Image processing device and image processing method, imaging device, imaging system, program

Abstract

To further reduce the gap between a display image and a photographic image when perform photography while controlling exposure settings.SOLUTION: An imaging system comprises an imaging apparatus 110 and a strobe light 120. A first display image creation unit 202 executes image processing on acquired pre-photography data to create a first display image. A photometric data generation unit 203 generates photometric data based on the pre-photography data. A position information determination unit 204 determines position information corresponding to a plurality of areas in an image based on the photometric data. An exposure correction information limitation unit 205 determines a limit range of exposure correction information corresponding to the plurality of areas. An exposure correction information selection unit 206 performs processing of selecting the exposure correction information corresponding to the plurality of areas. An exposure setting determination unit 207 determines exposure settings based on the selected exposure correction information. A second display image creation unit 208 executes image processing on image data based on the exposure settings to create a second display image.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to techniques for controlling exposure settings and image processing.

Background Art

[0002] When taking a picture using a strobe, in order to obtain a desired image, the photographer may repeat taking pictures while changing the settings related to the exposure of the strobe and the camera (hereinafter also referred to as exposure settings) many times. This can be a burden on the photographer and the subject person.

[0003] Patent Document 1 discloses an imaging device and an exposure amount control method capable of taking a picture with a suitable exposure during flash photography regardless of whether it is a backlight scene. First photometric information when strobe light is irradiated before shooting and second photometric information when strobe light is not irradiated are obtained, and the exposure setting of the camera is performed so as to obtain an appropriate exposure based on the first and second photometric information.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the technique disclosed in Patent Document 1, the photographer cannot arbitrarily adjust the exposure of each of the main subject area and the background area. In order to arbitrarily adjust each exposure related to the main subject area and the background area, it is necessary to control not only the exposure settings of the camera but also those of the strobe, so the operation becomes complicated.

[0006] One method to provide a function that allows for easy and arbitrary adjustment of the exposure for the main subject area and background area is to display an exposure simulation image on the camera's live view screen, enabling the photographer to confirm the settings. The photographer adjusts the exposure compensation parameter, and the flash and camera exposure settings are controlled based on the adjusted exposure compensation parameter to take the picture. With this method, depending on the exposure settings, there is a possibility that the exposure simulation image and the actual image taken may differ significantly. The present invention aims to reduce the discrepancy between the displayed image and the captured image when taking pictures while controlling the exposure settings. [Means for solving the problem]

[0007] An apparatus according to an embodiment of the present invention is an image processing apparatus that acquires image data and performs image processing, comprising: a first generation means for generating a first display image based on the image data; a photometric data generation means for generating photometric data based on the image data; a position information determination means for determining position information corresponding to a plurality of regions in the image from the photometric data; a limiting means for determining a settable range of exposure compensation information corresponding to the plurality of regions; a selection means for performing selection processing of exposure compensation information corresponding to the plurality of regions; an exposure setting determination means for determining an exposure setting based on the exposure compensation information selected within the settable range; and a second generation means for generating a second display image based on the exposure setting. The limiting means calculates feasible combinations of exposure compensation information corresponding to sets of exposure change rates in the plurality of regions based on the photometric data and the position information, determines the feasible combinations as the settable range of the exposure compensation information, notifies the settable range of the exposure compensation information, and the selection means selects the exposure compensation information corresponding to the plurality of regions based on an operation specifying the exposure compensation information corresponding to the plurality of regions in the settable range determined by the limiting means. [Effects of the Invention]

[0008] According to the image processing apparatus of the present invention, when taking pictures while controlling the exposure settings, the discrepancy between the displayed image and the captured image can be made smaller. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing an example configuration of the imaging system in the embodiment. [Figure 2] This is a block diagram illustrating the functions of the camera processing unit shown in Figure 1. [Figure 3] This is a flowchart illustrating the process in the first embodiment. [Figure 4] This is a schematic diagram showing an example of the display of the configurable range related to exposure control. [Figure 5] This is a flowchart illustrating the process in the second embodiment. [Modes for carrying out the invention]

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The embodiments show an example of an imaging system to which the image processing apparatus according to the present invention is applied.

[0011] [First Example] Figure 1 is a block diagram showing an example configuration of the imaging system of this embodiment. The imaging system consists of an imaging device 110 and a strobe 120. The strobe 120 is a light-emitting device for imaging. The imaging device 110 is equipped with a camera connection unit 111, and the strobe 120 is equipped with a strobe connection unit 121. The imaging device 110 and the strobe 120 are connected by the camera connection unit 111 and the strobe connection unit 121, and can communicate with each other. The communication method is not limited to any particular method, and wireless or wired communication is possible.

[0012] The imaging device 110 includes a camera connection unit 111, a camera control unit 112, an imaging unit 113, a camera operation unit 114, a camera display unit 115, and a camera processing unit 116. Each component of the imaging device 110 is interconnected by a system bus. The strobe 120 includes a strobe connection unit 121, a strobe control unit 122, and a light-emitting unit 123. Each component of the strobe 120 is interconnected by a system bus.

[0013] First, let's explain the configuration of the imaging device 110. The camera control unit 112 includes, for example, a CPU (Central Processing Unit) and controls the operation of the imaging system. The imaging unit 113 includes an imaging optical system, an image sensor, and an A / D conversion unit. The imaging optical system forms an optical image by imaging light from the subject. The image sensor performs photoelectric conversion on the generated optical image and outputs an analog signal as an electrical signal. The A / D conversion unit converts the analog signal output by the image sensor into a digital signal and outputs image data.

[0014] The camera control unit 114 is equipped with operating elements such as buttons, dials, and a touch panel, and receives user operation instructions. The camera control unit 114 transmits signals corresponding to the operation instructions to the camera control unit 112.

[0015] The camera display unit 115 is equipped with a display device such as an LCD (liquid crystal display device) and displays the display image and various information generated by the camera processing unit 116. In embodiments in which a touch panel or the like is provided on the display screen, the camera display unit 115 displays an interface screen for receiving user operation instructions.

[0016] The camera processing unit 116 performs various processes on the digital image signal output by the imaging unit 113. These processes include, for example, image processing, analysis based on the digital image signal, and determining control parameters for when the camera control unit 112 and the strobe control unit 122 perform control.

[0017] Next, the configuration of the strobe 120 will be described. The strobe control unit 122 includes, for example, a CPU and controls the operation of each component of the strobe 120. The light-emitting unit 123 emits light according to the instructions of the strobe control unit 122, illuminating the subject with light. The amount of light emitted by the light-emitting unit 123 is variable, and the strobe control unit 122 controls the light-emitting unit 123 according to the commands related to the amount of light emitted determined by the camera processing unit 116.

[0018] In the imaging system of FIG. 1, when shooting is performed using the flash 120, the imaging device 110 and the flash 120 communicate with each other via the camera connection portion 111 and the flash connection portion 121. The imaging system can appropriately control the exposure setting and perform a cooperative operation. The exposure setting includes settings such as the aperture value of the imaging optical system, the shutter speed, the ISO sensitivity, and the emission intensity of the flash. For example, in the exposure setting, a value selected from a plurality of predetermined values (candidate values within the controllable range) is set. Note that the exposure setting method is not limited to a specific method.

[0019] FIG. 2 is a block diagram for explaining the functions of the camera processing unit 116. Each component of the camera processing unit 116 is interconnected by a system bus (not shown) and is also connected to each component of the imaging device 110. It is assumed that each component can acquire the information acquired by the component in the previous stage.

[0020] The camera processing unit 116 includes a pre-shooting data acquisition unit 201, a first display image generation unit 202, a photometry data generation unit 203, and a position information determination unit 204. The pre-shooting data acquisition unit (hereinafter referred to as the acquisition unit) 201 controls the imaging device 110 and the flash 120, causes both to operate cooperatively, and acquires pre-shooting data. The first display image generation unit 202 performs image processing on the pre-shooting data acquired by the acquisition unit 201 to generate a first display image.

[0021] The photometry data generation unit 203 performs image processing on the pre-shooting data acquired by the acquisition unit 201 to generate photometry data. The position information determination unit 204 determines position information corresponding to a plurality of regions in the image based on the photometry data generated by the photometry data generation unit 203. For example, among the plurality of regions, the first region corresponds to the main subject, and the second region corresponds to areas other than the main subject (background, etc.).

[0022] The camera processing unit 116 further includes an exposure compensation information limiting unit 205, an exposure compensation information selection unit 206, an exposure setting determination unit 207, and a second display image generation unit 208. The exposure compensation information limiting unit (hereinafter referred to as the limiting unit) 205 determines the limiting range of the exposure compensation information based on the photometric data generated by the photometric data generation unit 203 and the position information determined by the position information determination unit 204. The exposure compensation information selection unit (hereinafter referred to as the selection unit) 206 selects the exposure compensation information according to the user's input.

[0023] The exposure setting determination unit 207 determines the exposure setting based on the photometric data generated by the photometric data generation unit 203, the location information determined by the location information determination unit 204, and the exposure compensation information selected by the selection unit 206.

[0024] The second display image generation unit 208 performs the generation process of a second display image by applying predetermined image processing to the pre-shot data acquired by the acquisition unit 201. The predetermined image processing includes exposure simulation processing that takes into account the exposure setting determined by the exposure setting determination unit 207. The second display image generation unit 208 performs the generation process of a second display image according to the location information determined by the location information determination unit 204 and the exposure setting determined by the exposure setting determination unit 207.

[0025] Referring to Figure 3, the process in this embodiment will be explained. First, in S301, the acquisition unit 201 acquires the following pre-shooting data. Image data corresponding to the use of strobe light on a subject (hereinafter referred to as strobe-on data). Image data corresponding to the case where the subject is not illuminated by strobe light (hereinafter referred to as strobe-off data).

[0026] Next, in S302, the first display image is generated and displayed. For example, the first display image generation unit 202 generates the data for the first display image by applying various image processing such as white balance processing, noise reduction processing, color interpolation processing (debayering), and gamma processing to the acquired strobe-on data of the Bayer array. At this time, strobe-off data may be used instead of strobe-on data, or strobe-on data and strobe-off data may be used in combination. The camera display unit 115 displays the generated first display image on the screen. Then the process proceeds to S303.

[0027] In S303, the photometering data generation unit 203 generates photometering data. Photometering data based on strobe-on data (hereinafter referred to as strobe-on photometering data) and photometering data based on strobe-off data (hereinafter referred to as strobe-off photometering data) are generated. Each piece of photometering data corresponds to the light intensity of the shooting scene corresponding to each pixel. In the photometering data generation process, for example, interpolation processing is performed on the image data stored in a Bayer array to generate three-plane data of R (red), G (green), and B (blue). Then, for each pixel, linear combination processing is performed on the R, G, and B values ​​using predetermined linear coefficients to generate photometering data. Next, the process proceeds to S304.

[0028] In S304, the location information determination unit 204 determines the location information. The location information is either calculated automatically or determined according to user specifications. Here, the automatic calculation and determination methods are described.

[0029] The position information determination unit 204 uses the strobe-on metering data and the strobe-off metering data to determine a first position information corresponding to the main subject area in the image and a second position information corresponding to the background area in the image. For example, a process is performed to calculate the strobe influence (denoted as D) using the strobe-off metering data and the strobe-on metering data. The area where the value of the strobe influence D is largest is determined to be the main subject area, and the area where it is smallest is determined to be the background area. The strobe influence D is calculated, for example, by the following formula (1). D(p)=1-OFF(p) / ON(p) Equation (1) In equation (1), OFF represents strobe-off metering data, and ON represents strobe-on metering data. p represents the positions of multiple pixels that make up the image data, and is usually a two-dimensional vector representing the vertical and horizontal positions. D(p), OFF(p), and ON(p) are all functions of p.

[0030] In calculating the strobe influence D, the calculation is not limited to using strobe-on metering data and strobe-off metering data; distance information from the imaging means to the subject (subject distance information) can be used instead of metering data. In that case, the pre-shooting data acquired by the acquisition unit 201 includes subject distance information. For example, it is possible to determine the area where the subject distance information satisfies predetermined conditions (distance range, etc.) as the main subject area, and determine the area other than the main subject area as the background area.

[0031] The location information determined in S304 is displayed on the screen, for example, by the camera display unit 115. The user can change the location information using the camera operation unit 114 while viewing the display screen. The process then proceeds to S305.

[0032] In S305, the configurable range is set and notification processing is performed. The limiting unit 205 determines the configurable range using the strobe influence corresponding to the main subject area and the strobe influence corresponding to the background area. The exposure compensation information indicates how many times the exposure at the time of shooting should be corrected compared to a predetermined exposure. The predetermined exposure is the exposure that the imaging device 110 determines to be optimal, or the exposure when acquiring pre-shooting data. For example, the exposure compensation information when shooting at k times the brightness (increased light intensity) is k. Alternatively, log2(k) may be used as the exposure compensation information using the base 2 logarithmic function log.

[0033] The following shows an example of controlling the aperture value, shutter time, ISO sensitivity, and flash intensity of the imaging device as exposure settings. The percentage changes of various quantities compared to the pre-shooting data acquired with S301 are defined as follows. • Rate of change of ISO sensitivity S • Rate of change of aperture area due to changing the aperture value A • Rate of change T of shutter time • Rate of change of strobe light intensity F

[0034] The exposure change rate in the main subject area is denoted as k1, and the exposure change rate in the background area is denoted as k2. k1 and k2 can be calculated using the following formulas (2) and (3). k1=S×A×T×(1-D1)+S×A×F×(D1) Formula (2) k2=S×A×T×(1-D2)+S×A×F×(D2) Equation (3) In equation (2), D1 is the strobe influence corresponding to the main subject area. In equation (3), D2 is the strobe influence corresponding to the background area.

[0035] The limiting unit 205 calculates the possible combinations of (k1, k2) when each exposure setting is changed within the controllable range, and outputs them as the configurable range. The camera display unit 115 displays the corresponding configurable range to notify the user. The process proceeds from S305 to S306.

[0036] In S306, the selection unit 206 performs the process of selecting exposure compensation information. For example, the user checks the configurable range displayed on the camera display unit 115 and operates the camera operation unit 114 to indicate the desired exposure compensation information. The selection unit 206 selects the exposure compensation information according to the instructions. A specific example will be explained with reference to Figure 4.

[0037] Figure 4 is a schematic diagram showing an example of the configurable range displayed by the camera display unit 115. The configurable range 400 is shown on the right side of Figure 4, and the display image 401 is shown on the left side of Figure 4. The camera display unit 115 displays the configurable range 400 on the screen. The horizontal axis represents the exposure change rate k1 in the main subject area, and the vertical axis represents the exposure change rate k2 in the background area. The data of the configurable range can be represented by plotting multiple black dots. The user indicates the black dot corresponding to the desired exposure change rate from the displayed configurable range. In the initial state, one of the multiple black dots is highlighted by being surrounded by a rectangular frame. The user can indicate the desired exposure change rate by moving this rectangular frame to the black dot that represents the desired exposure change rate. As interface methods for user operation instructions, there are methods using a touch panel on the display screen and methods using buttons such as a directional pad or a dial.

[0038] Among multiple exposure change rates, the exposure change rate specified by the user is selected as exposure compensation information. In other words, the selection unit 206 performs a process to select a pair of exposure change rates k1 in the main subject area and exposure change rates k2 in the background area, as specified by the user, and (k1,k2) is selected as exposure compensation information. At this time, the camera display unit 115 may display position information corresponding to the main subject and background areas. Display image 401 is an example of the first display image generated and displayed in S302. Markers 402 and 403, which indicate position information corresponding to the main subject area and background area, respectively, are superimposed on the display image 401. Marker 402 indicates position information corresponding to the main subject area, and marker 403 indicates position information corresponding to the background area. The positions of these markers may be made operable via a touch panel or the like, and the position information may be controlled to be changed according to the user's operation.

[0039] In step S307 of Figure 3, the exposure setting determination unit 207 determines the exposure setting that achieves the selected exposure change rate according to the user's instructions. The exposure setting is determined based on exposure compensation information (exposure change rate k1) corresponding to the main subject area, exposure compensation information (exposure change rate k2) corresponding to the background area, strobe influence D1 corresponding to the main subject area, and strobe influence D2 corresponding to the background area.

[0040] The method for determining exposure settings will be explained in detail. First, X and Y are defined by the following equations (4) and (5). X=S×A×T formula (4) Y = S × A × F Equation (5) By solving the simultaneous equations for X and Y using equations (4) and (5) with respect to equations (2) and (3), we obtain equations (6) and (7) below. X=k1×(-D2) / (D1-D2)-k2×(-D1) / (D1-D2) Equation (6) Y=k1×(1-D2) / (D1-D2)-k2×(1-D1) / (D1-D2) Equation (7)

[0041] Next, the rate of change S of ISO sensitivity, the rate of change A of aperture area due to changing the aperture value, the rate of change T of shutter time, and the rate of change F of flash intensity are determined to satisfy the following equations (8) and (9). S×A×T = X formula (8) S × A × F = Y Equation (9) There are multiple sets of S, A, T, F that satisfy the conditions of equations (8) and (9). By selecting one of these sets using a predetermined procedure, the exposure setting can be determined. For example, one method is to use a reference table. This method involves creating a look-up table in advance that defines one (S, A, T, F) for each (X, Y), and referencing it when setting the exposure. We also consider the case where there is a restriction on any of the quantities that make up the (S, A, T, F) set. For example, if the aperture value and shutter time are fixed according to the user's shooting intention, then A=1, T=1, and S=X, F=Y / X.

[0042] In step S308 of Figure 3, the second display image is generated and displayed. The second display image generation unit 208 generates the second display image by applying various image processing, such as white balance processing, noise reduction processing, color interpolation processing (debayering), and gamma processing, to the pre-shot data of the Bayer array acquired by the acquisition unit 201. At this time, exposure simulation processing is performed taking into account the exposure settings determined by the exposure setting determination unit 207. Since the exposure simulation processing is well known, a detailed explanation is omitted. The generated second display image is displayed by the camera display unit 115.

[0043] In S309, the camera control unit 112 determines whether to take a full image with the current exposure settings or to reset them. During full shooting, image data development and recording processing are performed. The user can operate the camera operation unit 114 to instruct the camera to take a full image or reset the settings. If it is determined that a full image should be taken, the process proceeds to S310. If it is determined that settings should be reset, the process proceeds to S304. In this case, if the user does not need to change the location information and only wants to change the exposure compensation information, S304 and S305 may be skipped and the process proceeds to S306.

[0044] In S310, the data for the captured image is acquired. The camera control unit 112 and the strobe control unit 122 work in coordination, and the imaging operation is performed based on the exposure setting determined by the exposure setting determination unit 207. After that, the series of processes is completed.

[0045] In the flowchart of Figure 3, we assume a case where exposure compensation information outside the settable range, rather than within the settable range explained in S305, is selected. In this case, although the second display image generated in S308 reflects the selected exposure compensation information, the exposure setting determined in S307 cannot reflect this exposure compensation information. Therefore, it is possible that the image actually captured and the second display image may differ. According to this embodiment, the occurrence of such a situation can be suppressed.

[0046] In this embodiment, the photographer checks the exposure simulation image displayed in advance and adjusts the exposure compensation parameters. Based on the exposure compensation parameters within the configurable range, the photographer controls the exposure settings for the strobe and imaging device to take the picture. This makes it possible to reduce the discrepancy between the exposure simulation image and the image actually taken.

[0047] While examples of using strobe-on and strobe-off data as pre-exposure data have been shown, the method is not limited to these examples. For example, instead of strobe-on data, image data corresponding to the case where the strobe light is strongly illuminated at a first light intensity can be used. Also, instead of strobe-off data, image data corresponding to the case where the strobe light is weakly illuminated at a second light intensity lower than the first light intensity can be used.

[0048] [Second Example] Referring to Figure 5, the process in the second embodiment will be described. Note that explanations of matters similar to those in the first embodiment will be omitted, and the differences will be explained primarily.

[0049] Following S304, S305b performs the setting and notification process of the recommended exposure range (hereinafter also referred to as the recommended range). The limiting unit 205 determines the recommended range for exposure compensation information based on the acquired pre-shooting data. As an example of how to determine the recommended range, we will explain a method in which the non-recommended range is determined first, and then all areas other than the non-recommended range are determined as the recommended range.

[0050] Assume that the pre-shot data includes areas where overexposure occurs. In this case, the limiting unit 205 determines the range of exposure compensation information in which the exposure change rate in that area is smaller than a predetermined threshold as a non-recommended range. Assume that the pre-shot data includes areas where underexposure occurs. In this case, the limiting unit 205 determines the range of exposure compensation information in which the exposure change rate in that area is larger than a predetermined threshold as a non-recommended range.

[0051] Alternatively, the limiting unit 205 determines the range of exposure compensation information in which false contours are determined to occur in the gradient area of ​​the generated second display image to be a non-recommended range. The limiting unit 205 also determines the range of exposure compensation information in which grain noise is determined to increase in the generated second display image due to a large rate of exposure change (i.e., the image is corrected to be brighter) to be a non-recommended range.

[0052] By determining the non-recommended range using the methods exemplified above, the portion that does not belong to any of the non-recommended ranges can be determined as the recommended range for exposure compensation information. In the recommended range notification process, for example, the camera display unit 115 displays the recommended range on the screen, distinguishing it from the non-recommended range.

[0053] Following S308, in S501, the camera processing unit 116 determines whether the exposure compensation information selected by the selection unit 206 falls within the recommended range determined by the limiting unit 205. If it is determined that the exposure compensation information falls within the recommended range, the process proceeds to S309b; otherwise, the process proceeds to S502.

[0054] In S502, the camera display unit 115 notifies the user that the exposure compensation information selected by the selection unit 206 is not recommended. Then the process proceeds to S309b.

[0055] In S309b, the camera control unit 112 determines, according to the user's operation instructions, whether to acquire the main image with the current exposure settings or to acquire pre-shot data again. If it is determined to acquire the main image, the process proceeds to S310. If it is determined to acquire pre-shot data again, the process proceeds to S301. In that case, the exposure setting determination unit 207 changes the exposure settings when acquiring pre-shot data.

[0056] Depending on the exposure compensation information selected by the selection unit 206, if the degradation of the second display image generated in S308 is significant, the actual image captured may differ from the second display image. In this embodiment, such a situation can be suppressed by presenting the user with a recommended range for setting the exposure compensation information.

[0057] In the above embodiment, the photographer can check the exposure simulation image displayed on the live view screen, etc., and adjust the exposure compensation parameters. By controlling the exposure settings related to the flash and camera based on the exposure compensation parameters, the discrepancy between the exposure simulation image and the image actually captured can be reduced.

[0058] [Other examples] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. [Explanation of Symbols]

[0059] 110 Imaging device 120 Strobe 202,208 First and second display image generation units 203 Photometric data generation unit 204 Location information determination unit 205 Exposure Compensation Information Limitation Section 206 Exposure Compensation Information Selection Section 207 Exposure setting determination unit

Claims

1. An image processing device that acquires image data and performs image processing, A first generation means for generating a first display image based on the aforementioned image data, A photometric data generation means for generating photometric data based on the aforementioned image data, A position information determination means that determines position information corresponding to multiple regions in an image from the aforementioned photometric data, A limiting means for determining the settable range of exposure compensation information corresponding to the aforementioned multiple regions, A selection means that performs a selection process for exposure compensation information corresponding to the aforementioned multiple regions, An exposure setting determination means that determines the exposure setting based on the exposure compensation information selected within the aforementioned configurable range, The system comprises a second generation means for generating a second display image based on the exposure setting, The limiting means calculates feasible combinations of exposure compensation information corresponding to sets of exposure change rates in the plurality of regions based on the photometric data and the position information, determines the feasible combinations as the settable range of the exposure compensation information, and notifies the settable range of the exposure compensation information. The selection means selects exposure compensation information corresponding to the plurality of regions based on an operation specifying exposure compensation information corresponding to the plurality of regions within the settable range determined by the limiting means. An image processing apparatus characterized by the following:

2. The system includes acquisition means for acquiring first image data when a strobe light is shone on the subject, and second image data when a strobe light is not shone on the subject. The image processing apparatus according to feature 1.

3. The system includes acquisition means for acquiring first image data when a strobe light is shone on a subject at a first light intensity, and second image data when a strobe light is shone on a subject at a second light intensity lower than the first light intensity. The image processing apparatus according to feature 1.

4. The photometric data generation means generates first photometric data based on the first image data and second photometric data based on the second image data. The position information determination means uses the first and second photometric data to determine a first position information corresponding to a first region in the image and a second position information corresponding to a second region in the image. The image processing apparatus according to claim 2 or 3.

5. The position information determination means determines the first and second position information based on the degree of influence of strobe light calculated from the first and second photometric data. The image processing apparatus according to feature 4.

6. It is equipped with an acquisition means that acquires distance information from the imaging means to the subject, The position information determination means uses the distance information to determine a first position information corresponding to a first region in the image and a second position information corresponding to a second region in the image. The image processing apparatus according to feature 1.

7. The first location information corresponds to the main subject area, and the second location information corresponds to the background area. The image processing apparatus according to any one of claims 4 to 6.

8. A display means for displaying the first and second display images, The system includes an operating means for specifying the positions of the first and second regions. The display means displays information corresponding to the first and second location information, respectively. The image processing apparatus according to any one of claims 4 to 7.

9. A notification means for notifying the settable range, The system includes an operating means for specifying the exposure compensation information within the settable range. The image processing apparatus according to any one of claims 1 to 7.

10. The location information determination means determines the first location information if the influence value is a first value, and determines the second location information if the influence value is a second value which is smaller than the first value. The image processing apparatus according to feature 5.

11. The limiting means determines the recommended range for setting the exposure compensation information. The image processing apparatus according to any one of claims 1 to 8.

12. If the exposure compensation information selected by the selection means does not fall within the recommended range, the system includes a notification means to that effect. The image processing apparatus according to feature 11.

13. If the exposure compensation information does not fall within the recommended range and image data acquisition is performed again, the exposure setting determination means changes the exposure setting. The image processing apparatus according to feature 12.

14. An imaging apparatus comprising an image processing apparatus according to any one of claims 1 to 13.

15. The imaging device according to claim 14, An imaging system comprising a light-emitting device for imaging.

16. An image processing method performed by an image processing device that acquires image data and performs image processing, A first generation step of generating a first display image based on the aforementioned image data, A photometric data generation step for generating photometric data based on the aforementioned image data, A position information determination step, which determines position information corresponding to multiple regions in the image from the aforementioned photometric data, A limitation step that determines the settable range of exposure compensation information corresponding to the multiple regions, A selection step which involves performing a selection process for exposure compensation information corresponding to the multiple regions, An exposure setting determination step in which the exposure setting is determined by the exposure compensation information selected within the above-mentioned settable range, The process includes a second generation step of generating a second display image based on the exposure setting, In the limiting step, based on the photometric data and the position information, feasible combinations of exposure compensation information corresponding to sets of exposure change rates in the plurality of regions are calculated, the feasible combinations are determined as the settable range of the exposure compensation information, and the settable range of the exposure compensation information is notified. In the selection step, exposure compensation information corresponding to the multiple regions is selected based on the operation of specifying the exposure compensation information corresponding to the multiple regions within the settable range determined in the limiting step. An image processing method characterized by the following:

17. A program that causes a computer to perform each of the steps described in claim 16.

Images