Imaging device and its control method, program

Abstract

This technology suppresses image quality degradation when stitching RAW images acquired during panoramic shooting into a panorama, and also enables panoramic shooting with the user experience of the photographer in mind. [Solution] An imaging device comprising: an imaging means for capturing multiple RAW images; a setting means for setting shooting conditions when capturing the multiple RAW images; a determination means for determining a region to be used for synthesis from the multiple RAW images; and a synthesis means for generating a synthesized RAW image by synthesizing the multiple regions, wherein the determination means determines the width of the region to be used for synthesis based on the shooting conditions, and if the width does not meet predetermined conditions, the setting means changes the shooting conditions or the determination means changes the width.

Description

Technical Field

[0001] The present invention relates to an imaging device, and particularly to an imaging device that cuts out and synthesizes a part from a plurality of images.

Background Art

[0002] Conventionally, there is a method of continuously shooting still images while panning an imaging device, and generating a wide-angle image (hereinafter referred to as a "panorama image") by cutting out and synthesizing the vicinity of the center of the continuously shot images in a strip shape.

[0003] In Patent Document 1, it is shown that when generating a panorama image, the images taken on a virtual cylinder are mapped and then synthesized. This is a process for reducing the step of the imaging part of the image when a plurality of images taken by panning are synthesized.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When mapping the images taken on a virtual cylinder as described in Patent Document 1, image quality degradation occurs depending on the image format. For example, in a general Bayer array as RAW format image data read from an imaging device, it is known that phenomena such as degradation of resolution and deterioration of false colors are likely to occur when geometric transformation is performed. Therefore, when performing panorama synthesis involving geometric transformation using RAW format image data, it is necessary to suppress degradation of image quality.

[0006] This invention was made in view of the above problems, and aims to suppress the degradation of image quality when combining RAW images acquired during panoramic shooting into a panorama, and to realize panoramic shooting that also takes into consideration the user-friendliness of the photographer. [Means for solving the problem]

[0007] The imaging device according to the present invention comprises: an imaging means for capturing a plurality of RAW images for the synthesis of a panoramic image; a setting means for setting shooting conditions when capturing the plurality of RAW images; a cropping means for determining the width of a first region to be cropped from each of the plurality of RAW images; and a synthesis means for combining a plurality of the first regions to synthesize a panoramic image, wherein the cropping means sets the width of the first region to be cropped from the plurality of RAW images based on the shooting conditions, and if the width of the first region does not satisfy a predetermined condition, the setting means changes the shooting conditions or the cropping means changes the set width of the first region. [Effects of the Invention]

[0008] According to the present invention, the degradation of image quality when combining RAW images acquired during panoramic shooting into a panorama is suppressed, and panoramic shooting that also takes into consideration the user-friendliness of the photographer is achieved. [Brief explanation of the drawing]

[0009] [Figure 1] Block diagram showing the hardware configuration of a digital camera according to an embodiment of the present invention. [Figure 2] Flowchart illustrating panoramic imaging in embodiments of the present invention [Figure 3] A flowchart illustrating how to determine various conditions during panoramic photography in embodiments of the present invention. [Figure 4] This figure illustrates the composite ratio during panoramic synthesis in an embodiment of the present invention. [Modes for carrying out the invention]

[0010] Preferred embodiments of the present invention will be described below with reference to the attached drawings. In each drawing, the same reference numeral is used for the same member or element, and redundant explanations will be omitted or simplified. Furthermore, the following description will focus on an example where the imaging device is a digital (still) camera. However, the imaging device may also include electronic devices such as movie cameras, smartphones with cameras, tablet computers with cameras, in-vehicle cameras, and network cameras.

[0011] (First embodiment) Figure 1 is an example of a block diagram showing the structure of a digital camera as an image processing device according to this embodiment. The digital camera 100 can continuously capture still images and store the data of the captured images. In this embodiment, it is explained that the type of still image captured continuously is an image in RAW format.

[0012] The control unit 101 is a signal processor such as a CPU or MPU, and controls various parts of the digital camera 100 by reading and executing various programs stored in the ROM 105, which will be described later. For example, as will be described later, the control unit 101 issues commands to the imaging unit 103, which will be described later, to start and end imaging. Alternatively, it issues commands to the image processing unit 107, which will be described later, for image processing based on a program stored in the ROM 105. Commands from the user are input to the digital camera 100 by the operation unit 110, which will be described later, and reach various parts of the digital camera 100 through the control unit 101.

[0013] The optical system 102 includes lenses, an aperture, and a drive unit that drives these optical components, and forms an image of light from the subject on the imaging unit 103. The imaging unit 103 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The image sensor performs photoelectric conversion on the optical image formed by the optical system 102 to form an analog image signal and functions as an imaging means for generating a captured image. The analog image signal is converted to digital image data by the A / D (analog / digital) conversion unit of the imaging unit 103. The converted digital image data is stored in the RAM 106 via the image processing unit 107.

[0014] The detection unit 104 includes a gyro sensor and an accelerometer, and acquires angular velocity information, acceleration information, and attitude information of the digital camera 100. The detection unit 104 can also detect vibrations such as shaking and swaying of the digital camera 100.

[0015] ROM105 is a read-only non-volatile memory used as a recording medium, and it stores the operating programs for each block of the digital camera 100, as well as parameters necessary for the operation of each block.

[0016] RAM 106 is a rewritable volatile memory used as a temporary storage area for data output during the operation of each block of the digital camera 100. RAM 106 has a storage capacity that can store a predetermined number of still images, panoramic images (wide-angle images), etc. In addition, RAM 106 can also be used as a work area for the control unit 101 to load programs and other data read from ROM 105.

[0017] The image processing unit 107 can perform various image processing or compositing processes such as white balance adjustment, color interpolation, reduction / enlargement, filtering, etc. on the image data stored in the RAM 106 or recorded on the storage medium 109. Also, it performs compression processing and development processing on the image data captured by the imaging unit 103 according to standards such as JPEG.

[0018] As a panorama compositing process described later, the image processing unit 107 can generate a panorama image by compositing a plurality of images. It also has an image compositing processing circuit for judging the result of the panorama composition. Instead of the configuration including the image processing unit 107, a configuration may be adopted in which the function of the image compositing process is realized by software processing by the control unit 101. For example, a configuration may be adopted in which the control unit 101 can execute part or all of the functions corresponding to the image processing unit 107 according to the program read from the ROM 105.

[0019] The display unit 108 includes a display device such as an LCD (Liquid Crystal Display), and performs through-image display of the captured image acquired by the imaging unit 103. Also, the display unit 108 displays the image data temporarily stored in the RAM 106, or the image data stored in the storage medium 109 described later, data such as characters and images, and a so-called graphical user interface such as a menu.

[0020] The operation unit 110 is, for example, buttons, switches, keys, mode dials, etc. attached to the digital camera 100, or a touch panel also used as the display unit 110. Instructions from the user reach the control unit 101 via the operation unit 110.

[0021] In addition, the RAW image in this embodiment is data that is saved as it is without performing development processing on the digital data of the image captured by the imaging unit 103 without changing the arrangement of the color components of the digital data, so it cannot be directly displayed on the display unit 108. However, since the RAW image has not been compressed or the like, the user can later develop it by selecting an arbitrary method.

[0022] FIG. 2 is a flowchart for explaining panoramic shooting in this embodiment. The processing of the flow shown in FIG. 2 starts when the user sets the mode of the digital camera 100 to the panoramic shooting mode. The mode can be set, for example, by operating a mode setting dial corresponding to the operation unit 110 or by operating a menu displayed on the touch panel also used by the display unit 108. Also, a mode setting button (not shown) may be provided on the digital camera 100 so that the panoramic shooting mode can be set by operating the mode setting button.

[0023] Also, in this embodiment, as described above, it is assumed that a RAW format image (RAW image) in a Bayer array is acquired as a material for panoramic synthesis in panoramic shooting, and a RAW format panoramic image (synthesized RAW image) is generated from a plurality of RAW images, and the description will proceed on this premise. Note that the user may be able to select the data format of the image to be recorded at the time of mode setting. For example, it is also possible to select a setting in which data of an image in JPEG format is also recorded together with the data of the RAW image.

[0024] First, in step S201, the control unit 101 determines the conditions for panoramic shooting. Details of the method for determining the conditions will be described later.

[0025] Next, in step S202, panoramic shooting is performed with the digital camera 100. For example, shooting starts when the user gives a shooting command to the digital camera 100 via the operation unit 110. The method of giving the instruction to start shooting is not limited to this. While the user is panning the digital camera 100, the control unit 101 causes the imaging unit 103 to perform imaging based on the shooting conditions determined in step S201. The captured image is temporarily recorded in the RAM 10 and used later to generate the panoramic image.

[0026] In step S203, the control unit 101 determines whether to continue or terminate panoramic shooting. For example, this could be done by determining whether there is an instruction to terminate shooting via the operation unit 110, or whether the upper limit of the data capacity that can be recorded in RAM 106 has been exceeded, but is not limited to these methods. If the control unit 101 determines to terminate panoramic shooting, the process proceeds to step S204.

[0027] In step S204, the image processing unit 107 cuts out strips of RAW images from the RAW image acquired in step S202 for panoramic stitching. The width of the cut-out strips of RAW images is determined in step S201 as a condition for panoramic shooting.

[0028] In step S205, the image processing unit 107 performs alignment processing on the strip RAW images extracted in step S204. The alignment processing of the strip RAW images involves calculating the amount of misalignment between the target strip RAW images and performing a conversion.

[0029] An example of a method for calculating the positional displacement is described below. First, the image processing unit 107 sets multiple blocks in the reference strip RAW image. Preferably, the size of each block set here is the same. Next, the image processing unit 107 sets a search range in the strip RAW image to be aligned, at the same positions as each block placed in the reference strip RAW image, but with a range wider than the size of the blocks in the reference panoramic strip image. Finally, the image processing unit 107 calculates the corresponding point in each search range of the strip RAW image to be aligned that minimizes the sum of absolute differences in brightness (SAD) with respect to the blocks in the reference strip RAW image. The positional displacement is calculated as a vector from the center of the blocks in the reference strip RAW image and the aforementioned corresponding point. In calculating the corresponding point as described above, in addition to SAD, the sum of squared differences or normalized cross-correlation may also be used.

[0030] Next, the image processing unit 107 calculates a conversion coefficient from the positional difference between the reference strip RAW image and the strip RAW image to be aligned. The image processing unit 107 uses, for example, a projection conversion coefficient as the conversion coefficient. However, the conversion coefficient is not limited to only projection conversion coefficients; affine conversion coefficients or simplified conversion coefficients consisting only of horizontal and vertical shifts may also be used.

[0031] The image processing unit 107 performs a geometric transformation on the target strip RAW image using the calculated transformation coefficient. For example, the transformation can be performed using the equation shown in equation (1).

[0032]

number

[0033] In equation (1), (x', y') represents the coordinates after the transformation, and (x, y) represents the coordinates before the transformation. Matrix A represents the transformation coefficients.

[0034] In step S206, the image processing unit 107 performs panoramic stitching of the strip RAW images. To minimize the visibility of the seams between the strip RAW images after alignment in step S205, weighted average stitching is performed using a stitching ratio curve as shown in Figure 4, based on the distance from a predetermined stitching boundary within the overlapping range of the strip RAW images. The stitching method here is not limited, and other methods such as additive averaging may also be used. The above is the flow up to panoramic stitching.

[0035] Next, we will explain in detail how to determine the panoramic shooting conditions in step S201 using the flowchart in Figure 3.

[0036] First, in step S301, the control unit 101 provisionally sets the shooting conditions for panoramic shooting. The shooting conditions provisionally set here include the target composite field of view when performing panoramic stitching, the frame rate during panoramic shooting, etc. The shooting conditions provisionally set here also depend on the buffer capacity of RAM 106, the processing performance of the image processing unit 107 for panoramic stitching, and the exposure conditions of the digital camera 100 at the time of shooting. It is assumed that the shooting conditions provisionally set are pre-set internally in each digital camera 100.

[0037] Regarding the provisionally set shooting conditions, for example, the target composite field of view can be any value, but it is preferable that it be set so that the field of view of the composited image is greater than or equal to a predetermined size. That is, it is preferable that the target composite field of view is set so that the panoramic image has a field of view and image size greater than or equal to a predetermined value. Furthermore, the processing performance of the panoramic stitching of the image processing unit 107 is determined by the panoramic stitching algorithm and the engine performance of the control unit 101 and the image processing unit 107. In addition, the shooting frame rate may also be predetermined to a value corresponding to the exposure conditions (shutter speed, etc.).

[0038] In step S302, the control unit 101 determines the number of images that can be taken before the buffer prepared for panoramic shooting in RAM 106 becomes full, based on the shooting conditions provisionally set in S301 (the number of images that can be taken). The number of images that can be taken can be determined from the capacity of the buffer prepared in RAM 106 for panoramic shooting, the capacity required to record each RAW image acquired during panoramic shooting, the shooting frame rate, and the processing performance of the image processing unit 107. Specifically, let the buffer capacity be Cbuffer [bytes], the capacity required to record each RAW image be Coneshot [bytes / image], the shooting frame rate be Sshot [images / sec], and the processing performance of the image processing unit 107 (the number of images that can be processed per unit time) be Sproc [images / sec]. The number of images that can be taken at this time, Nfull [images], is Nfull=Cbuffer *Sshot / ((Sshot-Sproc)* Coneshot) ...(1) This can be calculated. However, in reality, the capacity required to record each RAW image fluctuates during panoramic shooting. Therefore, the capacity required to record each RAW image may be determined by, for example, referring to the recording size of the RAW image data acquired by the imaging unit 103 immediately before the instruction to start panoramic shooting. Alternatively, since it is sufficient to estimate the number of images that can be taken, the capacity required to record each RAW image may be set to a predetermined value.

[0039] In step S303, the control unit 101 determines the width of the strip to be cut out from each RAW image acquired during panoramic shooting. The width of the strip to be cut out can be determined, for example, from the number of images that can be taken and the field of view after combining. Specifically, if the field of view after combining is Acomposite[deg], then the width of the field of view per strip, Astripe[deg / image], is Astripe=Acomposite / Nfull ···(2) This can be calculated using the following formula. Note that the field of view width per strip calculated using formula (2) is a value assuming that all images corresponding to the number of possible shots are used in the composite, but in reality, panoramic shooting may end before reaching the upper limit of the number of possible shots. This is merely an approximate value of the field of view width per strip at the time of provisional settings. Whether to use this value for subsequent panoramic shooting will be determined in step S304 and later.

[0040] In step S304, the control unit 101 calculates the ratio of the field of view width of one strip calculated in step S303 to the total field of view of one RAW image to be captured. If the total field of view of one RAW image is Afull[deg], then the ratio Rstripe[%] of the field of view width of one strip to the total field of view of one RAW image used for combining panoramic RAW images is Rstripe=Astripe / Afull ···(3) This can be calculated. Note that the overall field of view Afull[deg] of a single RAW image is a value that depends on the lens focal length of the optical system 102 and the size of the sensor of the imaging unit 103.

[0041] Note that the overall field of view of a single RAW image, Afull[deg], depends not only on the size of the sensor in the imaging unit 103, but also on the settings for the size of the recorded image, image processing, and the size of the sensor's readout area. For example, the field of view of a single captured RAW image may be adjustable by the image processing unit 107. In that case, the image processing unit 107 may crop the RAW image read from the image sensor to a predetermined size, and define the field of view of the cropped RAW image as Afull[deg].

[0042] In step S305, the control unit 101 determines whether the value obtained in S304 (ratio of strip width) is acceptable. Specifically, a threshold may be set for the ratio of strip width, and if it is within the threshold, the control unit 101 may determine that the current ratio of strip width is acceptable. It is generally known that the larger the ratio of strip width, the more image quality degradation occurs during geometric transformation of RAW images when performing panoramic stitching. Therefore, it is preferable to set an upper limit on the ratio of strip width used for stitching from the field of view of each RAW image.

[0043] Furthermore, a lower limit may be set on the ratio of the field of view per RAW image to the width of the strip used for stitching. Theoretically, reducing the ratio of the strip width suppresses the degradation of image quality during geometric transformation of RAW images when creating a panorama. However, as shown in (2), the relationship between the field of view after stitching (field of view of the panoramic RAW image) and the width of the field of view per strip is such that a smaller ratio of the strip width requires more RAW images for stitching. In other words, this is limited by the buffer capacity used to temporarily store the necessary materials for stitching. Also, the more images required for stitching, the longer the stitching process takes, which leads to a decrease in usability. Therefore, a lower limit may be set on the ratio of the strip width.

[0044] Furthermore, the threshold values ​​(upper and lower limits) for the ratio of the strip width can be determined, for example, by experimentally investigating the relationship between the ratio of the strip width and the degree of image quality degradation.

[0045] If the control unit 101 determines that the ratio of the strip width is acceptable, the process proceeds to step S307; otherwise, the process proceeds to step S306.

[0046] Furthermore, in this embodiment, the determination was made based on the ratio of the field of view width of each strip to the overall field of view of a single RAW image, but the determination may also be made based on the width (size) of each strip. As mentioned above, the larger the ratio of the strip width to the RAW image, the more image quality degradation occurs during the geometric transformation of the RAW image when performing panoramic stitching. This means that if the strip has a width greater than a predetermined size, image quality degradation occurs during the geometric transformation of the RAW image. Therefore, in step S305, it may be determined whether the width of the strip is acceptable or not based on the width of each strip determined in step S303.

[0047] In step S306, the control unit 101 resets the shooting conditions. To reduce the ratio of the strip width to within the acceptable range, it is necessary to reduce, for example, Astripe[deg]. Specifically, the ratio of the strip width can be reduced by increasing the buffer capacity Cbuffer[bytes] of RAM 106 or by reducing the difference between the shooting frame rate and the processing speed of the image processing unit 107. Once the control unit 101 has reset the shooting conditions in this way, the process proceeds to step S302.

[0048] In step S307, the control unit 101 calculates the swing speed during panoramic shooting. The swing speed Sswing [deg / sec] is Sswing=Acomposite / (Nfull / Sshot)...(4) This can be calculated using the formula provided. This value corresponds to the recommended panning speed for the user during panoramic shooting.

[0049] Next, in step S308, the control unit 101 determines whether the swing speed calculated in S307 is within a predetermined range. In panoramic photography, the user generally pans the digital camera 100 while shooting, so if the swing speed calculated in S307, i.e., the speed required for panning, is too fast or too slow, panoramic photography becomes difficult. Therefore, an upper limit and a lower limit are set for the swing speed required when actually performing panoramic photography. It is desirable to determine the upper and lower limits of the swing speed experimentally, for example, and to set them based on the user experience when actually performing panoramic photography. Note that the method of setting the upper and lower limits is not limited to this.

[0050] If the control unit 101 determines that the swing speed calculated in S307 is within a predetermined range, the shooting conditions for panoramic shooting are determined, and this flow ends. On the other hand, if the control unit 101 determines that the swing speed calculated in S307 is not within a predetermined range, the process proceeds to step S309.

[0051] In step S309, the control unit 101 determines that the shooting conditions need to be reset and changes the shooting settings. Here, if Sswing [deg / sec] is increased, Acomposite [deg] and the shooting frame rate Sshot [frames / sec] must be increased. Conversely, if Sswing [deg / sec] is decreased, the shooting frame rate Sshot [frames / sec] must be decreased, or the buffer capacity Cbuffer [bytes] must be increased. With these reset conditions, the system proceeds to step S302.

[0052] Furthermore, in step S309, the shooting conditions can be read out by limiting the readout area of ​​the image sensor in the imaging unit 103, thereby increasing the shooting frame rate Sshot [frames / sec]. By limiting the readout area of ​​the image sensor, it is possible to generate image data from signals from only a portion of the image sensor in the imaging unit 103. Using this, for example, the readout area of ​​the image sensor in the imaging unit 103 can be brought closer to the size of the strip width required for synthesis. In this way, by performing readout from an area smaller than the entire image sensor, the readout speed is improved, and the shooting frame rate Sshot [frames / sec] can be increased. Note that such adjustments to the shooting conditions may also be made in steps S301 and S306 as needed.

[0053] Based on the above, it is possible to present appropriate shooting conditions when generating a panoramic RAW image by capturing multiple RAW images during panoramic photography. This suppresses the degradation of image quality when stitching RAW images acquired during panoramic photography into a panorama, and further enables panoramic photography that takes into account the user's convenience.

[0054] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or recording medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. Furthermore, each function may be divided into those that are executed by the processor reading the program and those that are executed by the circuit, and these may be combined.

[0055] Furthermore, although preferred embodiments of the present invention have been described, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist. The disclosure of this embodiment includes the following items.

[0056] (Item 1) An imaging device comprising: an imaging means for capturing multiple RAW images; a setting means for setting shooting conditions when capturing the multiple RAW images; a determination means for determining a region to be used for synthesis from the multiple RAW images; and a synthesis means for generating a synthesized RAW image by synthesizing the multiple regions, wherein the determination means determines the width of the region to be used for synthesis based on the shooting conditions, and if the width does not meet predetermined conditions, the setting means changes the shooting conditions or the determination means changes the width.

[0057] (Item 2) The imaging device according to Item 1, characterized in that the predetermined condition is that the width is smaller than the first threshold.

[0058] (Item 3) The imaging device according to Item 1 or 2, characterized in that the predetermined condition is that the ratio of the width to the angle of view corresponding to the plurality of RAW images is smaller than the first threshold.

[0059] (Item 4) The imaging apparatus according to any one of items 1 to 3, characterized in that the setting means sets the shooting conditions based on the processing speed of the synthesis means.

[0060] (Item 5) The imaging apparatus according to any one of Items 1 to 4, characterized in that the synthesis means performs synthesis by performing geometric transformations on a plurality of regions.

[0061] (Item 6) The imaging apparatus according to any one of Items 1 to 5, characterized in that the imaging means captures a RAW image of a Bayer array.

[0062] (Item 7) The imaging device according to any one of items 1 to 6, characterized in that the composite RAW image has a wider field of view than the field of view of each of the plurality of RAW images.

[0063] (Item 8) A control method for an imaging device, comprising: an imaging step of capturing multiple RAW images; a setting step of setting shooting conditions when capturing the multiple RAW images; a determination step of determining a region to be used for synthesis from the multiple RAW images; and a synthesis step of generating a synthesized RAW image by synthesizing the multiple regions, wherein in the determination step the width of the region to be used for synthesis is determined based on the shooting conditions, and if the width does not meet predetermined conditions, the shooting conditions are changed in the setting step or the width is changed in the determination step.

[0064] (Item 9) A program to cause a computer to function as one of the means of an imaging apparatus described in any one of Items 1 through 7. [Explanation of Symbols]

[0065] 100 Digital Cameras 101 Control Unit 102 Optical system 103 Imaging Unit 104 Detection unit 105 ROM 106 RAM 107 Image Processing Unit 108 Display section 109 Storage medium 110 Operation section

Claims

1. An imaging means for capturing multiple RAW images, A setting means for setting the shooting conditions when capturing the aforementioned multiple RAW images, A determination means for determining the region to be used for synthesis from the plurality of RAW images, The system includes a synthesis means for generating a composite RAW image by combining multiple such regions, The determination means determines the width of the region to be used for synthesis based on the shooting conditions, An imaging apparatus characterized in that, if the width does not meet predetermined conditions, the setting means changes the shooting conditions or the determination means changes the width.

2. The imaging apparatus according to claim 1, characterized in that the predetermined condition is that the width is smaller than the first threshold.

3. The imaging apparatus according to claim 1, characterized in that the predetermined condition is that the ratio of the width to the field of view corresponding to the plurality of RAW images is smaller than the first threshold.

4. The imaging apparatus according to claim 1, characterized in that the setting means sets the shooting conditions based on the processing speed of the synthesis means.

5. The imaging apparatus according to claim 1, characterized in that the synthesis means performs synthesis by performing geometric transformations on a plurality of regions.

6. The imaging apparatus according to claim 1, characterized in that the imaging means captures a RAW image of a Bayer array.

7. The imaging apparatus according to claim 1, characterized in that the composite RAW image has a wider field of view than each of the plurality of RAW images.

8. An imaging step in which multiple RAW images are captured, A setting step for setting the shooting conditions when capturing the multiple RAW images, A determination step of determining the region to be used for synthesis from the plurality of RAW images, The process includes a synthesis step of generating a composite RAW image by combining multiple such regions, In the aforementioned determination step, the width of the region to be used for synthesis is determined based on the shooting conditions, A method for controlling an imaging device, characterized in that, if the width does not meet predetermined conditions, the shooting conditions are changed in the setting step or the width is changed in the determination step.

9. A program for causing a computer to function as one of the means of an imaging apparatus according to any one of claims 1 to 7.

Images