Image processing apparatus, imaging apparatus, method for controlling image processing apparatus, and program
Patent Information
- Application Number
- JP2022193344
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-12-02
- Publication Date
- 2025-12-03
AI Technical Summary
Existing imaging devices fail to provide a live view display that accurately represents the exposure image after additive synthesis of multiple images, making it difficult for users to set exposure settings and determine the number of images to capture.
An image processing device that includes an exposure setting unit, a number setting unit, a control unit, an imaging unit, a synthesis unit, and a live view image generation unit, which generates a simulation image corresponding to the exposure and number of images to be captured, allowing for real-time live view display.
Enables users to visualize the exposure result after additive synthesis, facilitating accurate setting of exposure and number of images, thereby improving the ability to capture desired composite images.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device and an imaging device capable of synthesizing a plurality of images. [Background technology]
[0002] It is generally known that when taking pictures with long exposure times, image blurring occurs due to shaking of the imaging device caused by hand shake, etc. In order to correct image blurring, Patent Document 1 discloses an imaging device that captures images by exposing while dividing the total exposure time, and suppresses image blurring by adding and synthesizing each image. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2006-54698 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the imaging device of Patent Document 1, when images with divided exposure times are displayed in a live view display before shooting, the user cannot imagine what kind of exposure the image will have after additive synthesis. Therefore, the user cannot determine how to set the exposure settings (e.g., shutter speed, aperture, ISO sensitivity, etc.) and the number of shots to be captured based on the live view display.
[0005] An object of the present invention is to provide a live view display of an exposed image after a plurality of images have been additively synthesized. [Means for solving the problem]
[0006] In order to solve the above problems, the image processing device of the present invention includes an exposure setting unit that sets the exposure of an image to be captured, a number setting unit that sets the number of images to be captured, an imaging unit that controls imaging at the set exposure and acquires a plurality of image signals corresponding to the set number of images, a synthesis unit that generates an additive synthesis image by additively synthesizing the plurality of image signals, a generation unit that generates an image for live view, and a display control unit that controls displaying the image for live view on a display unit. The image for live view is an image that is displayed in real time before the imaging unit executes imaging, and the generation unit generates a simulation image corresponding to the exposure of the additive synthesis image as the image for live view in accordance with the exposure and the number of images. Effect of the Invention
[0007] According to the present invention, it is possible to display a live view of an exposed image after a plurality of images have been additively synthesized. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an imaging device. [Diagram 2] 5 is a flowchart showing a shooting process in the first embodiment. [Diagram 3] 13 is a flowchart showing a shooting process in the second and third embodiments. [Figure 4] FIG. 2 is a diagram illustrating a scene to be photographed. [Diagram 5] FIG. 13 is a diagram showing an example of a simulation image. [Figure 6] FIG. 13 is a diagram showing an example of a simulation image in which a whiteout region is highlighted. [Figure 7] FIG. 13 is a diagram showing an example of a simulation image displaying a warning display icon. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] (First embodiment) FIG. 1 is a diagram showing the configuration of an imaging device. The imaging device 10 includes, for example, an imaging optical system, an imaging element 102, an A / D conversion unit 103, an image processing device, a recording unit 107, a live view image display unit 112, and an operation unit 113. The image processing device includes a processor such as a CPU (Central Processing Unit) and a memory for recording a program executed by the processor. The imaging optical system includes a photographing lens 100 and an aperture 101. The image processing device includes a memory 104, a signal processing unit 105, a synthesis unit 106, a control unit 108, a position shift detection unit 109, a position shift correction unit 110, and a live view image generation unit 111. Note that, in this embodiment, an example of an imaging device in which a main body unit of the imaging device and a lens device constituting the imaging optical system are integrated will be described, but the imaging device may also be one in which the lens device is detachable from the main body unit.
[0010] The photographing lens 100 includes a plurality of lenses such as a focus lens and a shift lens. The aperture 101 adjusts the amount of light passing through the imaging optical system. When the shutter switch SW2 of the operation unit 113 is pressed, light rays incident on the photographing lens 100 pass through the aperture 101 and form a subject image on the imaging element 102. The imaging element 102 converts the optical image of the subject image into an image signal, which is an electrical signal (analog signal), and outputs the image signal. The imaging element 102 has a photoelectric conversion element, and is configured, for example, in a Bayer array in which R, G1, G2, and B pixels are regularly arranged. The analog signal output from the imaging element 102 is converted by the A / D conversion unit 103 into an image signal, which is a digital signal (RAW data), and temporarily stored in the memory 104. The digital signal converted by the A / D conversion unit 103 may be output to the signal processing unit 105, where image processing may be performed. The signal processing unit 105 performs development processing such as color matrix processing and gamma processing on the RAW data and the RAW data synthesized by the synthesis unit 106. The signal processing unit 105 may also perform various types of image processing such as noise removal, demosaicing, luminance signal conversion, aberration correction, white balance adjustment, color correction, etc. The memory 104 stores the RAW data, image data processed by the signal processing unit 105, etc.
[0011] The synthesis unit 106 synthesizes a plurality of images. In this embodiment, the synthesis unit 106 performs arithmetic processing of additive synthesis of RAW data to generate a synthesized image. If the luminance value of each image before synthesis is I_i(x, y) (i=1 to N, x, y represent coordinates within the screen) and the luminance value of the image after synthesis of these N images is I(x, y), the luminance value I(x, y) of the synthesized image is expressed by the following formula 1. I(x,y)=I_1(x,y)+I_2(x,y)+···+I_N(x,y)··(Formula 1) That is, the luminance values of N images are added together for each pixel to produce composite image data.
[0012] The recording unit 107 records the RAW data output by the A / D conversion unit 103, the RAW data synthesized by the synthesis unit 106, the image data developed by the signal processing unit 105, and the like. The recording unit 107 may record the image data and the like in an external memory detachable from the imaging device 10, or in an external device such as a smartphone connected to the imaging device 10. The control unit 108 performs overall control of the imaging device 10. For example, the control unit 108 also functions as an exposure setting unit that sets exposure such as shutter speed, aperture, and ISO sensitivity, and a number setting unit that sets the number of images to be captured. The control unit 108 also functions as an imaging unit that controls imaging by controlling the imaging element 102. The control unit 108 also functions as a subject detection unit that performs subject detection and determines whether the subject is a moving object or not.
[0013] The misalignment detection unit 109 detects the amount of misalignment between the continuously captured images in units of pixels. In this embodiment, the misalignment detection unit 109 detects the amount of misalignment between the reference image and the aligned image in units of pixels by performing template matching. Template matching is a method of cutting out a specific area of an image, measuring the absolute value of the difference between the specific area while shifting the template position, and determining the amount of shift with the smallest difference as the amount of misalignment. In this embodiment, the amount of misalignment is detected by template matching of the image, but this is not limited to this. For example, the misalignment detection unit 109 may obtain the rotation angle of the camera between the continuously captured images using a gyro sensor, and calculate the amount of misalignment between the images from the focal length and the rotation angle. The misalignment correction unit 110 performs affine transformation on the position of the RAW data based on the amount of misalignment for each pixel detected by the misalignment detection unit 109, and outputs the result to the memory 104.
[0014] The live view image generating unit 111 performs development processing of RAW data captured for live view, and displays the RAW data on a live view image display unit 112 disposed on the rear surface of the imaging device 10 or the like. The live view image display unit 112 functions as a display control unit that controls display of the live view image generated by the live view image generating unit 111. The live view image display unit 112 displays the live view image on a display that is a display unit disposed on the rear surface of the imaging device 10 or the like, for example. The display unit may be a touch panel that can accept an operation by a user. By associating input coordinates on the touch panel with display coordinates, it is possible to configure a GUI that makes it appear as if the user can directly operate the screen displayed on the touch panel. In addition, when the imaging device 10 is connected to an external device having a display such as a PC or smartphone (not shown), the live view image display unit 112 can also display the live view image on the display of the external device. The operation unit 113 accepts an operation from a user, and sets the exposure of the image capture, the number of images captured, and the like according to the operation. The operation unit 113 accepts user operations from various buttons or a touch panel provided on the imaging device 10, an external device connected to the imaging device 10, etc. The operation unit 113 may also accept instructions from the user by voice input.
[0015] Fig. 2 is a flowchart showing the photographing process in this embodiment. The photographing process shown in Fig. 2 is a photographing process executed in the additive composition mode. The additive composition mode is a mode in which images are captured by exposing while dividing the total exposure time, and a positional deviation of each image is detected and corrected to generate an additively composed image. Each process shown in Fig. 2 is realized by a processor reading a program from a memory and executing it. In this embodiment, a live view image is displayed in real time before capturing an image for additive composition, so that the user can change settings while viewing the live view image.
[0016] When the additive synthesis mode is designated by a user operation, this process is started. In S201, the control unit 108 determines the exposure. The exposure determined in S201 is the exposure of each image captured in multiple images for additive synthesis. Specifically, the shutter speed, the aperture, and the ISO sensitivity are set. These setting values may be manually designated by the user, or may be determined by the automatic exposure control of the imaging device 10 (automatic exposure calculation function such as program AE, shutter speed priority, and aperture priority). In S202, the control unit 108 determines the number of images to be captured for additive synthesis. The number of images to be captured is set to a value of 2 or more. The number of images to be captured may be designated by the user, or may be automatically determined by the imaging device 10. Note that, in the present embodiment, an example in which the exposure of images before additive synthesis is determined has been described, but the total exposure after additive synthesis may be set. By setting the total exposure after additive synthesis and the number of images, the exposure of the images to be captured in multiple images for additive synthesis can be determined.
[0017] In S203, the control unit 108 determines whether or not to use a simulation image for live view display. Here, the simulation image is an image that allows the exposure after additive synthesis to be confirmed. That is, the simulation image is an image that corresponds to the exposure after additive synthesis that is determined according to the exposure and the number of shots determined in steps S201 and S202. The simulation image is generated, for example, by increasing the gain of an image for live view. The user may specify whether or not to use a simulation image for live view display using a menu or button of the camera, or the imaging device 10 may automatically determine through processing. When the imaging device 10 determines whether or not to use a simulation image, for example, when a moving object is detected within the angle of view, it determines that a simulation image is not used, and that a simulation image is used when shooting a still object. The reason for making the determination depending on the presence or absence of a moving object is that a simulation image when a moving object is present will result in multiple images, and will not provide a correct simulation result. When it is determined in S203 that a simulation image is used, the processing of S204 is executed, and when it is determined that a simulation image is not used, the processing of S205 is executed.
[0018] In S204, the live view image generating unit 111 generates a simulation image for live view. In steps S201 and S202, the live view image generating unit 111 generates a simulation image that matches the exposure after additive synthesis according to the exposure and number of shots determined. First, the live view image generating unit 111 uses the number of shots to determine the number of steps of brightness that will be achieved by additive synthesis. If the number of shots to be added is N, the number of steps of brightness n is expressed by the following formula 2. JPEG2024080284000002.jpg9159 The live view image generating unit 111 uses the number of steps of brightness n to generate a simulation image that matches the exposure after additive synthesis. The live view image generating unit 111 generates a simulation image that matches the exposure after additive synthesis by, for example, using a method of developing the RAW for live view to be n steps brighter by gain up. Note that in this embodiment, a method of generating a simulation image by gain up has been described, but the method of generating a simulation image is not limited to this. For example, a simulation image that matches the exposure after additive synthesis may be generated by using a method of raising the shooting setting of the RAW for live view by gamma, capturing it n steps brighter, and developing it. In addition, when capturing an image for live view, a simulation image may be generated by performing exposure correction to brighten the exposure by n steps by changing at least one of the settings of the shutter speed, the aperture, and the ISO sensitivity.
[0019] In S205, the live view image generation unit 111 generates a normal live view image. Here, normal live view refers to displaying an image captured with the exposure set in S201. In S205, the live view image generation unit 111 performs development according to the set exposure, rather than special development as in S204. In S206, the live view image display unit 112 controls the display of the live view image generated in S204 or S205. The live view image display unit 112 displays the live view image on a display provided on the back of the imaging device 10, for example.
[0020] In S207, the operation unit 113 accepts the user's decision as to whether or not to capture images using the exposure and number of images determined in S201 and S202, and sends the result to the control unit 108. The user checks the live view image displayed in S206, decides whether or not to capture images using the exposure and number of images determined in S201 and S202, and instructs the image capture device 10 of the decision result. If the user is satisfied with the image displayed in S206, for example, the user sends an instruction to the image capture device 10 to capture images using the exposure and number of images determined in S201 and S202. On the other hand, if the user is not satisfied with the image displayed in S206, for example, the user sends an instruction to the image capture device 10 not to capture images using the exposure and number of images determined in S201 and S202, that is, an instruction to change the exposure. If the user wants to capture images using the exposure and number of images determined in S201 and S202, the process of S208 is performed. On the other hand, if images are not to be captured using the exposure and number of images determined in S201 and S202, the process returns to S201, where the exposure and number of images are changed again, and a live view image is generated and displayed according to the changed settings, and the setting changes are repeated until the user is satisfied.
[0021] In S208, when the operation unit 113 detects that the user has pressed the shutter switch SW2, the control unit 108 controls the image sensor 102 to capture images at the exposure and number of images determined, and generates RAW data. That is, the control unit 108 captures images for the number of images set in S202 with the exposure determined in S201, obtains multiple image signals corresponding to the number of images, and generates RAW data. In S209, the position shift detection unit 109 and the position shift correction unit 110 align the RAW data obtained in S208 with the first image as a reference. For the RAW data other than the first image, the position shift detection unit 109 detects the amount of deviation from the first RAW data using a template matching technique or a gyro sensor, and the position shift correction unit 110 performs geometric transformation of the RAW data using affine transformation.
[0022] In S210 and S211, the multiple image signals captured in S208 are additively combined to generate an additively combined image. In S210, the combining unit 106 additively combines the RAW data that has been aligned in S209. The additive combination method is as shown in Equation 1. In S211, the signal processing unit 105 develops and encodes the RAW data that has been additively combined in S210. In S212, the recording unit 107 records the file that has been developed and encoded in S211. Specifically, the recording unit 107 records on a recording medium (not shown) inserted in the imaging device 10, or on an external medium such as a PC or smartphone.
[0023] As described above, according to this embodiment, a simulation image corresponding to the exposure after additive synthesis can be displayed in live view before capturing an image. By checking the simulation image, the user can imagine what the exposure will be after additive synthesis, which helps the user set the exposure and the number of images to be captured, making it easier for the user to generate a composite image that he or she desires.
[0024] Second embodiment In the first embodiment, an example of displaying the simulation image as it is has been described, but in the present embodiment, an example of highlighting a part of the area will be described. In the present embodiment, an example of highlighting a whiteout area will be described, but the present embodiment is not limited to this. For example, a blackout area may be highlighted, or both the whiteout area and the blackout area may be highlighted using a different highlighting method.
[0025] Fig. 3 is a flowchart showing image processing in the second and third embodiments. The shooting processing shown in Fig. 3 is executed in additive synthesis mode. Each process shown in Fig. 3 is realized by a processor reading a program from a memory and executing it. Note that in the second embodiment, only the differences from the first embodiment will be described, and the same components will be denoted by the same reference numerals and description thereof will be omitted.
[0026] This process starts when the additive synthesis mode is designated by a user operation. S301 and S302 are the same as the processes of S201 and S202 in the first embodiment, respectively. When the process of S202 is completed, the process of S303 is executed. In S303, the live view image generation unit 111 generates a normal live view image. The process of S303 is the same as the process of S205 in the first embodiment. When the process of S303 is completed, the process of S304 is executed. In S304, the live view image display unit 112 controls to display the live view image generated in S303. That is, in S304, the normal live view image is displayed. When the process of S304 is completed, the process of S305 is executed.
[0027] In S305, the live view image generating unit 111 determines whether or not to display a blown-out white warning in the live view display. Whether or not to display a blown-out white warning is set by the user, and the live view image generating unit 111 makes the determination according to the user's setting. If it is set to display a blown-out white warning, the process proceeds to S306. On the other hand, if it is set not to display a blown-out white warning, the process proceeds to S309.
[0028] In S306, the live view image generating unit 111 generates a simulation image for live view. The process of S306 is the same as the process of S204 in the first embodiment. In S307, the live view image generating unit 111 determines whether or not a blown-out white area exists in the simulation image generated in S306. The live view image generating unit 111 determines whether or not a blown-out white area exists by checking whether or not the luminance value of each pixel in the simulation image reaches a blown-out white threshold. If a blown-out white area exists in the simulation image, the process of S308 is executed. On the other hand, if a blown-out white area does not exist in the simulation image, the process of S309 is executed.
[0029] In S308, the live view image generating unit 111 and the live view image display unit 112 display a warning on the live view so as to highlight the whiteout area. Here, examples of images in which the whiteout area is highlighted will be described with reference to Figs. 4 to 6. Fig. 4 is a diagram for explaining a scene to be shot. Fig. 4 assumes a scene in which a mountain and sky landscape is shot. Area 401 is a bright sky area, and area 402 is a mountain area that is darker than area 402. When the scene in Fig. 4 is shot in the additive synthesis mode, as shown in Fig. 4, neither area 401 nor area 402 is whiteout in each image before additive synthesis. Fig. 5 is a diagram showing an example of a simulation image. Fig. 5 is a simulation image obtained by capturing a plurality of images of the scene in Fig. 4 and additively synthesizing them. The sky area 501 is whiteout due to addition, but the mountain area 502 is brighter than the mountain area 402, but whiteout does not occur. Fig. 6 is a diagram showing an example of a simulation image in which the whiteout area is highlighted. FIG. 6 shows an example in which the blown-out white area in FIG. 5 is highlighted and superimposed on the simulation image, and the blown-out white area 601 of the sky is highlighted on the screen to clearly indicate that the whiteout has occurred. For example, a horizontal line is superimposed on the blown-out white area 601 of the sky to highlight the blown-out white area. The live view image generating unit 111 and the live view image display unit 112 hold information on whether each pixel of the simulation image has been blown-out in S307, and use the information to superimpose the blown-out white area. The highlighting method may be any method that allows the user to recognize the blown-out white area, and may be, for example, a method of superimposing a diagonal line on the blown-out white area or a method of blinking the superimposed display of the blown-out white area. In S308, an image in which the blown-out white area shown in FIG. 6 is highlighted is displayed. S309 to S314 are the same processes as S207 to S212 in the first embodiment.
[0030] As described above, according to the second embodiment, the user can visually recognize which areas will be overexposed after additive synthesis, which assists the user in setting the exposure and the number of images to be captured.
[0031] Third embodiment In the second embodiment, an example has been described in which the blown-out highlight area is highlighted in step S308 as shown in Fig. 6. In the present embodiment, an example will be described in which a warning icon is superimposed on the simulation image.
[0032] In S308 in this embodiment, the live view image generation unit 111 and the live view image display unit 112 display a whiteout warning icon superimposed on the live view. An example of an image displayed in S308 in this embodiment is shown in FIG. 7. FIG. 7 is a diagram showing an example of a simulation image displaying a warning display icon. Assuming a scene as in FIG. 4 as in the second embodiment, a simulation image in which whiteout occurs as in FIG. 5 can be obtained. In this embodiment, a whiteout warning icon 701 is displayed superimposed as in FIG. 7.
[0033] As described above, according to this embodiment, the user can recognize from the icon whether or not there will be whiteout after additive composition, which assists the user in setting the exposure and the number of shots to be captured.
[0034] (Other embodiments) The disclosure of this embodiment of the present invention includes the following configuration of an image processing device. (Configuration 1) an exposure setting unit that sets the exposure of an image to be captured; a number setting unit for setting the number of images to be captured; an imaging unit that controls imaging at the set exposure and acquires a plurality of image signals corresponding to the set number of images; a synthesis unit that synthesizes the plurality of image signals to generate an additive synthesis image; A generation unit that generates an image for live view; a display control unit that controls displaying the live view image on a display unit, the live view image is an image that is displayed in real time before the imaging unit captures an image, The image processing device according to claim 1, wherein the generation unit generates a simulation image corresponding to an exposure of the additive composite image as an image for live view in accordance with the exposure and the number of images. (Configuration 2) the generating unit generates an image captured at the exposure for live view as a normal live view image for live view, 2. The image processing device according to claim 1, wherein the display control unit displays either the normal live view image or the simulation image as the image for live view. (Configuration 3) The image processing device according to configuration 2, wherein the display control unit displays the normal live view image as the image for the live view when a moving object is included in the subject, and displays the simulation image as the image for the live view when a moving object is not included in the subject. (Configuration 4) 4. The image processing device according to configuration 2 or 3, wherein the display control unit switches between displaying the normal live view image and displaying the simulation image in response to an instruction from a user. (Configuration 5) 5. The image processing device according to any one of configurations 1 to 4, wherein the generation unit generates the simulation image by increasing a gain for an image signal captured for live view. (Configuration 6) 6. The image processing device according to any one of configurations 1 to 5, wherein the display control unit displays a blown-out white area of the simulation image with emphasis. (Configuration 7) 7. The image processing method according to any one of configurations 1 to 6, wherein the image signal is RAW data.
[0035] The object of the present invention can also be achieved as follows. That is, a storage medium on which the program code of the software in which the procedure for realizing the functions of each of the above-mentioned embodiments is recorded is supplied to a system or device. Then, a computer (or a CPU, MPU, etc.) of the system or device reads out and executes the program code stored in the storage medium. In this case, the program code itself read out from the storage medium realizes the novel functions of the present invention, and the storage medium and program storing the program code constitute the present invention. In addition, examples of storage media for supplying the program code include flexible disks, hard disks, optical disks, and magneto-optical disks. In addition, CD-ROMs, CD-Rs, CD-RWs, DVD-ROMs, DVD-RAMs, DVD-RWs, DVD-Rs, magnetic tapes, non-volatile memory cards, ROMs, etc. can also be used. In addition, the functions of each of the above-mentioned embodiments are realized by making the program code read out by the computer executable. Furthermore, the present invention also includes a case where an OS (operating system) or the like running on a computer performs part or all of the actual processing based on the instructions of the program code, and the processing realizes the functions of each of the above-mentioned embodiments. In addition, the following cases are also included. First, the program code is read from the storage medium and written into the memory of an expansion board inserted into a computer or an expansion unit connected to the computer. Then, based on the instructions of the program code, the CPU or other device in the expansion board or expansion unit performs some or all of the actual processing.
[0036] The present invention can also be realized by supplying a program for implementing one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) for implementing one or more functions. Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]
[0037] 10. Imaging device 102 Image sensor 108 Control Unit 106 Synthesis Section 111 Live view image generator 112 Live view image display section
Claims
1. an exposure setting unit that sets the exposure of an image to be captured; a number setting unit for setting the number of images to be captured; an imaging unit that controls imaging at the set exposure and acquires a plurality of image signals corresponding to the set number of images; a generation unit that generates an image for live view; a display control unit that controls display of the live view image on a display unit, the generation unit generates a simulation image corresponding to the exposure of an additive composite image obtained by additively combining the plurality of image signals as an image to be displayed for live view before performing imaging to acquire the plurality of image signals, in accordance with the exposure and the number of images.
2. the generation unit generates an image captured at the exposure set by the exposure setting unit for live view as a normal live view image for live view; The image processing device according to claim 1 , wherein the display control unit displays either the normal live view image or the simulation image as the image for live view.
3. The imaging device further includes a detection means for detecting a subject from an image, 3. The image processing device according to claim 2, wherein the display control unit displays the normal live view image as the image for the live view before performing imaging to acquire the plurality of image signals when a moving object is included in the subject, and displays the simulation image as the image for the live view before performing imaging to acquire the plurality of image signals when a moving object is not included in the subject.
4. The image processing device according to claim 2 , wherein the display control unit switches between displaying the normal live view image and displaying the simulation image in response to an instruction from a user.
5. The image processing device according to claim 1 , wherein the generation unit generates the simulation image by increasing a gain for an image signal captured for live view before performing imaging to acquire the plurality of image signals.
6. The image processing device according to claim 1 , wherein the display control unit highlights blown-out highlight areas of the simulation image.
7. 2. The image processing apparatus according to claim 1, wherein the image signal is RAW data.
8. An image processing device according to any one of claims 1 to 7; An imaging element; An imaging device comprising a display for displaying a live view image.
9. A control method for an image processing device, comprising: setting the exposure for the image to be captured; A step of setting the number of images to be captured; a step of controlling the image capture at the set exposure to acquire a plurality of image signals corresponding to the set number of images; generating an image for live view; and controlling the display of the live view image on a display unit, a control method characterized in that a simulation image corresponding to the exposure of an additive composite image obtained by additively combining the plurality of image signals as an image to be displayed for live view before performing imaging to acquire the plurality of image signals is generated in accordance with the exposure and the number of images.
10. A program that causes a computer of an image processing apparatus to execute each step according to claim 9.