Imaging device, control method for imaging device, and program

Abstract

This system provides a mechanism that allows photographers to capture objects emerging from areas with large differences in brightness without blurring, while maintaining the exposure level set in advance. [Solution] The imaging device 100 comprises a frame-based imaging unit 101 and an event detection unit 102. The imaging device 100 extracts a first region of brightness outside the dynamic range of the frame-based sensor of the frame-based imaging unit 101, and a second region other than the first region, from the frame-based image. The imaging device 100 also performs object recognition based on the event signal output from the event-based sensor of the event detection unit 102, and calculates the imaging settings for the frame-based sensor based on the movement vector of the recognized object. The imaging device 100 reflects the imaging settings at a predetermined timing related to the movement of the object from the first region to the second region.

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method for the imaging device, and a program.

Background Art

[0002] Conventionally, in an imaging device, a frame-based sensor that captures an image in synchronization with a synchronization signal such as a vertical synchronization signal is used. In recent years, an imaging device that also uses an event-based sensor that outputs a luminance change for each pixel as an event signal is also known. Furthermore, a technique that combines a frame-based sensor and an event-based sensor has also been proposed. As a related technique, the technique of Patent Document 1 has been proposed. In Patent Document 1, a region of interest is determined based on an event signal, and the frame-based sensor is controlled so that the region of interest can be clearly photographed. Thereby, a subject can be clearly recorded even in an environment with a large brightness difference.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique of Patent Document 1 described above, although the detected subject can be clearly recorded in a situation with a large brightness difference, it does not consider shooting that intentionally leaves unclear areas such as black crush and white bloom as photographic expressions. For this reason, for example, it is difficult to photograph a car emerging from the tunnel without blurring while the tunnel is in a black-crushed state. That is, in the conventional technique, it is impossible to photograph an object emerging from a region with a large brightness difference without blurring while maintaining the exposure amount set in advance by the photographer.

[0005] The present invention aims to provide a mechanism that allows photographers to capture images of objects emerging from areas with large differences in brightness without blurring, while maintaining a pre-set exposure level. [Means for solving the problem]

[0006] To achieve the above objective, the present invention provides an imaging device comprising: imaging means for outputting a frame-based image; extraction means for extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image; acquisition means for acquiring an event signal indicating the position and time at which a change in brightness occurs in the field of view captured by the imaging device; recognition means for recognizing an object in the field of view based on the event signal; movement vector calculation means for calculating the movement vector of the object; shooting setting calculation means for calculating the shooting settings of the imaging means based on the movement vector; and means for reflecting the shooting settings at a predetermined timing relating to the movement of the object from the first region to the second region. [Effects of the Invention]

[0007] According to the present invention, it is possible to photograph objects emerging from areas with large differences in brightness without blurring, while maintaining the exposure level set in advance by the photographer. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram schematically showing the configuration of the imaging device according to this embodiment. [Figure 2] This flowchart shows the procedure for the imaging control process performed by the imaging device shown in Figure 1. [Figure 3] Figure 1 is a timing chart showing the relationship between the frame-based image from the frame-based sensor of the imaging device, the event signal from the event-based sensor, and the mapping timing. [Figure 4] Figure 1 shows an example of capturing a scene with a large difference in brightness using the imaging device shown. [Figure 5]This flowchart shows another procedure for the imaging control process performed by the imaging device shown in Figure 1. [Figure 6] This flowchart shows the procedure for the automatic imaging control process performed by the imaging device shown in Figure 1. [Modes for carrying out the invention]

[0009] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0010] Figure 1 is a schematic block diagram showing the configuration of the imaging device 100 according to this embodiment. In Figure 1, the imaging device 100 comprises a frame-based imaging unit 101, an event detection unit 102, a control unit 103, a storage unit 104, an image processing unit 105, a display unit 106, and an operation unit 107. These are connected to each other via a bus 108. The imaging device 100 is a device capable of capturing frame-based images from smartphones, digital cameras, etc.

[0011] The frame-based imaging unit 101 consists of an imaging optical system, a mechanical shutter, and an image sensor. The imaging optical system consists of an aperture, an image stabilization lens, a focus / zoom lens, etc., and guides the optical image of the subject to the frame-based sensor through the mechanical shutter. The mechanical shutter adjusts the exposure time for exposing the frame-based sensor. The frame-based sensor converts the optical image formed by the lens into a digital video signal as a frame-based image (hereinafter referred to as "frame-based image") and outputs it to the image processing unit 105 and the storage unit 104. The frame-based image is output in synchronization with a synchronization signal such as a vertical synchronization signal so that it has a constant period. Note that if the frame-based sensor has an electronic shutter function that can adjust the exposure time by controlling the signal storage time and signal readout time, a mechanical shutter is not necessary.

[0012] The event detection unit 102 consists of an imaging optical system and an event-based sensor. The event-based sensor of the event detection unit 102 outputs an event signal indicating the position and time when a change in brightness occurs in the field of view captured by the imaging device 100. Specifically, the event-based sensor detects changes in brightness of each pixel and outputs the position and time of the pixel where the change in brightness occurred as an event signal. The event signal output by the event detection unit 102 is output asynchronously to the frame-based image output from the frame-based imaging unit 101 in synchronization with a synchronization signal such as a vertical synchronization signal. The imaging optical system of the event detection unit 102 may be the same as or different from the imaging optical system of the frame-based imaging unit 101.

[0013] The control unit 103 consists of a CPU (Central Processing Unit), program memory, etc., and controls the imaging device 100 by executing a predetermined program.

[0014] The memory unit 104 is a volatile memory that can rewrite the stored data, and it stores frame-based images received from the frame-based imaging unit 101 and data received from the image processing unit 105.

[0015] The image processing unit 105 consists of a GPU (Graphics Processing Unit), program memory, etc., and primarily performs image processing by executing a predetermined program.

[0016] The display unit 106 is composed of a display display such as a liquid crystal panel or an organic EL, and displays images acquired from the image processing unit 105 and the storage unit 104.

[0017] The operation unit 107 consists of buttons, sensors, etc., and is a user interface for the photographer to operate. In this embodiment, the imaging device 100 may communicate with an external information processing device, and the imaging device 100 may be operated from the information processing device by software installed on the imaging device 100.

[0018] Figure 2 is a flowchart showing the procedure of the shooting control process executed by the imaging device 100 of FIG. 1. This shooting control process is realized by the CPU of the control unit 103 executing a program stored in the program memory of the control unit 103. This shooting control process is started, for example, when the photographer performs a predetermined operation through the operation unit 107 or when the imaging device 100 is activated.

[0019] In FIG. 2, first, in S201, the control unit 103 controls the frame-based shooting unit 101 to acquire a frame-based image. The frame-based shooting unit 101 outputs the acquired frame-based image to the image processing unit 105.

[0020] Next, in S202, the control unit 103 controls the image processing unit 105 to extract a first region and a second region from the acquired frame-based image. The first region is a region of brightness outside the dynamic range of the frame-based sensor, such as a blacked-out region or a white-out region, in the frame-based image, and the second region is a region other than the first region in the frame-based image. The first region and the second region are determined based on the pixel values of the frame-based image. For example, a luminance value is obtained from the pixel values of the frame-based image, and a region composed of pixels with a luminance value below a first threshold for extracting a blacked-out region is set as the first region, and a region composed of pixels with a luminance value higher than the first threshold is set as the second region. Also, a region composed of pixels with a luminance value above a second threshold for extracting a white-out region is set as the first region, and a region composed of pixels with a luminance value lower than the second threshold is set as the second region. In the present embodiment, the threshold values used in S202 may be determined based on an instruction from the user or the result of image analysis of the frame-based image. By this determination, in S202, the first region and the second region are extracted using only one of the first threshold value and the second threshold value, or the first region and the second region are extracted using both the first threshold value and the second threshold value.

[0021] Next, in S203, the control unit 103 controls the event detection unit 102 to output an event signal including information on the position and time of the luminance change detected by the event-based sensor to the image processing unit 105.

[0022] Next, in S204, the control unit 103 controls the image processing unit 105 to perform object recognition. Specifically, the image processing unit 105 maps the position of the luminance change indicated by the event signal output in S203 as two-dimensional data for each predetermined period. Here, the predetermined period is, for example, a period of 1 / 10 frame with respect to the frame-based image. The image processing unit 105 performs object recognition based on this two-dimensional data. In object recognition, for example, when a mass of the mapped positions is larger than a predetermined area, this mass is recognized as an object. Note that the area mapped as two-dimensional data corresponds to the viewing angle of the frame-based image.

[0023] Next, in S205, the control unit 103 controls the image processing unit 105 to calculate a motion vector from the change in the position of the object recognized in S204. The motion vector is, for example, the change in the center position of the object. Here, since the two-dimensional data is mapped every 1 / 10 frame, the motion vector is calculated 10 times for one frame-based image. The image processing unit 105 transmits information on the motion vector during the exposure period of one frame of the recognized object to the control unit 103. Note that the image processing unit 105 may transmit information on the motion vector for each mapping of the recognized object to the control unit 103. Here, the relationship between the frame-based image, the event signal, and the mapping timing will be described using FIG. 3.

[0024] FIG. 3 is a timing chart showing the relationship between the frame-based image of the frame-based sensor of the imaging device 100 in FIG. 1, the event signal of the event-based sensor, and the mapping timing.

[0025] In Figure 3, for the frame-based image, processing of the first frame (hereinafter referred to as the "F1 frame") begins at F1, which is synchronized with the frame synchronization signal, and exposure and data output are performed sequentially at timings synchronized with the horizontal synchronization signal. For the next frame, processing of the second frame (hereinafter referred to as the "F2 frame") begins at F2. In addition, in the 2D data mapping based on the event signal by the image processing unit 105, if it is performed every 1 / 10 frame as described above, for example, 10 mapping processes from M1 to M10 are performed during the F1 frame. Based on the movement vectors from M1 to M10 of the recognized object, the position of this object in the frame-based image of the F2 frame is calculated. As described above, since the area mapped as 2D data corresponds to the field of view of the frame-based image, it is possible to calculate the position to which the recognized object has moved in the frame-based image from the event signal. Note that the number of mappings in one frame does not have to be 10.

[0026] Returning to Figure 2, in S206, the control unit 103 calculates the frame-based image shooting settings from the movement vector calculated in S205. Here, the current shutter speed is set to SS0. The shutter speed SS1, which allows the object to be photographed without motion blur, can be determined using the length L of the movement vector and the mapping interval tm calculated in S205, by the following equation (1).

[0027] SS1 = tm / L …(1) Here, let ΔSS be the change in exposure that occurs when the current shutter speed SS0 is changed to the shutter speed SS1 calculated by Equation 1. Either the ISO sensitivity or the aperture, or both, are changed to cancel out the change in exposure ΔSS. The relationship between each setting at this time can be expressed as shown in Equation (2) below, where ΔISO and ΔAv are the changes in ISO sensitivity and aperture, respectively.

[0028] ΔSS + ΔISO + ΔAv = 0 …(2) In Equation 2, the unit of each variable represents the number of stops of exposure change. For example, if the shutter speed decreases by one stop, the ISO sensitivity is increased by one stop. If ISO sensitivity alone is insufficient, both the ISO sensitivity and the aperture are adjusted so that Equation 2 holds true. For example, if the shutter speed decreases by one stop, the ISO sensitivity is increased by 2 / 3 stop and the aperture is increased by 1 / 3 stop. By controlling in this way, it is possible to obtain a shooting setting that allows the photographer to capture moving objects without subject blur while maintaining the exposure level intended by the photographer. Furthermore, by prioritizing the adjustment of ISO sensitivity over aperture, it is possible to minimize changes in depth of field. Also, by prioritizing the adjustment of aperture over ISO sensitivity, it is possible to suppress changes in image quality associated with changes in ISO sensitivity. In this embodiment, either ISO sensitivity or aperture may be prioritized for adjustment.

[0029] Next, in S207, the control unit 103 determines whether the object recognized in S204 has moved from the first region to the second region. If the object recognized in S204 has moved from the first region to the second region, this process ends. Otherwise, this process proceeds to S208.

[0030] In S208, the control unit 103 applies the shooting settings calculated in S206 to the frame-based shooting unit 101. Thus, in this embodiment, the shooting settings calculated in S206 are applied to the frame-based shooting unit 101 at the timing before the object recognized in S204 moves from the first region to the second region. As a result, for example, when the object recognized in S204 appears from the blacked-out region to the visible region (second region), the imaging device 100 already reflects the shooting settings that allow this object to be photographed without subject blur. After that, the process returns to S201. Once the shooting control process shown in Figure 2 above is completed, the imaging device 100 automatically takes a predetermined number of shots, for example, without receiving any operation from the photographer.

[0031] According to the embodiment described above, a first region of brightness outside the dynamic range of the frame-based sensor of the frame-based shooting unit 101, and a second region other than the first region, are extracted from the frame-based image. Furthermore, object recognition is performed based on the event signal output from the event-based sensor of the event detection unit 102, and the shooting settings for the frame-based sensor are calculated based on the movement vector of the recognized object. Here, the movement vector is acquired using an event-based sensor with a wider dynamic range than the frame-based sensor. Therefore, even if an object cannot be detected from the frame-based image output by the frame-based sensor based on the exposure amount set in advance by the photographer, the shooting settings that allow the object to be photographed without blur can be calculated based on the movement vector calculated by the event-based sensor. As a result, objects appearing from areas with large differences in brightness can be photographed without blur while maintaining the exposure amount set in advance by the photographer. In addition, the photographer does not need to change the shooting settings in accordance with the movement of the object, and can concentrate only on the timing of the shutter.

[0032] Furthermore, in the embodiment described above, the timing at which the shooting settings are applied is before the object reaches the second region. This allows the photographer to maintain the exposure level set in advance while photographing the object without blurring once it reaches the second region.

[0033] Furthermore, in the embodiment described above, the area composed of pixels with a brightness value below a first threshold for extracting the underexposed areas is defined as the first area, and the area composed of pixels with a brightness value higher than the first threshold is defined as the second area. This allows the photographer to capture objects emerging from the underexposed areas without blurring while maintaining the exposure amount set in advance.

[0034] Furthermore, in the above-described embodiment, the area composed of pixels with a brightness value equal to or greater than a second threshold for extracting overexposed areas is defined as the first area, and the area composed of pixels with a brightness value lower than the second threshold is defined as the second area. This allows the photographer to maintain a preset exposure level while capturing objects emerging from overexposed areas without blurring.

[0035] Figure 4 shows an example of capturing a scene with a large difference in brightness using the imaging device 100 shown in Figure 1.

[0036] Figure 4(a) shows the field of view of the imaging device 100. As an example of a scene with a large difference in brightness, Figure 4(a) shows a car, which is an object, moving from the background to the foreground near the exit of a tunnel.

[0037] Figure 4(b) shows an example of a frame-based image where the photographer has determined the field of view and exposure and is waiting for the subject to emerge from the tunnel. Because the exposure is set to the outside of the tunnel, the inside of the tunnel is completely black and invisible. In this state, it is difficult to set up the shooting settings to be suitable for an object emerging from the tunnel, as objects inside the tunnel are not visible.

[0038] Figure 4(c) shows an object recognized by the event detection unit 102. The movement vector is calculated from the object's position at mapping points M(N) and M(N+1).

[0039] First, the photographer sets the field of view and exposure amount according to the desired image result, as shown in Figure 4(b), using the image obtained from the frame-based sensor. Then, even if there is an object in an area that is blacked out and cannot be seen, the frame-based sensor of the imaging device 100 can recognize the subject with the event-based sensor and determine the movement vector. Once the movement vector is calculated, the imaging device 100 applies shooting settings to the frame-based sensor that maintain the exposure amount intended by the photographer while preventing subject blur, before the object recognized by the event-based sensor becomes visible (before it reaches the visible area). As a result, the photographer can take a picture with the appropriate settings from the moment the object becomes visible.

[0040] In Figure 4, an example is given of an object appearing from a blacked-out area within the field of view, but the same control is performed when an object appears from a blown-out area within the field of view.

[0041] As shown in the shooting control process in Figure 2 above, in a configuration where the shooting settings calculated in S205 are applied before the object recognized in S204 moves from the first region to the second region, there is an advantage that the frame-based sensor settings are always adjusted to match the subject. However, because the shooting settings are changed each time a frame-based image is acquired, the processing load for changing the shooting settings increases, and the image quality of the live view video acquired by the frame-based sensor changes each time.

[0042] In contrast, in this embodiment, the shooting settings are applied at the moment when an object that has moved from the first region reaches the second region.

[0043] Figure 5 is a flowchart showing another procedure of the imaging control process performed by the imaging device 100 in Figure 1. The imaging control process in Figure 5 is similar to the imaging control process in Figure 2 described above, and the differences from the imaging control process in Figure 2 will be explained below. The imaging control process in Figure 5, like the imaging control process in Figure 2 described above, is realized by the CPU of the control unit 103 executing a program stored in the program memory of the control unit 103. Also, the imaging control process in Figure 5, like the imaging control process in Figure 2 described above, is started, for example, when the photographer performs a predetermined operation through the operation unit 107 or when the imaging device 100 is started up.

[0044] In Figure 5, first, processes S501 to S506, which are the same as those described in S201 to S206, are performed.

[0045] Next, in S507, the control unit 103 determines whether the object recognized in S504 has moved from the first region to the second region. If the object recognized in S504 has moved from the first region to the second region, the process proceeds to S508. Otherwise, the process returns to S501.

[0046] In S508, the control unit 103 applies the shooting settings calculated in S506 to the frame-based shooting unit 101. After that, this process is completed. Once the shooting control process shown in Figure 5 above is completed, the imaging device 100 automatically takes a predetermined number of shots, for example, without receiving any operation from the photographer.

[0047] In the shooting control process shown in Figure 5 above, the shooting settings are reflected when the object that has moved from the first region reaches the second region. This minimizes the frequency of changing the shooting settings. As a result, the processing load for changing the shooting settings is reduced, and the image quality of the live view image can be stabilized.

[0048] In the embodiments described above, a configuration was described in which automatic shooting is performed after the shooting control processing shown in Figures 2 and 5 is completed, but the configuration is not limited to this. For example, the imaging device 100 may take a picture at the timing when it receives a predetermined operation from the photographer that serves as a shooting instruction during automatic shooting. The predetermined operation is, for example, pressing the shutter button. The image obtained in accordance with the operation received from the photographer in this way is an image taken at the timing intended by the photographer. It is preferable that such an image be distinguishable from other images obtained by automatic shooting so that the photographer can easily manage the images.

[0049] In contrast, in this embodiment, marker information is added to the frame-based image acquired at the time the photographer performs the predetermined operation described above during automatic shooting.

[0050] Figure 6 is a flowchart showing the procedure for the automatic shooting control process performed by the imaging device 100 in Figure 1. The automatic shooting control process in Figure 6 is realized by the CPU of the control unit 103 executing a program stored in the program memory of the control unit 103. Furthermore, the automatic shooting control process in Figure 6 is executed after the shooting control processes in Figures 2 and 5 described above have been completed.

[0051] In Figure 6, first, in S601, the control unit 103 controls the frame-based imaging unit 101 to acquire a frame-based image. The frame-based imaging unit 101 outputs the acquired frame-based image to the image processing unit 105. The imaging settings applied to the frame-based imaging unit 101 at this time are the same imaging settings applied in S208 and S508.

[0052] Next, in S602, the control unit 103 determines whether the shutter button is being pressed by the photographer. If it is determined that the shutter button is not being pressed by the photographer, the process proceeds to S604, which will be described later. If it is determined that the shutter button is being pressed by the photographer, the process proceeds to S603.

[0053] In S603, the control unit 103 adds marker information to the frame-based image acquired in S601. The marker information is a tag or similar that can distinguish whether or not the photographer performed any actions.

[0054] Next, in S604, the control unit 103 stores the frame-based image acquired in S601 in the storage unit 104. The control unit 103 also keeps track of the number of images that have been stored.

[0055] Next, in S605, the control unit 103 determines whether the shutter button is being pressed by the photographer. If it is determined that the shutter button is being pressed by the photographer, the process returns to S601. If it is determined that the shutter button is not being pressed by the photographer, the process proceeds to S606.

[0056] In S606, the control unit 103 determines whether a predetermined number of shots have been taken, based on the number of shots recorded in S604. If it is determined that the predetermined number of shots have not been taken, the process returns to S601. If it is determined that the predetermined number of shots have been taken, the process terminates.

[0057] In the automatic shooting control process shown in Figure 6 above, marker information is added to the frame-based image acquired at the time the photographer performs the predetermined operation described above during automatic shooting. This allows the photographer to easily identify the image at the desired timing from among the multiple images obtained during shooting.

[0058] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0059] Furthermore, the disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An imaging device comprising: an imaging means for outputting a frame-based image; an extraction means for extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image; an acquisition means for acquiring an event signal indicating the position and time at which a change in brightness occurs in the field of view captured by the imaging device; a recognition means for recognizing an object in the field of view based on the event signal; a movement vector calculation means for calculating the movement vector of the object; a shooting setting calculation means for calculating the shooting settings of the imaging means based on the movement vector; and a means for reflecting the shooting settings at a predetermined timing relating to the movement of the object from the first region to the second region. (Configuration 2) The imaging apparatus according to Configuration 1, characterized in that the predetermined timing is the timing before the object reaches the second region. (Configuration 3) The imaging apparatus according to Configuration 1, characterized in that the predetermined timing is the timing at which the object that has moved from the first region reaches the second region. (Configuration 4) An imaging device according to Configuration 2 or 3, which, after the object has moved from the first area and reached the second area, takes a photograph of the object based on the reflected shooting settings. (Configuration 5) The imaging device according to Configuration 4, further comprising means for adding marker information to a frame-based image output by the imaging means at the timing of a shooting instruction received from the user during shooting. (Configuration 6) The imaging device according to any one of Configurations 1 to 5, characterized in that the shooting settings are shutter speed, ISO sensitivity, and aperture amount. (Configuration 7) The imaging apparatus according to any one of Configurations 1 to 6, characterized in that the extraction means defines a region composed of pixels with a brightness value below a first threshold for extracting blacked-out regions as a first region, and a region composed of pixels with a brightness value higher than the first threshold as a second region. (Configuration 8) The imaging apparatus according to any one of Configurations 1 to 7, characterized in that the extraction means defines a region composed of pixels with a brightness value of a second threshold or higher as a first region, and a region composed of pixels with a brightness value lower than the second threshold as a second region. (Configuration 9) A method for controlling an imaging device, comprising: an imaging step of causing the imaging means of the imaging device to output a frame-based image; an extraction step of extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image; an acquisition step of acquiring an event signal indicating the position and time at which a change in brightness occurs in the field of view captured by the imaging device; a recognition step of recognizing an object in the field of view based on the event signal; a movement vector calculation step of calculating the movement vector of the object; a shooting setting calculation step of calculating the shooting setting of the imaging means based on the movement vector; and a step of reflecting the shooting setting at a predetermined timing relating to the movement of the object from the first region to the second region. (Configuration 10) A program that causes a computer to execute a control method for an imaging device, wherein the control method for the imaging device comprises: an imaging step of causing the imaging means of the imaging device to output a frame-based image; an extraction step of extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image; an acquisition step of acquiring an event signal indicating the position and time at which a change in brightness occurs in the field of view captured by the imaging device; a recognition step of recognizing an object in the field of view based on the event signal; a movement vector calculation step of calculating the movement vector of the object; a shooting setting calculation step of calculating the shooting setting of the imaging means based on the movement vector; and a step of reflecting the shooting setting at a predetermined timing relating to the movement of the object from the first region to the second region. [Explanation of Symbols]

[0060] 100 Imaging device 101 Frame-based shooting unit 102 Event Detection Unit 103 Control Unit 105 Image Processing Unit

Claims

1. An imaging device, An imaging means that outputs a frame-based image, Extraction means for extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image, An acquisition means for acquiring an event signal indicating the location and time when a change in brightness occurs in the field of view captured by the imaging device, A recognition means for recognizing an object in the field of view based on the event signal, A means for calculating the movement vector of the object, A shooting setting calculation means that calculates the shooting settings of the imaging means based on the aforementioned movement vector, An imaging device characterized by comprising means for reflecting the shooting settings at a predetermined timing relating to the movement of the object from the first region to the second region.

2. The imaging apparatus according to claim 1, characterized in that the predetermined timing is the timing before the object reaches the second region.

3. The imaging apparatus according to claim 1, characterized in that the predetermined timing is the timing at which the object that has moved from the first region reaches the second region.

4. The imaging device according to claim 2 or 3, wherein, after the object has moved from the first region and reached the second region, the device takes a photograph of the object based on the reflected shooting settings.

5. The imaging apparatus according to claim 4, further comprising means for adding marker information to a frame-based image output by the imaging means at the timing of a shooting instruction received from a user during the aforementioned shooting.

6. The imaging device according to claim 1, characterized in that the shooting settings are shutter speed, ISO sensitivity, and aperture amount.

7. The imaging apparatus according to claim 1, characterized in that the extraction means defines a region composed of pixels with a brightness value below a first threshold for extracting blacked-out regions as a first region, and a region composed of pixels with a brightness value higher than the first threshold as a second region.

8. The imaging apparatus according to claim 1, characterized in that the extraction means defines a region composed of pixels with a brightness value equal to or greater than a second threshold for extracting overexposed areas as a first region, and a region composed of pixels with a brightness value lower than the second threshold as a second region.

9. A method for controlling an imaging device, The imaging step involves causing the imaging means of the imaging device to output a frame-based image, Extraction steps include extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image, The acquisition step involves acquiring an event signal that indicates the location and time when a change in brightness occurs in the field of view captured by the imaging device, A recognition step of recognizing an object in the field of view based on the event signal, A movement vector calculation step for calculating the movement vector of the object, A shooting setting calculation step that calculates the shooting settings of the imaging means based on the aforementioned movement vector, A control method for an imaging device, characterized by comprising the step of reflecting the shooting settings at a predetermined timing relating to the movement of the object from the first region to the second region.

10. A program that causes a computer to execute a control method for an imaging device, The control method for the imaging device is as follows: The imaging step involves causing the imaging means of the imaging device to output a frame-based image, Extraction steps include extracting a first region of brightness outside the dynamic range of the imaging means and a second region other than the first region from the frame-based image, The acquisition step involves acquiring an event signal that indicates the location and time when a change in brightness occurs in the field of view captured by the imaging device, A recognition step of recognizing an object in the field of view based on the event signal, A movement vector calculation step for calculating the movement vector of the object, A shooting setting calculation step that calculates the shooting settings of the imaging means based on the aforementioned movement vector, A program characterized by having a step of reflecting the shooting settings at a predetermined timing relating to the movement of the object from the first region to the second region.

Images