Imaging system

Abstract

To provide an imaging system that can easily set desired adjustment.SOLUTION: An imaging system according to the present invention comprises: an imaging sensor; a plurality of output interfaces that can externally output each of a plurality of output videos based on an original video imaged by the imaging sensor; setting means that sets a preset value for an area selected from a plurality of areas corresponding to the plurality of output videos in the original video; and adjustment means that adjusts whole of the original video using the preset value of the selected area. The setting means stores the preset value of a first area when it transition from a state in which the first area is selected to a state in which a second area is selected, and sets the preset value of the first area stored when the first area is again selected.SELECTED DRAWING: Figure 33

Description

[Technical Field]

[0001] The present invention relates to an imaging system capable of cropping. [Background technology]

[0002] There are imaging systems equipped with a crop function that cuts out a portion of a captured image for use. In these imaging systems, adjustments such as focus, exposure, and color balance, which affect the entire captured image, are typically made to ensure that the cropped image is desirable. When these adjustments are made automatically, it is preferable to fit the sensing area within the crop area. Patent Document 1 discloses a technology for a system that cuts out a target image (crop area) from a wide-angle image (full area) and uses it, in which provisional correction values for the target image are created and corrected using information from the wide-angle image in order to quickly apply adjustment values when switching the target image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-222816 Summary of the Invention [Problem to be solved by the invention]

[0004] The inventors have developed an imaging system capable of generating output images of different crop areas from a single video source (original video) and simultaneously outputting these output images to an external device via multiple output terminals. When multiple output images are simultaneously output in this manner, it is difficult to automatically determine how to adjust focus, exposure, color balance, and other settings. This is because the brightness and subject matter of the image differ for each crop area, and adjusting the image quality for one crop area may degrade the image quality of other crop areas. Furthermore, the device cannot automatically determine which of the multiple output images the user places the most importance on.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an imaging system that allows desired adjustments to be easily set. [Means for solving the problem]

[0006] The imaging system of the present invention comprises an imaging sensor, a plurality of output interfaces capable of outputting a plurality of output images based on an original image captured by the imaging sensor to the outside, a setting means for setting a setting value for an area selected from a plurality of areas in the original image that correspond to the plurality of output images, and an adjustment means for adjusting the entire original image using the setting value of the selected area, wherein the setting means stores the setting value of the first area when a transition occurs from a state in which a first area is selected to a state in which a second area is selected, and sets the stored setting value of the first area when the first area is selected again. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide an imaging system that allows desired adjustments to be easily set. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a configuration of an imaging system according to a first embodiment. [Figure 2] Example of original video captured by the imaging device in Example 1 [Figure 3] Example of crop setting screen in Example 1 [Figure 4] Image of crop 1 area cut out from the original image in Figure 2 [Figure 5] Image of crop 2 area cut out from the original image in Figure 2 [Figure 6] Original image captured after adjusting the exposure of Crop 2 to achieve the correct exposure [Figure 7] Image of crop 1 area cut out from the original image in Figure 6 [Figure 8] Image of crop 2 area cut out from the original image in Figure 6 [Figure 9] Flowchart of user setting application processing in the first embodiment [Figure 10] FIG. 10 is a diagram showing the configuration of an imaging system according to a second embodiment. [Figure 11] Example of crop setting screen in Example 2 [Figure 12] Flowchart of exposure compensation processing [Figure 13] FIG. 10 is a diagram showing the results of exposure correction processing in each block in the second embodiment. [Figure 14] FIG. 10 is a diagram showing the configuration of an imaging system according to a third embodiment. [Figure 15] Example of original video captured by the imaging device in the third embodiment [Figure 16] Example of crop setting screen in Example 3 [Figure 17] Image of crop 1 area cut out from the original image in Figure 15 [Figure 18] Image of crop 2 area cut out from the original image in Figure 15 [Figure 19] Original image captured with autofocus adjusted at Crop 2 setting [Figure 20] Image of crop 1 area cut out from the original image in Figure 19 [Figure 21] Image of crop 2 area cut out from the original image in Figure 19 [Figure 22] Flowchart of user setting application processing in the third embodiment [Figure 23] FIG. 10 is a diagram showing the configuration of an imaging system according to a fourth embodiment. [Figure 24] 10 is a flowchart of the process of the adjustment unit when the adjustment reference area is changed. [Figure 25] FIG. 10 is a diagram showing the configuration of an imaging system according to a fifth embodiment. [Figure 26] Example of original video captured by the imaging device in Example 5 [Figure 27] Example of AF setting screen when crop 1 is selected in Example 5 [Figure 28]Example of AF position setting screen when Crop 1 is selected in Example 5 [Figure 29] Example of AF position setting screen when Crop 2 is selected in Example 5 [Figure 30] FIG. 13 is a diagram showing the configuration of an imaging system according to a sixth embodiment. [Figure 31] Example of original video captured by the imaging device in Example 6 [Figure 32] Example of crop setting screen in Example 6 [Figure 33] Flowchart of user setting application processing in the sixth embodiment DETAILED DESCRIPTION OF THE INVENTION

[0009] Example 1 Hereinafter, a first embodiment of the present invention will be described, which will explain an exposure adjustment method in an imaging system capable of outputting images selected as different crop regions to a plurality of output units.

[0010] 1 is a diagram showing the configuration of an imaging system in Example 1. The imaging system is made up of an imaging device 1 and a controller device 2. The imaging device 1 has a lens 110, an imaging unit 120, an image processing unit 130, an output unit 140, a crop region setting unit 150, an allocation setting unit 160, an adjustment unit 170, and a camera communication unit 180.

[0011] The lens 110 is a mechanism including optical components that captures light and forms an image on the imaging unit 120, and the lens can be moved to adjust zoom and focus. The imaging unit 120 is an imaging sensor that converts the captured light into an electrical signal. The image processing unit 130 is an image processing circuit that performs various image processes on the electrical signal converted by the imaging unit 120 to convert it into a video signal, and includes a cropping unit 131 and multiple image processing blocks (not shown). Hereinafter, the raw video captured by the imaging unit 120 and captured in the image processing unit 130 will be referred to as the "original video."

[0012] The output unit 140 is a video output interface that outputs video signals such as HDMI (registered trademark) and SDI (Serial Digital Interface) to the outside, and has multiple output units such as output unit A 141A and output unit B 141B. The crop area setting unit 150 controls the setting of an area for cropping processing that cuts out a portion of the video signal. The allocation setting unit 160 controls the allocation of crop areas to the multiple output units of the output unit 140. The adjustment unit 170 has an AE setting management unit 171, an AE unit 172, and a storage area (not shown), and controls the management and adjustment of various parameter settings related to exposure in the imaging unit 120. The camera communication unit 180 is a communication interface that communicates with the controller device 2 and other devices.

[0013] The controller device 2 has a selection unit 210 and a controller communication unit 220. The selection unit 210 has an operation input unit 211 that accepts user input, a setting screen control unit 212 that creates a screen to be presented to the user, and a display unit 213 that displays the created setting screen. The selection unit 210 provides a user interface (UI) for setting areas of multiple output videos that are respectively output from multiple output units, and a UI for setting individual setting values for each area of the multiple output videos. The controller communication unit 220 is a communication interface that communicates with the imaging device 1 and other devices.

[0014] Although omitted in this embodiment for the sake of simplicity, the imaging device 1 may be provided with a recording unit (not shown) that records video data in a recording medium such as an internal memory or an SD card. Also, a live view video may be transmitted from the imaging device 1 to the controller device 2, allowing the live view video to be viewed on the controller device 2.

[0015] First, we will explain the process of converting light captured by the lens of the imaging device 1 into a video signal output and outputting the video to the outside. The light collected by the lens 110 is photoelectrically converted in the imaging unit 120. The photoelectrically converted imaging signal is subjected to various image processes by the image processing unit 130 to generate a video signal. The output unit 140 is an external output such as HDMI or SDI. The video signal generated by the image processing unit 130 is output from the output unit 140 to the outside, and the video signal is transmitted to a connected monitor, switcher, etc.

[0016] Next, the cropping process for cutting out a part of the video signal will be described. FIG. 2 shows an example of an image captured by the imaging device 1, and FIG. 3 shows an example of an operation screen displayed on the selection unit 210 of the controller device 2. As shown in FIG.

[0017] The crop setting screen 20 shown in FIG. 3 is composed of a menu cursor 21 indicating the currently selected item and the following seven items (22 to 28). The output unit A allocation setting item 22 is an item for setting the crop area to be allocated to the output unit A 141A (i.e., the area of the video to be output from the output terminal of the output unit A). The output unit B allocation setting item 23 is an item for setting the crop area to be allocated to the output unit B 141B (i.e., the area of the video to be output from the output terminal of the output unit B). The crop 1 area setting item 24 is an item for setting the size and position of crop 1. The crop 2 area setting item 25 is an item for setting the size and position of crop 2. The adjustment reference area selection item 26 is an item for selecting the area that serves as the reference for correcting various adjustment values, and full screen, crop 1, and crop 2 can be selected. Items 27 and 28 are items for setting individual setting values for each area. The exposure compensation item 27 when crop 1 is selected is an item for setting the exposure compensation value that is applied when crop 1 is selected in the adjustment reference area selection item 26. The exposure compensation item 28 when crop 2 is selected is an item for setting the exposure compensation value that is applied when crop 2 is selected in the adjustment reference area selection item 26.

[0018] In FIG. 2, the area surrounded by the solid line 10 indicates the entire screen area captured by the image capture unit 120, and the areas surrounded by the dashed lines 11 and 12 indicate the respective crop areas. Any crop size and position can be specified using the selection unit 210 of the controller device 2. If the imaging system is configured to allow live view confirmation on the controller device 2, it is preferable to be able to display an image in which each crop frame is visible, as in the image in FIG. 2. It is also preferable to display the number of each crop area (such as "Crop 1" or "Crop 2") along with the crop frame. The size and position information of each crop area are displayed in the crop 1 area setting item 24 and the crop 2 area setting item 25. In the case of the content shown in FIG. 3, the crop area for crop 1 is 1280 x 720 in size and has a center coordinate position of (1136, 1392), and the crop area for crop 2 is 1280 x 720 in size and has a center coordinate position of (2627, 1392). The position and size of the crop area can be specified by selecting the dashed lines 11 and 12 and performing enlargement / reduction or movement operations, or by entering values in the crop 1 area setting item 24 or the crop 2 area setting item 25 on the crop setting screen 20 shown in Figure 3.

[0019] The size and position information of the crop area specified by the selection unit 210 is transmitted from the controller communication unit 220 to the camera communication unit 180. The camera communication unit 180 distinguishes the received information, and if the information is the cutout size or position information of the crop area, transmits it to the crop area setting unit 150.

[0020] Crop area setting unit 150 sets cropping unit 131 based on the crop size and position information of the transmitted crop area. Cropping unit 131 is part of the circuitry of image processing unit 130, and is capable of generating a video signal by cropping any area from a captured video. The video signal generated by cropping unit 131 is subjected to various image processes by image processing unit 130, and then transmitted to output unit 140, where it is output to the outside as a video signal cropped from the specified crop area.

[0021] Next, a method for allocating the video cut out in the crop area and the output unit will be described. As shown in Fig. 2, multiple cropping areas can be set, and as shown in Fig. 1, output unit 140 has multiple output units. Therefore, it is necessary to specify which output unit will output the video of which cropping area. An example of how to do this and the processing to be executed are described below.

[0022] The selection items for output unit A allocation setting item 22 and output unit B allocation setting item 23 in Figure 3 include full screen, crop 1, and crop 2, and it is possible to set the area to be allocated to the corresponding output unit. When settings are made using output unit A allocation setting item 22 and output unit B allocation setting item 23, the set allocation information is transmitted from controller communication unit 220 to camera communication unit 180. Camera communication unit 180 determines whether the received information is allocation information, and if so, transmits it to allocation setting unit 160. Based on the transmitted allocation information, allocation setting unit 160 controls the output destination of the video signal cropped by cropping unit 131 or the full-screen video signal.

[0023] Next, a method for adjusting the image will be described. Figures 4 and 5 are images cut out from the image captured in Figure 2 in the crop 1 and crop 2 areas, respectively. In this case, the exposure of the image in crop 1 shown in Figure 4 is correct, but the exposure of the image in crop 2 is underexposed. Also, Figure 6 is an image captured after adjusting the exposure of crop 2 to be correct. In this case, the exposure of the image in crop 2 shown in Figure 8 is correct, but the exposure of the image in crop 1 shown in Figure 7 is overexposed.

[0024] When there is a difference in brightness in the captured image, the area cut out by cropping may not be properly exposed. In this case, the user must decide which exposure to use. Therefore, in this embodiment, an exposure compensation value is set for each crop area, and the exposure is adjusted accordingly. By selecting the area you want to adjust, you can make the exposure correction you want.

[0025] First, the user sets an exposure compensation value for each crop area using the exposure compensation when crop 1 is selected item 27 and the exposure compensation when crop 2 is selected item 28. Next, the area that will serve as the adjustment reference is specified using the adjustment reference area selection item 26. The adjustment information specified by the selection unit 210 is transmitted from the controller communication unit 220 to the camera communication unit 180. The camera communication unit 180 determines whether the received information is adjustment information, and if so, transmits it to the AE setting management unit 171.

[0026] The AE setting management unit 171 acquires the exposure compensation value of the crop area corresponding to the transmitted adjustment reference area selection item and transmits it to the AE unit 172. Based on the transmitted exposure compensation value, the AE unit 172 performs exposure compensation by setting the aperture, shutter speed, and ISO sensitivity of the lens 110 for the imaging unit 120. By processing in this manner, it is possible to make adjustments as intended by the user.

[0027] A series of controls from when the user changes the settings to when the adjustments are applied can be realized by applying the process shown in the flowchart of Fig. 9. The flowchart of Fig. 9 will now be described.

[0028] In S901, the controller device 2 monitors whether the adjustment reference area selection item 26 has been changed, and if there has been a change since the last time S901 was executed, the process proceeds to S902, and if there has not been a change, the process branches to S904. In S902, the controller device 2 notifies the AE setting management unit 171 of the changed value of the adjustment reference area (new user setting value) from the controller communication unit 220 via the camera communication unit 180, using the process described above. In S903, the AE setting management unit 171 saves the notified new user setting value of the adjustment reference area in a storage area (not shown), and the process proceeds to S913, which will be described later.

[0029] In S904, the controller device 2 monitors whether the exposure compensation item 27 when crop 1 is selected has been changed, and if there has been a change since the last time S904 was executed, the process proceeds to S905, and if there has not been a change, the process branches to S907. In S905, the controller device 2 notifies the AE setting management unit 171 of the changed value of the exposure compensation value for crop 1 (new user setting value) from the controller communication unit 220 via the camera communication unit 180, using the processing described above. In S906, the AE setting management unit 171 saves the notified exposure compensation value for crop 1 in a storage area (not shown), and the process proceeds to S913, which will be described later.

[0030] In S907 to S909, the same processing as in S904 to S906 is performed on the exposure compensation value when crop 2 is selected. Also, in S910 to S912, the same processing as in S904 to S906 is performed on the exposure compensation value when full screen is selected. In this embodiment, the exposure compensation value when full screen is selected is set using a setting screen different from the crop setting screen 20 of FIG. 3. However, this is not limiting, and an item for setting the exposure compensation value when full screen is selected may be added to the crop setting screen 20 of FIG. 3. If no change was made in S910, the process returns to S901.

[0031] In S913 and S915, the AE setting management unit 171 reads the setting value of the adjustment standard area from the storage area, and branches to S914 if the adjustment standard area is crop 1, to S916 if it is crop 2, and to S917 if it is the full screen. In S914, the AE setting management unit 171 reads the exposure compensation value for crop 1 from the storage area and notifies the AE unit 172. In S916, the AE setting management unit 171 reads the exposure compensation value for crop 2 from the storage area and notifies the AE unit 172. In S917, the AE setting management unit 171 reads the exposure compensation value for the full screen from the storage area and notifies the AE unit 172.

[0032] In S918, the AE unit 172 performs exposure compensation for the imaging unit 120 as described above based on the notified exposure compensation value. Then, the process returns to S901. In this way, every time the settings are changed on the crop setting screen 20, exposure compensation using the exposure compensation value according to the adjustment reference area is applied to the imaging unit 120.

[0033] As described above, the imaging system of this embodiment allows the user to properly adjust the exposure of the intended crop area simply by selecting the adjustment reference area, thereby providing an imaging system with excellent usability that allows the user to easily set the desired adjustments.

[0034] In this embodiment, the user sets the exposure compensation value for each crop area using the exposure compensation item 27 when crop 1 is selected and the exposure compensation item 28 when crop 2 is selected. However, instead of such manual setting, the imaging device 1 may automatically set an appropriate exposure compensation for each crop area. For example, the imaging device 1 can calculate an appropriate exposure compensation value for a specified crop area by performing photometry only on that crop area. Information about the crop area during this automatic exposure compensation can be obtained by transmitting information about the crop size and position of the crop area from the crop area setting unit 150 to the adjustment unit 170.

[0035] Furthermore, a function may be provided to check whether the exposure in the area after the change is as intended before switching the adjustment reference area. For example, an image is captured without changing the exposure setting of the image capturing unit 120. Then, the image processing unit 130 may perform image processing (brightness correction) on the captured image to create an image for checking the adjustment results, simulating the exposure correction after the change, and output the image to a checking unit (not shown) or an arbitrary output unit. The method for displaying the confirmation image may be a PinP display, in which a small independent area is provided in the output image and the confirmation image is displayed therein.

[0036] In some cases, the imaging device 1 is configured to record video data based on original video captured by the imaging unit 120 to the built-in media. In such cases, if the adjustment value of the imaging unit 120 is changed based on the exposure compensation value of the adjustment reference area while the video data is being recorded, video data with inappropriate exposure may be recorded to the built-in media. This is because the area of the video to be recorded to the built-in media and the adjustment reference area of the output video from the output unit are not necessarily the same, so the appropriate exposure compensation amount may differ. Therefore, to prevent video data with inappropriate exposure from being recorded, the adjustment unit 170 may not adjust the exposure of the imaging unit 120 based on the exposure compensation value of the adjustment reference area while the video data is being recorded to the built-in media. Furthermore, in this case, the adjustment unit 170 (AE unit 172) may adjust the exposure of the imaging unit 120 based on the exposure compensation value preset for the area to be recorded to the built-in media (which may be the entire area or a cropped area). It is also preferable that the user be able to set the exposure compensation value for the area to be recorded on a setting screen provided by the selection unit 210.

[0037] The exposure compensation value used in the actual adjustment may be determined by combining the exposure compensation values set for each crop area. For example, if the exposure compensation value when crop 1 is selected is set to ±0 and the exposure compensation value when crop 2 is selected is set to +2 on the crop setting screen 20, these may be weighted at a ratio of, for example, 1:1, and an exposure compensation value of +1 (= ±0 / 2 + 2 / 2) may be used for the adjustment. The combination ratio (weight) is not limited to 1:1 and may be a fixed value or may be changeable. For example, an item for setting the combination ratio (weight for each crop area) may be added to the crop setting screen 20, allowing the user to set it arbitrarily. The combination ratio may also be adaptively (automatically) changed depending on the area ratio or brightness ratio of the crop areas.

[0038] In addition, although the present embodiment is directed to exposure correction, it is also possible to perform color correction such as white balance. In this case, the image processing unit 130 may include a color correction unit that applies color correction to each of the cropped images after the cropping unit 131. The color correction unit may be preset with a plurality of color correction parameters used for color correction. It is preferable that the selection unit 210 provides a user interface for specifying the color correction parameters, allowing the user to select the color correction parameters for each cropped area. As the color correction parameters, for example, parameters for correcting the influence of the color of light in the imaging environment, such as sunlight, shade, or incandescent light, may be preset.

[0039] Furthermore, in this embodiment, the selection unit 210 is described as being included in the controller device 2, but the imaging device 1 or the switcher device may also be configured to have the selection unit 210. In other words, the imaging system may be configured as a combination of the imaging device 1 and the controller device 2, a combination of the imaging device 1 and the switcher device, or a configuration of the imaging device 1 alone.

[0040] <Example 2> A second embodiment of the present invention will now be described.

[0041] In the adjustment method described in the first embodiment, the image in the area selected as the adjustment reference area is properly exposed, but the image in areas other than the adjustment reference area may not be properly exposed. In the second embodiment, image processing is used to mitigate the problem of exposure in areas other than the adjustment reference area. In addition, this embodiment also illustrates a process for selecting which output unit is to be prioritized from among multiple output units, and adjusting the imaging unit 120 based on the setting of the prioritized output unit, thereby suppressing data loss such as whiteout and blackout in the video signal of the prioritized output unit.

[0042] Fig. 10 is a diagram showing the configuration of an imaging system in Example 2. The imaging system in Example 2 differs from the configuration in Example 1 in that it has an individual image processing unit 132 and a priority output setting unit 190. Also, while the crop setting screen displayed on the selection unit 210 of the controller device 2 in Example 1 was the operation screen shown in Fig. 3, Example 2 differs in that an operation screen shown in Fig. 11 is used. Other than that, it is the same as Example 1, and therefore description thereof will be omitted.

[0043] The individual image processing unit 132 performs individual image processing on each of the video signals created by the cropping unit 131 and output to the output unit A 141A and the output unit B 141B. The priority output setting unit 190 controls the priority output terminal used during adjustment, which will be described later.

[0044] 11 to 13, the exposure correction process using the individual image processing unit 132 and the priority output setting unit 190 will be described. FIG. 11 is a diagram showing an example of a crop setting screen displayed on the selection unit 210 of the controller device 2. FIG. 12 is a flowchart of the exposure correction process. FIG. 13 is a diagram showing the results of the exposure correction process in each block of the imaging device 1 when the settings on the crop setting screen 30 shown in FIG. 11 are applied.

[0045] The crop setting screen 30 shown in Fig. 11 is the same as in the first embodiment except that the adjustment reference area selection item 26 in the crop setting screen 20 of Fig. 3 has been replaced with a priority output terminal item 36. The priority output terminal item 36 is an item for setting the output terminal that is to be preferentially adjusted so that the video signal is appropriate, and it is possible to select output unit A or output unit B. Fig. 11 shows the state in which output unit B has been set.

[0046] When an item on the crop setting screen 30 shown in FIG. 11 is changed, the exposure compensation process shown in FIG. 12 is started. When the exposure compensation process is started, the controller device 2 first executes the following process to acquire the exposure compensation value assigned to the priority output terminal. In S1201, the controller device 2 acquires the value set in the priority output terminal item 36. If output unit A is selected, the process proceeds to S1202, and if output unit B is selected, the process proceeds to S1203. In S1202, the controller device 2 acquires the value set in the output unit A allocation setting item 22 (i.e., the setting value of the area to be output from the output terminal of output unit A). In the case of full screen, the process proceeds to S1204, in the case of crop 1, the process proceeds to S1205, and in the case of crop 2, the process proceeds to S1206. In S1203, the controller device 2 acquires the value set in the output unit B allocation setting item 23 (i.e., the setting value of the area to be output from the output terminal of output unit B). Similarly, in the case of full screen, the process proceeds to S1204, in the case of crop 1, the process proceeds to S1205, and in the case of crop 2, the process proceeds to S1206. In S1204, the exposure compensation value set for full screen is acquired, in S1205 the exposure compensation value set for crop 1 is acquired, and in S1206 the exposure compensation value set for crop 2 is acquired. The exposure compensation value thus acquired (the exposure compensation value assigned to the priority output terminal) is sent from the controller device 2 to the imaging device 1. After that, the process proceeds to S1207.

[0047] Next, exposure compensation is performed using the exposure compensation value assigned to the acquired priority output terminal. In S1207, the adjustment unit 170 performs exposure compensation processing on the image capture unit 120 based on the exposure compensation value assigned to the priority output terminal acquired in S1204 to S1206. In the example of settings on the crop setting screen 30 shown in FIG. 11, the priority output terminal is "output unit B," the area assigned thereto is "crop 2," and the exposure compensation value set for that area is +2. Therefore, the image capture unit 120 captures a positively compensated image as indicated by reference numeral 40 in FIG. 13. The image captured by the image capture unit 120 is subjected to cropping processing of the crop area by the cropping unit 131, and an image 41A of the crop 1 area to be output to the output unit A 141A and an image 41B of the crop 2 area to be output to the output unit B 141B are transmitted to the individual image processing unit 132.

[0048] The individual image processing unit 132 performs the following individual processing on images 41A and 41B to be output to each output unit so that images with proper exposure are output from each output unit. First, image 41B of the crop 2 area assigned to output unit B, which is the priority output terminal, is an image cut out from an original image captured with proper exposure, so no individual image processing is performed on it. On the other hand, for image 41A of the crop 1 area assigned to output unit A, which is not the priority output terminal, the individual image processing unit 132 performs image processing based on the exposure compensation amount for crop 1 to adjust the exposure of image 41A. At this time, it is preferable that the individual image processing unit 132 adjusts the brightness of image 41A so that the brightness of image 41A approaches the brightness of an image captured with the exposure of the imaging unit 120 adjusted based on the exposure compensation amount for crop 1. In other words, the individual image processing unit 132 simulates the exposure adjustment of the imaging unit 120 through image processing (brightness adjustment). The amount of brightness adjustment for image 41A may be determined (calculated) based on the amount of exposure compensation applied to the exposure adjustment of image capturing unit 120 (the amount of exposure compensation for crop 2 area) and the amount of exposure compensation for the area of image 41A (the amount of exposure compensation for crop 1 area). A specific processing example will be described below.

[0049] First, in S1208, the individual image processing unit 132 determines whether correction of images to be output to all output units has been completed. If not completed, the process proceeds to S1209, and if completed, the individual image processing ends.

[0050] In S1209, the individual image processing unit 132 acquires the exposure compensation value assigned to the output unit from the allocation setting information of the output unit targeted for individual image processing and the exposure compensation information at the time of crop selection. In S1210, the individual image processing unit 132 acquires the difference between the "exposure compensation value of the output unit" acquired in S1209 and the "exposure compensation value assigned to the priority output terminal." For example, in the case of output unit A, the exposure compensation value of output unit A is ±0, and the exposure compensation value of output unit B assigned to the priority output terminal is +2, so 0 - 2 = -2 is acquired as the difference.

[0051] In S1211, the individual image processing unit 132 performs image processing based on the difference acquired in S1210. Exposure correction is performed by processing. For example, in the case of output unit A, image 41A input to individual image processing unit 132 is subjected to brightness correction of -2 by image processing to generate an image like reference numeral 42A. On the other hand, in the case of output unit B, the difference in exposure correction value is 0, so brightness correction is not performed by individual image processing unit 132, and input image 41B is output as is as image 42B. When individual image processing is completed, the process transitions to S1208, and the processes of S1209 to S1211 are repeated until correction is completed for all output units.

[0052] By performing exposure correction as described above, exposure adjustment is performed so that the image of the output section specified by the priority output terminal is captured at the correct exposure, and for the images of the other output sections, image processing is used to output images with reduced deviation from the correct exposure.

[0053] For example, suppose output unit A is connected to a device used for recording and distributing video, and output unit B is connected to a device used for previewing the video to be switched next. In this case, by setting the priority output terminal to output unit A, it is possible to prioritize adjustment of the video used for video recording or distribution. Furthermore, by using the priority output terminal setting, it is possible to synchronize the crop area switching process and the adjustment process associated with the crop area change. Furthermore, an option may be added to the priority output terminal item 36 so that adjustment processing is performed based on the area recorded by a recording unit (not shown).

[0054] In this embodiment, exposure correction processing is performed using both the imaging unit 120 and the individual image processing unit 132 to prevent data loss due to whiteout or blackout of the imaging signal obtained by the imaging unit 120, but exposure correction processing may also be performed by the individual image processing unit 132 alone.

[0055] Furthermore, in order to prevent changes in the exposure of the video data being recorded while the video is being recorded to the built-in media, it is preferable that the adjustment unit 170 not adjust the exposure of the image capture unit 120. In this case, the adjustment unit 170 may adjust the exposure of the image capture unit 120 based on an exposure correction value that is preset for the area to be recorded to the built-in media. Furthermore, control may be performed so that exposure correction processing is performed by adjusting the brightness of the output video using only the individual image processing unit 132.

[0056] Example 3 A third embodiment of the present invention will now be described.

[0057] While the imaging systems of Examples 1 and 2 are intended for exposure adjustment, the imaging system of Example 3 is intended for autofocus adjustment. Fig. 14 is a diagram showing the configuration of the imaging system of Example 3. The configuration of the imaging system of Example 3 differs in that the adjustment unit 170 of Example 1 is replaced with an adjustment unit 1470. Another difference is that the crop setting screen displayed on the selection unit 210 of the controller device 2 is an operation screen as shown in Fig. 3 in Example 1, but an operation screen as shown in Fig. 16 is used in Example 3. Other than that, the imaging system is the same as Example 1, and therefore description thereof will be omitted.

[0058] The adjustment unit 1470 controls the management and adjustment of various parameter settings related to autofocus in the lens 110. The adjustment unit 1470 includes an AF setting management unit 1471 and an AF unit 1472.

[0059] Next, a description will be given of the cropping process in Example 3. Fig. 15 shows an example of an image captured by the imaging device 1, and Fig. 16 is a diagram showing an example of a crop setting screen displayed on the selection unit 210 of the controller device 2.

[0060] In FIG. 15, similar to FIG. 2 of the first embodiment, a solid line 1510 indicates the entire screen area captured by the image capturing unit 120, and broken lines 1511 and 1512 indicate the areas of crop 1 and crop 2, respectively. Any crop size and position can be specified using the selection unit 210 of the controller device 2. Frames 1513 and 1514 represent AF frames for crop 1 and crop 2, respectively, and are adjusted during autofocus so that the subject within the frame is in focus. As a known method can be used to adjust the autofocus itself, a description thereof will be omitted.

[0061] The crop setting screen 1620 shown in FIG. 16 is a screen for configuring various crop-related settings, similar to FIG. 3 in the first embodiment. The same reference numerals as those in FIG. 3 have the same content, and therefore their descriptions are omitted. However, in the example of FIG. 16, crop 1 has a size of 1280 × 720 and a central coordinate position of (1300, 1200), and crop 2 has a size of 1280 × 720 and a central coordinate position of (2800, 950). The difference from the items in FIG. 3 is that the exposure compensation item 27 when crop 1 is selected and the exposure compensation item 28 when crop 2 is selected have been replaced with an AF setting item 1627 when crop 1 is selected and an AF setting item 1628 when crop 2 is selected, respectively. The AF setting item 1627 when crop 1 is selected and the AF setting item 1628 when crop 2 is selected are autofocus settings to be applied when crop 1 and crop 2 are selected, respectively. Whether or not the setting is actually applied depends on the setting of the adjustment reference area selection item 26. In this embodiment, the AF setting value includes information specifying the size and position of the AF frame. Specifically, the size of the AF frame can be selected from the entire crop, a large frame, or a small frame, and the center coordinates can be set as the position of the AF frame. In FIG. 16, the AF setting when Crop 1 is selected is set to a large frame with a center coordinate position of (1300, 1400), and the AF setting when Crop 2 is selected is set to a small frame with a center coordinate position of (2800, 800). The AF setting items are merely examples, and other settings may be added, such as whether autofocus is performed intermittently or only once, or whether face recognition and tracking is enabled or disabled.

[0062] Next, a method for adjusting the image will be described. Figures 17 and 18 are images obtained by cutting out the image in Figure 15 in the areas of crop 1 and crop 2. In this case, the focus of the image in crop 1 shown in Figure 17 is correct, but the focus of the image in crop 2 shown in Figure 18 is blurred. Also, Figure 19 is an image captured after adjusting the focus of crop 2 to be correct. In this case, the image in crop 2 shown in Figure 21 is correct, but the image in crop 1 shown in Figure 20 is blurred.

[0063] As shown in Figures 15 and 19, when there is a difference in distance between multiple subjects in a captured image, the subjects in the area cut out by cropping may not be in proper focus. In this case, the user must decide which area to focus on. Therefore, in this embodiment, a focus setting value is stored for each crop area, and the user can adjust the focus as intended by selecting the area to focus on.

[0064] First, the user sets the AF setting frame size and position for each crop area using the AF setting item when crop 1 is selected 1627 and the AF setting item when crop 2 is selected 1628. Next, the user specifies the crop area that will be the adjustment reference area using the adjustment reference area selection item 26. The setting information specified by the selection unit 210 is transmitted from the controller communication unit 220 to the AF setting management unit 1471 via the camera communication unit 180, similar to the exposure adjustment information in the first embodiment.

[0065] The AF setting management unit 1471 acquires the AF setting value of the crop area specified in the adjustment reference area and transmits it to the AF unit 1472. Based on the transmitted AF setting value, the AF unit 1472 uses the imaging information of the imaging unit 120 or values from a ranging sensor (not shown) to adjust the focus of the lens 110. By processing in this manner, it becomes possible to perform focus adjustment using the AF setting intended by the user.

[0066] A series of controls from when the user changes the settings to when the adjustments are applied can be realized by applying the process shown in the flowchart of Fig. 22. The flowchart of Fig. 22 will now be described.

[0067] In S2201, the controller device 2 monitors whether the adjustment reference area selection item 26 has been changed, and if there has been a change since the last time S2201 was executed, the process proceeds to S2202, and if there has not been a change, the process branches to S2204. In S2202, the controller device 2 notifies the AF setting management unit 1471 of the changed value of the adjustment reference area (new user setting value) from the controller communication unit 220 via the camera communication unit 180, using the process described above. In S2203, the AF setting management unit 1471 saves the notified new user setting value of the adjustment reference area in a storage area (not shown), and proceeds to S2213, which will be described later.

[0068] In S2204, the controller device 2 monitors whether the AF setting item 1627 when crop 1 is selected has been changed, and if there has been a change since the last time S2204 was executed, the process proceeds to S2205, and if there has not been a change, the process branches to S2207. In S2205, the controller device 2 notifies the AF setting management unit 1471 of the changed value of the AF setting value for crop 1 (new user setting value) from the controller communication unit 220 via the camera communication unit 180, using the processing described above. In S2206, the AF setting management unit 1471 saves the notified AF setting value for crop 1 in a storage area (not shown), and the process proceeds to S2213, which will be described later.

[0069] In S2207 to S2209, the same processing as in S2204 to S2206 is performed on the AF setting value when crop 2 is selected. Also, in S2210 to S2212, the same processing as in S2204 to S2206 is performed on the AF setting value when full screen is selected. Note that in this embodiment, the AF setting value when full screen is selected is set using a setting screen different from the crop setting screen 1620 in FIG. 16. However, this is not limiting, and an item for setting the AF setting value when full screen is selected may be added to the crop setting screen 1620 in FIG. 16. If no change was made in S2210, the process returns to S2201.

[0070] In S2213 and S2215, the AF setting management unit 1471 reads the setting values of the adjustment reference area from the storage area, and branches to S2214 if the adjustment reference area is crop 1, to S2216 if it is crop 2, and to S2217 if it is the full screen. In S2214, the AF setting management unit 1471 reads the AF setting values of crop 1 from the storage area and notifies the AF unit 1472. In S2216, the AF setting management unit 1471 reads the AF setting values of crop 2 from the storage area and notifies the AF unit 1472. In S2217, the AF setting management unit 1471 reads the AF setting values for the full screen from the storage area and notifies the AF unit 1472.

[0071] In S2218, the AF unit 1472 performs autofocus adjustment on the lens 110 as described above based on the notified AF setting value. Then, the process returns to S2201. In this way, every time the setting is changed on the crop setting screen 1620, autofocus adjustment using the AF setting value according to the adjustment reference area is applied to the lens 110.

[0072] In this embodiment, the user sets the AF setting value for each crop area using the AF setting item 1627 when crop 1 is selected and the AF setting item 1628 when crop 2 is selected. However, instead of such manual setting, the imaging device 1 may perform autofocus using imaging information for each crop area. This information about the crop area during autofocus can be obtained by transmitting the cutout size and position information of the crop area from the crop area setting unit 150 to the adjustment unit 1470. Also, to simplify the explanation, the following will be similar to that of embodiment 1. However, as shown in FIG. 10 of the second embodiment, a priority output setting unit 190 may be added so that the output video of the terminal set as the priority output terminal is always in proper focus.

[0073] Furthermore, if the adjustment value of the lens 110 is changed based on the AF setting value of the adjustment reference area while recording to the built-in media, there is a possibility that video data with an inappropriate focus will be recorded to the built-in media. This is because the area of the video to be recorded to the built-in media and the adjustment reference area of the output video from the output unit are not necessarily the same, so the appropriate AF setting value may differ. Therefore, to prevent video data with an inappropriate focus from being recorded, it is preferable that the adjustment unit 1470 does not adjust the focus based on the AF setting value of the adjustment reference area while recording video data to the built-in media. Furthermore, in this case, the adjustment unit 1470 (AF unit 1472) may adjust the focus based on the AF setting value previously set for the area to be recorded to the built-in media (which may be the entire area or a cropped area). It is also preferable that the user be able to set the AF setting value for the area to be recorded on a setting screen provided by the selection unit 210.

[0074] Furthermore, in this embodiment, the selection unit 210 is described as being included in the controller device 2, but the imaging device 1 or the switcher device may also be configured to have the selection unit 210. In other words, the imaging system may be configured as a combination of the imaging device 1 and the controller device 2, a combination of the imaging device 1 and the switcher device, or a configuration of the imaging device 1 alone.

[0075] Example 4 A fourth embodiment of the present invention will now be described.

[0076] The imaging systems of Examples 1 and 2 are only for exposure adjustment, and the imaging system of Example 3 is only for autofocus adjustment, but the imaging system of Example 4 is for both exposure adjustment and autofocus adjustment. When changing the adjustment reference area in this configuration, it is advisable to determine the timing for performing each automatic adjustment so as to prevent autofocus from being performed in an inappropriate exposure adjustment state. This will be described in this example.

[0077] FIG. 23 is a diagram illustrating the configuration of an imaging system according to a fourth embodiment. The configuration of an adjustment unit 2370 differs from that of FIG. 1 of the first embodiment and FIG. 14 of the third embodiment. The adjustment unit 2370 includes an AE setting management unit 171, an AE unit 2371, an AF setting management unit 1471, and an AF unit 2372. Since the components other than the AE unit 2371 and the AF unit 2372 are the same as those in the first embodiment or the third embodiment, a description thereof will be omitted. The AE unit 2371 is added to the AE unit 172 of the first embodiment with a function to execute processing to notify the AF unit 2372 whether exposure adjustment executed after the adjustment reference area is changed has been completed. The AF unit 2372 is added to the AF unit 1472 of the third embodiment with a function to control so as not to execute autofocus adjustment until exposure adjustment is completed when the adjustment reference area is changed. A detailed processing flow will be described below.

[0078] Fig. 24 is a flowchart of the process performed by the adjustment unit 2370 when the adjustment reference area is changed. Note that before the process of Fig. 24 starts (that is, in the normal state), it is assumed that the AF unit 2372 is constantly executing autofocus processing.

[0079] In S2401, the AF unit 2372 stops the autofocus function. In S2402, the exposure adjustment value notified to the AE unit 2371 from the AE setting management unit 171 and the AF setting value notified to the AF unit 2372 from the AF setting management unit 1471 are changed to those of the new crop area. In S2403, the AE unit 2371 adjusts the exposure with the exposure adjustment value of the new crop area. In S2404, the process waits for the exposure adjustment to be completed, and once it is completed, the process proceeds to S2405. In S2405, the AF unit 2372 starts the autofocus function with the AF setting value of the new crop area.

[0080] By controlling in the above manner, it is possible to avoid errors caused by performing autofocus in an inappropriate exposure adjustment state. Note that modifications similar to those in the third embodiment are possible.

[0081] <Example 5> Hereinafter, a fifth embodiment of the present invention will be described. While the third embodiment is an example of an imaging system configured with an imaging device and a controller device, the fifth embodiment is an example of an imaging system configured with a single imaging device.

[0082] Fig. 25 is a diagram showing the configuration of an imaging device 1 in Example 5. The differences from the imaging device 1 in Fig. 14 of Example 3 are that the camera communication unit 180 is eliminated, a selection unit 230 is added, and the internal configuration of the image processing unit 2530 has been changed. The selection unit 230 has an operation input unit 231, a setting screen control unit 232, and a display unit 233. Other than these, the configuration is the same as that of Example 3, and therefore a description thereof will be omitted.

[0083] The cropping unit 2531 is similar to the cropping unit 131 in that it can generate a video signal by cropping any region from a captured image. However, it differs in that it can output not only to the output unit 140 but also to the display unit 233 (described later). The image output to the display unit 233 can also be selected from the entire region, crop 1 region, and crop 2 region. The operation input unit 231 is an interface that accepts user operations and includes operation members such as a keypad or touch panel. The setting screen control unit 232 creates a setting acceptance screen to be presented to the user, determines what settings have been made, and notifies the crop region setting unit 150, allocation setting unit 160, and AF setting management unit 1471 of new user setting values based on the settings. The display unit 233 displays a setting screen generated by the setting screen control unit 232 superimposed on the image output from the cropping unit 2531. The display unit 233 and the operation input unit 231 may be configured as touch panel displays.

[0084] The cropping process in the fifth embodiment will be described. As in the third embodiment, the selection unit 230 can display a crop setting screen as shown in FIG. 16, and the user performs crop setting operations on this screen. FIG. 26 shows an example of an image captured by the imaging device 1, where a solid line 2610 indicates the entire screen area captured by the imaging unit 120, and dashed lines 2611 and 2612 indicate the areas of crop 1 and crop 2, respectively. The user can specify any crop size and position using the selection unit 230. A frame 2613 indicates the active AF frame, which is adjusted during autofocus so that the subject within the frame is in focus. The active AF frame 2613 uses the setting value of the AF frame for the area set in the adjustment reference area selection item 26. The crop setting screen 1620 is displayed by pressing a menu key (not shown), and each item is set using a touch operation, a cross key (not shown), or the like. The output section A allocation setting item 22 to the adjustment reference area selection item 26 can be input or selected by a keypad or touch operation.

[0085] The setting flow of the AF setting item 1627 when crop 1 is selected and the AF setting item 1628 when crop 2 is selected will be described with reference to FIGS.

[0086] 27 shows an AF setting screen 2720 when crop 1 is selected. When the AF setting item 1627 when crop 1 is selected on the crop setting screen 1620 in FIG. 16 is selected, the screen transitions to the AF setting screen 2720 when crop 1 is selected. The AF setting screen 2720 when crop 1 is selected displays the currently selected The screen has a menu cursor 2721 indicating the currently selected item, an AF frame setting item 2722, an AF frame position item 2723, and an AF frame position adjustment item 2724. The AF frame setting item 2722 is an item for determining the size of the AF frame that will be the AF target area, and is selected from full crop 1, large frame, or small frame. The AF frame position item 2723 is an item for determining the center position of the AF frame, and is selected from crop center or variable. The AF frame position adjustment item 2724 is a setting for adjusting the center position when the AF frame position is variable, and touching this item transitions to the AF frame position adjustment screen of FIG. 28. The AF frame position adjustment screen has a cropped image 2811 of the crop 1 area and a crop 1 AF frame 2813. Currently, the adjustment reference area is set to crop 1, so the crop 1 AF frame 2813 is active, and AF is adjusted to focus on the face of a man present within this frame. The user can touch any location on this screen to move the crop 1 AF frame 2813. Additionally, since the crop 1 AF frame 2813 is currently active, AF is performed within that area after movement.

[0087] Meanwhile, for crop 2, an AF setting screen for when crop 2 is selected is also prepared, although not shown. Selecting the AF setting item 1628 for when crop 2 is selected on the crop setting screen 1620 transitions the screen to the AF setting screen for when crop 2 is selected. Similarly, touching AF frame position adjustment when the AF frame position is variable transitions to the AF frame position adjustment screen shown in Figure 29. Figure 29 shows a cropped image 2912 of the crop 2 area and a crop 2 AF frame 2914. Because the adjustment reference area is currently set to crop 1, the crop 2 AF frame 2914 is not active, and AF is not performed on the woman within the frame. The user can move the crop 2 AF frame 2914 by touching any location on this screen. Currently, the crop 2 AF frame 2914 is not active, but if the adjustment reference area is changed to crop 2, the crop 2 AF frame 2914 immediately becomes active, and AF is performed within that area. The active AF frame 2813 and the inactive AF frame 2914 may be visually distinguishable from each other by different colors, lines, shapes, etc.

[0088] As explained above, the present invention can be implemented as an image pickup device alone. Note that even in the case of a configuration of an image pickup device alone, modifications similar to those in the first to fourth embodiments (and the sixth embodiment described later) are possible.

[0089] Example 6 A sixth embodiment of the present invention will be described below. In the first to fifth embodiments, the setting values for each crop area must be set manually (by opening a menu screen), which poses a problem that the effort (time) required for setting increases as the number of crop areas increases. For example, in the third embodiment, the AF setting values for each crop area must be set manually, which poses a problem that the effort required for setting increases as the number of crop areas increases.

[0090] Therefore, in the sixth embodiment, the AF setting values are stored and set automatically, which makes it possible to set the AF setting values for a plurality of crop areas without much effort.

[0091] Fig. 30 is a diagram showing the configuration of an imaging system according to a sixth embodiment. The difference from the imaging system of Fig. 14 according to the third embodiment is that an AF setting storage determination unit 3001 is added to the imaging device 1. Since the rest of the imaging system is the same as that of the third embodiment, a description thereof will be omitted. The AF setting storage determination unit 3001 determines whether or not to store the AF setting value.

[0092] In the sixth embodiment, when a state transitions from a state in which a first region is selected to a state in which a second region is selected among a plurality of regions including the entire region and a plurality of crop regions, the AF setting value of the first region is stored. Then, when the first region is selected again, the AF setting value of the first region that has been stored is set. The method of selecting a region is not particularly limited, but for example, a region is selected using the adjustment reference region selection item 26.

[0093] This allows the AF setting values for multiple crop areas to be set without much effort. Note that rehearsals are sometimes conducted before video distribution or recording. Generally, appropriate adjustments (such as adjustments to the size of the crop area, adjustments to the subject position, and adjustments to the AF setting values) are made during the rehearsal. For this reason, if a rehearsal is conducted, it is preferable to store the AF setting values from the time of the rehearsal.

[0094] In the sixth embodiment, one of the following three AF controls is performed: According to the following AF controls, it is possible to keep the focus on a moving subject. Specific subject tracking AF: AF control in which the imaging device 1 detects a specific subject (such as a person, animal, or vehicle) and keeps the subject in focus while tracking the detected subject. Main subject tracking AF: AF control in which the imaging device 1 detects the main subject and keeps the subject in focus while tracking the detected subject. Touch tracking AF: AF control in which the imaging device 1 detects a subject present at a position (such as a touch position) specified by the user, tracks the detected subject, and continues to focus on the subject.

[0095] For example, the imaging device 1 first performs specific subject tracking AF. In specific subject tracking AF, the AF unit 1472 detects a specific subject from a captured video (captured image) by performing pattern matching using a previously prepared subject pattern. When a specific subject is detected (when a specific subject is present in the captured video), the AF unit 1472 performs control to display a subject frame (AF frame) indicating the detected subject, and also performs AF control.

[0096] If a specific subject is not detected (if a specific subject does not exist in the captured image), the imaging device 1 performs main subject tracking AF. In main subject tracking AF, the AF unit 1472 detects the main subject from the captured image. There is no particular limitation on the method for detecting the main subject, but for example, the subject that exists closest to the center of the captured image is detected as the main subject. The AF unit 1472 stores information on the color and texture of the detected subject, and can continue to detect (track) the same subject by performing pattern matching based on the stored information. The AF unit 1472 performs control to display a subject frame (AF frame) indicating the main subject, and also performs AF control.

[0097] If the subject detected by specific subject tracking AF or main subject tracking AF is not the subject intended (desired) by the user, the user specifies a position within the captured image, and the imaging device 1 performs touch tracking AF. In touch tracking AF, the AF unit 1472 detects a subject that exists at the position specified by the user from the captured image. The AF unit 1472 performs control to display a subject frame (AF frame) indicating the detected subject, and also performs AF control.

[0098] By performing AF control using the above procedure, the user can easily (with minimal effort) focus on the intended subject.

[0099] In the sixth embodiment, it is assumed that setting values including at least one of the following eight pieces of information are stored as AF setting values. The following information can be acquired, for example, from the lens 110 or the imaging unit 120, or can be acquired using information acquired from the lens 110 or the imaging unit 120. In the following information, the target position may be interpreted as the position of the target subject, or the target position may be interpreted as the position of the target area. The target area may be interpreted as the area of the target subject, or may be wider or narrower than the area of the target subject. Information indicating the target position for AF control in the original image Information identifying the subject for AF control (Person A, Person B, etc.) Information indicating the type of subject (people, animals, vehicles, etc.) Information indicating the distance to the target subject Information indicating the size of the AF control target area in the original image Information indicating the color of the target area Information indicating the texture of the target area Information showing a histogram of the region of interest

[0100] For example, in the case of specific subject tracking AF, information identifying the target subject or information indicating the type of target subject is stored. In the case of main subject tracking AF and touch tracking AF, information indicating the subject distance to the target subject, information indicating the target position, information indicating the color of the target area, and information indicating the texture of the target area are stored. In the case of touch tracking AF, information indicating the subject distance to the target subject, information indicating the target position, information indicating the color of the target area, and information indicating the texture of the target area are also stored.

[0101] Note that if the coordinates of the AF frame (information indicating the target position of AF control in the original image) are used as the AF setting value, there is a risk that the desired subject will not be in focus if the desired subject moves between the time the AF setting value for the area is determined and the time the area is selected. This would require the user to take the trouble of updating (resetting) the AF setting value. Even if the desired subject moves between the time the AF setting value for the area is determined and the time the area is selected, if the AF setting value includes other information as described above, the desired subject can be detected and focused on. Therefore, it is preferable that the AF setting value include, from among the multiple pieces of information described above, information other than the information indicating the target position of AF control in the original image.

[0102] FIG. 31 shows an example of an image captured by the imaging device 1, and FIG. 32 shows an example of a crop setting screen displayed on the selection unit 210 of the controller device 2. As shown in FIG.

[0103] In FIG. 31, similar to FIG. 15 of the third embodiment, solid line 3101 indicates the full screen area captured by the imaging unit 120, and dashed lines 3102, 3103, and 3104 indicate the crop 1 area, crop 2 area, and crop 3 area, respectively. Any crop size and position can be specified using the selection unit 210 of the controller device 2. Furthermore, frames 3105, 3106, 3107, and 3108 represent the AF frame for the full screen, the AF frame for crop 1, the AF frame for crop 2, and the AF frame for crop 3, respectively. Autofocus is adjusted to focus on the subject indicated by the frame. A known method for adjusting the autofocus itself can be used, so a description thereof will be omitted.

[0104] A crop setting screen 3200 shown in Fig. 32 is a screen for making various settings related to cropping, similar to Fig. 16 in the third embodiment. Items with the same reference numerals as Fig. 16 have the same content, so description thereof will be omitted. The differences from the items in Fig. 16 are that a crop 3 area setting item 3201, an AF setting item when full screen is selected 3202, and an AF setting item when crop 3 is selected 3205 have been added, and the AF setting item when crop 1 is selected 1627 and the AF setting item when crop 2 is selected 1628 have been replaced with an AF setting item when crop 1 is selected 3203 and an AF setting item when crop 2 is selected 3204, respectively.

[0105] In the sixth embodiment, in the case of specific subject tracking AF, identification information of the AF target subject (information identifying the target subject for AF control) is acquired as at least a part of the AF setting value and displayed in the AF setting item. In the case of main subject tracking AF, coordinates of the AF target subject (information indicating the target position for AF control in the original image) are acquired as at least a part of the AF setting value and displayed in the AF setting item. In the case of main subject tracking AF, the imaging device 1 automatically detects and tracks the main subject, so the character string "auto tracking" is also displayed in the AF setting item. In the case of touch tracking AF, the coordinates of the AF target subject are also acquired as at least part of the AF setting values and displayed in the AF setting items. In the case of touch tracking AF, the imaging device 1 detects and tracks a subject that exists at a position specified by the user, so the text "Specified Tracking" is also displayed in the AF setting items.

[0106] For example, suppose the user selects full screen in the adjustment reference area selection item 26, touches within the AF frame 3105 while checking the full screen area indicated by the solid line 3101, and the subject indicated by the AF frame 3105 is selected by touch tracking AF. In that case, as shown in FIG. 32, the AF setting item when full screen is selected 3202 displays "Specified Tracking (2000, 10000)." Suppose the user selects Crop 1 in the adjustment reference area selection item 26, and person A indicated by the AF frame 3106 is selected by specific subject tracking AF. In that case, as shown in FIG. 32, the AF setting item when crop 1 is selected 3203 displays "Person A." Suppose the user selects Crop 2 in the adjustment reference area selection item 26, and person B indicated by the AF frame 3107 is selected by specific subject tracking AF. In that case, as shown in FIG. 32, the AF setting item when crop 2 is selected 3204 displays "Person B." Assume that the user selects crop 3 in the adjustment reference area selection item 26, and the subject indicated by the AF frame 3108 is selected by main subject tracking AF. In that case, as shown in Fig. 32, "Auto tracking (2100, 1250)" is displayed in the AF setting item 3205 when crop 3 is selected. Note that the AF frame is not displayed until a subject is selected.

[0107] In both main subject tracking AF and touch tracking AF, the coordinates of the AF target subject are acquired as at least part of the AF setting values, but considering that the subject may move while an area is not selected, it is preferable to acquire other information as the AF setting values. For example, it is preferable to acquire information such as the subject distance, color, and texture of the AF target subject as at least part of the AF setting values.

[0108] In the sixth embodiment, the AF setting values for the first area are stored when the state transitions from a state in which the first area is selected to a state in which the second area is selected. For example, when the adjustment reference area selection item 26 is changed from crop 1 to another area, the AF setting values for crop 1 are stored, and the AF setting values are reflected in the AF setting item 3203 when crop 1 is selected. This allows the latest AF setting values to be stored. However, this is not limiting, and for example, the setting values for the first area may be stored when the duration of the state in which the first area is selected reaches a threshold time (first time). When the first area is selected, the setting values for the first area may be stored in response to an instruction from the user.

[0109] Note that the display of the AF settings is merely an example, and other information included in the AF setting values may be displayed, for example.

[0110] A series of controls from when the user changes the settings to when the adjustments are applied can be realized by applying the process shown in the flowchart of Fig. 33. The flowchart of Fig. 33 will now be described.

[0111] In S3301, the AF setting storage determination unit 3001 monitors whether the adjustment reference area selection item 26 has been changed, and if there has been a change since the last time S3301 was executed, the process branches to S3302, and if there has been no change, the process branches to S3319. In S3302, the AF setting storage determination unit 3001 checks whether the storage conditions for the AF setting value for the adjustment reference area before the change are met. If the storage conditions are met, the process branches to S3303, and if they are not met, the process branches to S3319. The storage conditions are conditions under which the image quality of the output image is not bad (appropriate), and if the storage conditions are not met, that is, if it is determined that the image quality of the output image is bad, the process proceeds to S3319 without storing the AF setting value. For example, if the focus is In cases such as when the focus is significantly out of focus or when the exposure is significantly different from the appropriate level, it is determined that the storage conditions are not met, and the process proceeds to S3319 without storing the AF setting value. When the focus is significantly out of focus, for example, the degree of blur is equal to or greater than a threshold value. When the exposure is significantly different from the appropriate level, for example, the deviation of the exposure from the appropriate level is equal to or greater than a threshold value. In addition to these, the AF setting value may not be stored if the duration during which the adjustment reference area before the change is selected does not reach a threshold time (second time), or the AF setting value may not be stored during AF control (focus search). The second time may be the same as or different from the first time described above.

[0112] In S3303, the AF setting storage determination unit 3001 determines whether the adjustment reference area selection item 26 has been changed from the full screen to another area, and if it has been changed from the full screen to another area, the process proceeds to S3304; otherwise, the process branches to S3307. Similarly, in S3307, the controller device 2 determines whether the adjustment reference area selection item 26 has been changed from crop 1 to another area, and if it has been changed from crop 1 to another area, the process proceeds to S3308; otherwise, the process branches to S3311. Similarly, in S3311, the controller device 2 determines whether the adjustment reference area selection item 26 has been changed from crop 2 to another area, and if it has been changed from crop 2 to another area, the process proceeds to S3312; otherwise, the process branches to S3315. Similarly, in S3315, the controller device 2 determines whether the adjustment reference area selection item 26 has been changed from crop 3 to another area, and if it has been changed from crop 3 to another area, it branches to S3316, and if not, it branches to S3319.

[0113] In S3304, the AF setting storage determination unit 3001 acquires the AF setting value from the AF unit 1472 and notifies the controller device 2 of the AF setting value as the AF setting value of the AF setting item 3202 when full screen is selected via the camera communication unit 180. In S3305, the controller device 2 notifies the AF setting value of the AF setting item 3202 when full screen is selected to the AF setting management unit 1471 from the controller communication unit 220 via the camera communication unit 180. In S3306, the AF setting management unit 1471 saves the AF setting value of the AF setting item 3202 when full screen is selected in a storage area, and the process proceeds to S3319, which will be described later.

[0114] In S3308 to S3310, the same processing as in S3304 to S3306 is performed for the AF setting item 3203 when crop 1 is selected. In addition, in S3312 to S3314, the same processing as in S3304 to S3306 is performed for the AF setting item 3204 when crop 2 is selected. In addition, in S3316 to S3318, the same processing as in S3304 to S3306 is performed for the AF setting item 3205 when crop 3 is selected.

[0115] In S3319, the AF setting management unit 1471 determines whether the area selected in the adjustment reference area selection item 26 is the entire screen, and if so, proceeds to S3320, and if not, proceeds to S3321. Similarly, in S3321, the AF setting management unit 1471 determines whether the area selected in the adjustment reference area selection item 26 is crop 1, and if so, proceeds to S3322, and if not, proceeds to S3323. Similarly, in S3323, the AF setting management unit 1471 determines whether the area selected in the adjustment reference area selection item 26 is crop 2, and if so, proceeds to S3324, and if not, proceeds to S3325.

[0116] In S3320, the AF setting management unit 1471 notifies the AF unit 1472 of the AF setting values when full screen is selected that were saved in the storage area in S3306 (setting of AF setting values). Similarly, in S3322, the AF setting management unit 1471 notifies the AF unit 1472 of the AF setting values when crop 1 is selected that were saved in the storage area in S3310. Similarly, in S3324, the AF setting management unit 1471 notifies the AF unit 1472 of the AF setting values when crop 2 is selected that were saved in the storage area in S3314. Similarly, in S3325, the AF setting management unit 1471 notifies the AF unit 1472 of the AF setting values when crop 3 is selected that were saved in the storage area in S3318. Notify the setting value.

[0117] In S3326, the AF unit 1472 performs autofocus adjustment on the lens 110 as described above based on the notified AF setting value. Then, the process returns to S3301. In this way, each time the adjustment reference area is changed, autofocus adjustment using the AF setting value corresponding to that adjustment reference area is applied to the lens 110. Note that if the AF setting value is not stored in the storage area, autofocus adjustment (specific subject tracking AF, main subject tracking AF, touch tracking AF, etc.) is performed without using the AF setting value, and the AF setting value is acquired and stored for the next time.

[0118] In this embodiment, the setting values related to autofocus are stored, but the setting values related to exposure or the setting values related to white balance may also be stored. Two or more of the setting values related to autofocus, the setting values related to exposure, and the setting values related to white balance may also be stored.

[0119] Although the present invention has been described in detail above based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0120] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0121] The disclosure of this specification includes the following configurations, methods, programs, and media. (Configuration 1) An imaging sensor; a plurality of output interfaces capable of outputting a plurality of output images based on the original images captured by the imaging sensor to the outside, respectively; a setting means for setting a setting value for an area selected from a plurality of areas in the original image corresponding to the plurality of output images; an adjustment means for adjusting the entire original image using the setting values of the selected area; and The setting means stores the setting value of the first area when a state transitions from a state in which a first area is selected to a state in which a second area is selected, and sets the stored setting value of the first area when the first area is selected again. An imaging system characterized by: (Configuration 2) The setting means stores the setting value of the first area at a timing when a state in which the first area is selected transitions to a state in which the second area is selected. 2. The imaging system according to configuration 1, (Configuration 3) The setting means stores the setting value of the first area when the duration of the selected state of the first area reaches a first time. 3. The imaging system according to configuration 1 or 2. (Configuration 4) The setting means stores the setting value of the first area in response to an instruction from a user when the first area is selected. 4. The imaging system according to any one of configurations 1 to 3, wherein: (Configuration 5) The setting means does not store the setting value for the first area when it is determined that the image quality of the output video for the first area is poor. 5. The imaging system according to any one of configurations 1 to 4. (Configuration 6) The setting means does not store the setting value of the first area when the duration of the state in which the first area is selected does not reach a second time. 6. The imaging system according to any one of configurations 1 to 5, wherein: (Configuration 7) The setting means does not store the setting value of the first area while adjusting the entire original video using the setting value of the first area. 7. The imaging system according to any one of configurations 1 to 6, wherein: (Configuration 8) The setting values include a setting value related to autofocus. 8. The imaging system according to any one of configurations 1 to 7, wherein: (Configuration 9) The setting value for the autofocus is information for identifying a subject to be autofocused; information indicating the type of the target subject; information indicating a subject distance to the target subject; information indicating the size of the target area of the autofocus in the original video; information indicating a color of the target region; information indicative of a texture of the target region; and information indicative of a histogram of the region of interest; Includes at least one of the following: 9. The imaging system according to configuration 8, (Configuration 10) The setting values include at least one of a setting value related to exposure and a setting value related to white balance. 10. The imaging system according to any one of configurations 1 to 9, wherein: (method) An imaging sensor; a plurality of output interfaces capable of outputting a plurality of output images based on the original images captured by the imaging sensor to the outside, respectively; A control method for an imaging system having a setting step of setting a setting value for an area selected from a plurality of areas in the original video corresponding to the plurality of output videos, respectively; an adjustment step of adjusting the entire original video image using the setting values of the selected area, In the setting step, when a state in which a first area is selected transitions to a state in which a second area is selected, the setting value of the first area is stored, and when the first area is selected again, the stored setting value of the first area is set. A control method comprising: (program) A program for causing a computer to function as each means of the imaging system according to any one of configurations 1 to 10. (medium) A computer-readable storage medium storing a program for causing a computer to function as each means of the imaging system according to any one of configurations 1 to 10. [Explanation of symbols]

[0122] 1: Imaging device 120: Imaging section 140: Output section 1470: Adjustment section 1471: AF setting management unit 1472: AF unit 3001: AF setting storage determination unit

Claims

1. An imaging sensor; a plurality of output interfaces capable of outputting a plurality of output images based on the original images captured by the imaging sensor to the outside, respectively; a setting means for setting a setting value for an area selected from a plurality of areas in the original image corresponding to the plurality of output images; an adjustment means for adjusting the entire original image using the setting values of the selected area; and The setting means stores the setting value of the first area when a state transitions from a state in which a first area is selected to a state in which a second area is selected, and sets the stored setting value of the first area when the first area is selected again. An imaging system characterized by:

2. The setting means stores the setting value of the first area at a timing when the state transitions from the state in which the first area is selected to the state in which the second area is selected.

2. The imaging system according to claim 1, wherein:

3. The setting means stores the setting value of the first area when the duration of the selected state of the first area reaches a first time.

2. The imaging system according to claim 1, wherein:

4. The setting means stores the setting value of the first area in response to an instruction from a user when the first area is selected.

2. The imaging system according to claim 1, wherein:

5. The setting means does not store the setting value for the first area when it is determined that the image quality of the output video for the first area is poor.

2. The imaging system according to claim 1, wherein:

6. The setting means does not store the setting value of the first area when the duration of the state in which the first area is selected does not reach a second time.

2. The imaging system according to claim 1, wherein:

7. The setting means does not store the setting value of the first area while adjusting the entire original video using the setting value of the first area.

2. The imaging system according to claim 1, wherein:

8. The setting values include a setting value related to autofocus.

2. The imaging system according to claim 1, wherein:

9. The setting value for the autofocus is information for identifying a subject to be autofocused; information indicating the type of the target subject; information indicating a subject distance to the target subject; information indicating the size of the target area of the autofocus in the original video; information indicating a color of the target region; information indicative of a texture of the target region; and information indicative of a histogram of the region of interest; Includes at least one of the following:

9. The imaging system according to claim 8.

10. The setting values include at least one of a setting value related to exposure and a setting value related to white balance.

2. The imaging system according to claim 1, wherein:

11. An imaging sensor; a plurality of output interfaces capable of outputting a plurality of output images based on the original images captured by the imaging sensor to the outside, respectively; A control method for an imaging system having a setting step of setting a setting value for an area selected from a plurality of areas in the original video corresponding to the plurality of output videos, respectively; an adjustment step of adjusting the entire original video image using the setting values of the selected area, In the setting step, when a state in which a first area is selected transitions to a state in which a second area is selected, the setting value of the first area is stored, and when the first area is selected again, the stored setting value of the first area is set. A control method comprising:

12. A program for causing a computer to function as each of the means of the imaging system according to any one of claims 1 to 10.

13. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the imaging system according to any one of claims 1 to 10.

Images