Imaging apparatus, control method and program

The described imaging device configuration addresses the complexity of exposure value setting in multi-device imaging systems by allowing selection and adjustment of exposure parameters based on the position of a partial region, thereby enhancing imaging quality and reducing exposure variations.

JP2025083916APending Publication Date: 2025-06-02CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023197585
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-21
Publication Date
2025-06-02

Smart Images

  • Figure 2025083916000001_ABST
    Figure 2025083916000001_ABST
Patent Text Reader

Abstract

To make it less likely to get an exposure value not intended by a user on an imaging apparatus that is controlled using settings of other imaging apparatus.SOLUTION: An imaging apparatus comprises: a first imaging apparatus that acquires a first captured image; a second imaging apparatus that acquires a second captured image; and a third imaging apparatus that images a partial area, which is a partial area of the first captured image, a partial area of the second captured image, or a partial area of a composite image of the first imaged image and the second imaged image. The partial area is set. An imaging apparatus that is used for setting of exposure parameters for the third imaging apparatus is selected from the first imaging apparatus and the second imaging apparatus on the basis of the position of the partial area. The exposure parameters of the third imaging apparatus are set on the basis of the exposure parameters of the selected imaging apparatus.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method, and a program.

Background Art

[0002] In shooting using a plurality of imaging units, there has been a method of using an image captured by one imaging unit to control the shooting range of the other imaging unit. Patent Document 1 discloses a technique in which PTZ control performed at least partially based on a wide-angle image captured by a master camera is transmitted to a slave camera. Further, it is disclosed that the exposure is automatically adjusted by comparing the histogram of the image from the slave camera and the histogram of the image from the master camera.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when imaging devices other than the slave camera and the master camera are also used, if the technology of the above-mentioned patent document is applied, it is considered that the histogram comparison process becomes complicated.

[0005] An object of the present invention is to enable easy setting of an exposure value when there are a plurality of imaging devices.

Means for Solving the Problems

[0006] In order to achieve the object of the present invention, for example, an imaging device according to an embodiment includes the following configuration. That is, a first imaging device that acquires a first captured image, a second imaging device that acquires a second captured image, a partial region of a part of the first captured image, a partial region of the second captured image, or a partial region of a composite image obtained by combining the first captured image and the second captured image, a third imaging device that images the partial region, a first setting means that sets the partial region, a selection means that selects, from the first imaging device and the second imaging device, an imaging device to be used for setting the exposure parameter of the third imaging device based on the position of the partial region, and a second setting means that sets the exposure parameter of the third imaging device based on the exposure parameter of the selected imaging device.

Advantages of the Invention

[0007] In an imaging device controlled using settings of other imaging devices, it is possible to suppress the occurrence of an exposure value unintended by the user.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] [Embodiment 1] The information processing apparatus according to Embodiment 1 generates a composite image obtained by combining respective captured images by a plurality of imaging devices, and sets a partial region in the generated composite image. Next, the information processing apparatus selects an imaging device to be used for setting the exposure parameter of the imaging device based on the position of the partial region in the composite image, and sets the exposure parameter of the PTZ camera based on the exposure parameter of the selected imaging device.

[0011] FIG. 1 is a block diagram showing an example of the configuration of an imaging system including an information processing apparatus 1100 according to the present embodiment. The imaging system according to the present embodiment includes an imaging device 1000, an information processing apparatus 1100, and a network 1200. The imaging device 1000 and the information processing apparatus 1100 are connected to be communicable with each other via the network 1200. Thereby, the imaging device 1000 can distribute video data (image) to the information processing apparatus 1100 via the network 1200. The information processing apparatus 1100 transmits various commands to the imaging device 1000. The imaging device 1000 transmits responses to those commands to the information processing apparatus 1100.

[0012] The network 1200 is composed of, for example, a plurality of routers, switches, or cables that utilize a communication standard such as Ethernet (registered trademark). The communication standard, scale, and configuration of the network 1200 are not particularly limited as long as it can perform communication between the imaging device 1000 and the information processing device 1100. The network 1200 may be composed of, for example, the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), or a WAN (Wide Area Network). Note that the imaging device 1000 according to the present embodiment may, for example, support PoE (Power Over Ethernet (registered trademark)) and may be supplied with power via a LAN cable.

[0013] The imaging device 1000 is an imaging device including a plurality of imaging units. The imaging device 1000 according to the present embodiment includes fixed cameras 1010a and 1010b, a PTZ (Pan Tilt Zoom) camera 1020, and a camera system control unit 1030.

[0014] The fixed cameras 1010a and 1010b according to this embodiment are cameras with a fixed imaging range. The fixed camera 1010a includes an imaging optical system 1011a, an image sensor 1012a, and a camera control unit 1013a. The imaging optical system 1011a is an optical system that condenses the light incident from the subject onto the image sensor 1012a, and includes a diaphragm for adjusting the light amount, a focus lens, etc. for focus adjustment. The image sensor 1012a is, for example, a CCD sensor or a CMOS sensor, and converts the light received on the light receiving surface into an electrical signal and outputs it as image data to the camera control unit 1013a. The camera control unit 1013a controls the fixed camera 1010a, including the control of the exposure parameters of the fixed camera 1010a. The camera control unit 1013a according to this embodiment performs, as the control of the exposure parameters, for example, the setting of the diaphragm or the image sensor 1012a and the adjustment of the focus lens based on the result of analyzing the input signal from the image sensor 1012a. Further, the camera control unit 1013a performs various image processes on the imaging data input from the image sensor 1012a and outputs it to the camera system control unit 1030a. The processes performed by the imaging optical system 1011a, the image sensor 1012a, and the camera control unit 1013a can arbitrarily adopt the processes performed by a general imaging device as long as the imaging result can be output as image data.

[0015] The fixed camera 1010b includes an imaging optical system 1011b, an image sensor 1012b, and a camera control unit 1013b that have the same functions as the imaging optical system, the image sensor, and the camera control unit included in the fixed camera 1010a. Hereinafter, the fixed camera 1010a, the fixed camera 1010b, and the PTZ camera 1020 described later will be described as imaging devices of the same type (for example, having the same model number), but these cameras may be of different types of imaging devices. Also, in FIG. 1, two fixed cameras 1010a and 1010b are illustrated as fixed cameras, but the number of fixed cameras is not particularly limited as long as it is 2 or more. In the present embodiment, the fixed camera will be described as a camera whose posture is fixed, but the postures of these cameras may be controllable as long as imaging processing is similarly possible. Also, hereinafter, there may be cases where the fixed camera 1010a and the fixed camera 1010b are not distinguished and simply expressed as "fixed camera".

[0016] Note that in the present embodiment, each fixed camera will be described as an imaging device with an equal angle of view, but the imaging settings of each fixed camera may be different, and different types of imaging devices may be adopted as the fixed camera. For example, the fixed camera 1010a may be an imaging device capable of imaging a wider-angle imaging range than the fixed camera 1010b.

[0017] The PTZ camera 1020 is an imaging device whose imaging range can be changed. It includes an imaging optical system 1021, an image sensor 1022, and a camera control unit 1023 that have the same functions as the imaging optical system, the image sensor, and the camera control unit included in the fixed camera 1010a. The PTZ camera 1020 further includes a zoom motor 1024, a pan motor 1025, a tilt motor 1026, and a PTZ control unit 1027. The zoom motor 1024 controls the angle of view of the PTZ camera 1020. The pan motor 1025 and the tilt motor 1026 drive the PTZ camera 1020 in the pan direction and the tilt direction. The PTZ control unit 1027 controls the zoom motor 1024, the pan motor 1025, and the tilt motor 1026.

[0018] The camera system control unit 1030 acquires image data from the fixed cameras 1010a and 1010b, and the PTZ camera 1020, and transmits the acquired image data to the information processing apparatus 1100 via the network 1200. Further, the camera system control unit 1030 gives control commands to the fixed cameras 1010a and 1010b, and the PTZ camera 1020 in response to commands from the information processing apparatus 1100. Further, the camera system control unit 1030 acquires responses to the control commands and control information from the fixed cameras 1010a and 1010b, and the PTZ camera 1020.

[0019] In the present embodiment, the fixed camera 1010a, the fixed camera 1010b, and the PTZ camera 1020 are all described as imaging units included in the same imaging apparatus 1000, but some or all of these may be implemented as separate imaging apparatuses.

[0020] The information processing apparatus 1100 according to the present embodiment includes a display unit 1101, an input unit 1102, and a system control unit 1103. The display unit 1101 is, for example, a liquid crystal display, and displays various processing results such as a display image described later. The display unit 1101 can display, for example, image data acquired from the system control unit 1103, or a GUI (Graphical User Interface) for controlling the imaging apparatus 1000. Note that the display unit 1101 may be an apparatus integrated with the information processing apparatus 1100, or may be an external apparatus connected to the information processing apparatus 1100.

[0021] The input unit 1102 is, for example, a pointing device such as a keyboard and a mouse, and acquires user input. A user of the information processing apparatus 1100 can input to the GUI via the input unit 1102. The input unit 1102 may be integrated with the information processing apparatus 1100, or may be an external apparatus connected to the information processing apparatus 1100. Further, for example, the display unit 1101 may be a touch panel or the like, and may also have the function of the input unit 1102.

[0022] The system control unit 1103 transmits various commands according to the user's operations on the GUI by the input unit 1102 to the imaging device 1000 via the network 1200, and receives various data distributed from the imaging device 1000 via the network 1200. The commands according to this embodiment include a request command for video data, or a pan, tilt, or zoom setting command for the PTZ camera 1020, etc.

[0023] The system control unit 1103 generates a composite image by combining a first captured image by a first imaging device and a second captured image by a second imaging device. Also, the system control unit 1103 performs display control such as causing the generated composite image and the GUI to be displayed on the display unit 1101. The system control unit 1103 according to this embodiment generates the captured image by the fixed camera 1010a as the first captured image and the captured image by the fixed camera 1010b as the second captured image. Also, the system control unit 1103 according to this embodiment may further generate an image of the PTZ camera 1020.

[0024] Hereinafter, with reference to FIGS. 2 to 4, the processing by the system control unit 1103 according to this embodiment will be described. FIG. 2 is an example of a display image generated by the system control unit 1103 according to this embodiment. On the display unit 1101, a captured image 201 by the fixed camera 1010a, a captured image 202 by the fixed camera 1010b, and a captured image 203 by the PTZ camera 1020 are displayed.

[0025] The camera system control unit 1030 sets a partial region in the first captured image, the second captured image, or the composite image, and selects, based on the position (setting) of the partial region in the first captured image, the second captured image, or the composite image, an imaging device to be used for setting the exposure parameters of the third imaging device (here, the PTZ camera 1020) from the first imaging device and the second imaging device. In the example of FIG. 2, a designated region 204 is set as the partial region, and the designated region 204 is located within the captured image 202. The camera system control unit 1030 according to the present embodiment can select, as the imaging device to be used for setting the exposure parameters of the PTZ camera 1020, the imaging device that has captured the captured image in which the partial region is located. Hereinafter, when simply referred to as the "selected imaging device", it shall refer to the imaging device selected for setting the exposure parameters of such a PTZ camera 1020.

[0026] Here, it is assumed that the designated region 204 is a region set as the imaging range of the PTZ camera 1020. For this purpose, the camera system control unit 1030 can acquire imaging settings indicating the posture and zoom amount of the PTZ camera 1020, and set the designated region 204 (for example, in the initial setting) based on such imaging settings. The setting of the position of the designated region 204 may be performed, for example, based on the positional relationship between the PTZ camera and each imaging device, or may be performed based on the correspondence between the coordinates of the point designated in the first captured image or the captured image and the coordinates based on the PTZ camera 1020, and any known method can be used.

[0027] In this way, the camera system control unit 1030 can set a partial region on the first captured image or the second captured image, and set the imaging range of the PTZ camera 1020 to capture such a partial region.

[0028] Further, the designated area 204 may be set based on user input and may also be changed based on user input. The input by which the user sets the designated area 204 may be performed, for example, by a drag input via a mouse cursor, by an input for setting the coordinates and size of the designated area 204, or by an input for setting a reference point of the designated area 204. For example, a rectangular area with a predetermined size centered on the point where the user makes a touch input on the touch panel that displays the display screen may be set as the designated area 204. Also, the designated area 204 may be set so as not to straddle a plurality of captured images. Here, the designated area is described as being a rectangular area, but it may be, for example, a circular area or an area in which the user can freely set the contour, and its shape is not particularly limited.

[0029] An explanation will be given on how to determine whether or not the designated area 204 is located on which captured image. The system control unit 1103 may determine the captured image including a predetermined position (for example, the center of gravity) of the designated area as the captured image on which the designated area 204 is located. Also, for example, the camera system control unit 1030 may determine all the captured images on which the designated area 204 is superimposed as the captured images on which the designated area 204 is located.

[0030] The camera system control unit 1030 sets the exposure parameters of the PTZ camera 1020 based on the exposure parameters of the selected imaging device. For example, the camera system control unit 1030 may calculate the exposure parameters of the PTZ camera 1020 from the exposure parameters of the selected imaging device, or the exposure parameters of the PTZ camera 1020 may be set to the same values as the exposure parameters of the selected imaging device. Here, the explanation is given using the aperture value Av, shutter speed Tv, and gain Sv, and the exposure value Ev as the exposure parameters, but other parameters related to the brightness of the captured image may be included in the exposure parameters.

[0031] For example, the camera system control unit 1030 may store a table in which other exposure parameters (here, Av, Tv, and Sv) corresponding to the exposure value Ev in the PTZ camera 1020 are recorded in advance. In this case, the camera system control unit 1030 may obtain the exposure parameters corresponding to the Ev of the selected imaging device by referring to the table, and set them as the exposure parameters of the PTZ camera 1020. FIG. 4 is a diagram showing an example of the values of the respective exposure parameters corresponding to such Ev. Also, when the configuration of the sensor or lens is different between the selected imaging device and the PTZ camera 1020, the camera system control unit 1030 may calculate the exposure parameters after correcting the sensitivity difference of such sensors and the like.

[0032] Further, the camera system control unit 1030 can calculate the control amounts of the pan, tilt, and zoom drives of the PTZ camera 1020 so as to image the designated area 204 set in this way. Next, the camera system control unit 1030 can change the imaging range of the PTZ camera 1020 by transmitting a control command for performing such control to the drive unit.

[0033] FIG. 3 is a flowchart showing an example of the setting process of the exposure parameters of the PTZ camera 1020 based on the designated area 204 performed by the imaging device 1000. The process shown in FIG. 3 starts, for example, at the timing when the PTZ camera 1020 is activated. Also, this flowchart is realized by the camera system control unit 1030 executing a program expanded in the RAM.

[0034] In S301, the camera system control unit 1030 acquires imaging images from each of the fixed camera 1010a, the fixed camera 1010b, and the PTZ camera 1020.

[0035] In S302, the camera system control unit 1030 sets a partial area (designated area 204) in the display image. Here, as described above, the camera system control unit 1030 may set the partial area based on the imaging settings of the PTZ camera 1020, or may set the partial area based on user input.

[0036] In S303, the camera system control unit 1030 selects, from the fixed camera 1010a and the fixed camera 1010b, the imaging device to be used for setting the exposure parameters of the PTZ camera 1020 based on the setting (position) of the partial area in the first imaging image or the second imaging image. Also, when the partial area has been changed by user input, a PTZ drive instruction may be given to the PTZ camera 1020 to image such a partial area.

[0037] In S304, the camera system control unit 1030 acquires the exposure parameters of the imaging device selected in S303. In S305, the camera system control unit 1030 sets the exposure parameters of the PTZ camera 1020 based on the exposure parameters acquired in S304. In S306, the camera system control unit 1030 controls the PTZ camera 1020 so as to perform an exposure setting using the exposure parameters set in S305, and ends the process.

[0038] According to such processing, it is possible to select an imaging device based on a partial area on the first imaging image or the second imaging image, and to set the exposure parameters of the PTZ camera based on the exposure parameters of the selected imaging device. Therefore, it is possible to reduce the exposure difference between the selected imaging device and the PTZ camera, and to avoid an unnatural exposure. Also, since it is possible to determine the exposure parameters before changing the imaging range of the PTZ camera 1020, the time required for the exposure to converge due to the change in the imaging range of the PTZ camera 1020 is also reduced.

[0039] In addition, the system control unit 1103 may accept an input for exposure correction of the PTZ camera 1020 by the user. For example, when Ev is corrected based on user input, the system control unit 1103 can set the exposure parameters of the PTZ camera 1020 by referring to the above-described table using such corrected Ev.

[0040] The information processing apparatus 1100 according to the present embodiment has been described as setting the exposure parameters of the PTZ camera 1020 based on the exposure parameters of the fixed camera. However, this process does not always need to be performed. Predetermined conditions (execution conditions) may be provided, and control may be performed so that when the execution conditions are satisfied, the exposure parameters of the PTZ camera 1020 are set without depending on the exposure parameters of the fixed camera. Hereinafter, examples of such execution conditions will be described.

[0041] During the PTZ drive, even if exposure control is performed based on the result of analyzing the input signal from the imaging device 1022, the exposure gradually varies. Therefore, even if the exposure parameters of the PTZ camera 1020 are set based on the position of the partial region at a certain point in time, an unintended exposure change may occur thereafter. However, if the user is monitoring in such a case, it is considered that correction by user input is possible. When the pan, tilt, or zoom drive speed is low, it can be considered that there is a high possibility that the user is viewing the image during those drives. From such a viewpoint, for example, it can be assumed that the execution conditions are satisfied when the change speed of the imaging range of the PTZ camera (here, the pan, tilt, or zoom drive speed) is equal to or lower than a predetermined speed.

[0042] Here, the "driving speed of pan, tilt, or zoom" can be evaluated based on, for example, the driving speed of a motor that performs PTZ control. For example, when the weighted sum of the driving angle per unit time of the pan motor 1025 or the tilt motor 1026 and the driving angle per unit time of the zoom motor 1024 is equal to or less than a predetermined threshold value, it may be determined that the driving speed of pan, tilt, or zoom is equal to or less than a predetermined speed. The threshold value and weights used here can be arbitrarily set according to the conditions desired by the user.

[0043] In addition, when the imaging range of the PTZ camera 1020 is extremely bright or dark compared to the imaging range of the fixed camera, if the exposure parameters of the PTZ camera 1020 are always set based on the exposure parameters of the fixed camera, white blooming or black crush may occur. From such a perspective, when the designated area 204 is set, if the variance of the histogram within the designated area 204 on the display image is equal to or less than a predetermined threshold value, and the absolute value of the difference between the average luminance within the designated area 204 and the average luminance of the entire display image is equal to or greater than a predetermined threshold value, it can be considered that the execution conditions are satisfied.

[0044] In addition, as the exposure parameter of the fixed camera, a value of a gain for adjusting white balance may be further used. In that case, the system control unit 1103 can set the value of the gain for adjusting the white balance of the PTZ camera 1020 in the same manner as other exposure parameters based on the value of the gain for adjusting the white balance of the fixed camera.

[0045] [Embodiment 2] As shown in FIG. 2, the information processing apparatus 1100 according to Embodiment 1 displayed the first captured image and the second captured image respectively. The imaging apparatus 1000 according to the present embodiment generates a composite image obtained by combining the captured images by each fixed camera, and can perform the same processing as in Embodiment 1 using such a composite image. The imaging apparatus 1000 according to the present embodiment has the same configuration as the imaging apparatus shown in FIG. 1 of Embodiment 1 and can execute the same processing, so overlapping explanations are omitted. The imaging apparatus 1000 can determine whether the display image is an image in which the captured images of the fixed cameras are arranged independently or a composite image obtained by combining the captured images, based on, for example, user input.

[0046] Hereinafter, with reference to FIGS. 5 and 6, the processing by the camera system control unit 1030 according to the present embodiment will be described. FIG. 5 is an example of a composite image generated by the camera system control unit 1030 according to the present embodiment. The images displayed on the display unit 1101 are a panoramic image 501 obtained by combining the captured image by the fixed camera 1010a and the captured image by the fixed camera 1010b, and a captured image 502 by the PTZ camera 1020.

[0047] The camera system control unit 1030 sets a partial region in the composite image, and selects an imaging device to be used for setting the exposure parameter of the PTZ camera 1020 from the first imaging device and the second imaging device based on the position of the partial region in the composite image. In the example of FIG. 5, a designated region 503 is set as the partial region, and the designated region 503 is located above both the captured image by the fixed camera 1010a and the captured image by the fixed camera 1010b in the panoramic image 501 (composite image).

[0048] When a partial area is located on a plurality of captured images constituting the panoramic image 501, the camera system control unit 1030 according to the present embodiment can select these captured images as imaging devices to be used for setting the exposure parameters of the PTZ camera 1020. In that case, the camera system control unit 1030 sets the exposure parameters of the PTZ camera 1020 based on the exposure parameters of the selected imaging devices. For example, the camera system control unit 1030 sets weights based on the positions of each captured image in the panoramic image 501 and the position of the designated area 503, and sets the exposure parameters of the PTZ camera 1020 by weighted-averaging the exposure parameters of the selected imaging devices.

[0049] Hereinafter, such weighted-average processing will be described with reference to FIG. 6. In FIG. 6, the center of gravity 601 of the captured image of the fixed camera 1010a, the center of gravity 602 of the captured image of the fixed camera 1010b, and the center of gravity 603 of the designated area 503 in the panoramic image 501 are respectively illustrated. Here, the system control unit 1103 may set the exposure parameters of the PTZ camera 1020 by weighted-averaging the exposure parameters of the fixed cameras based on the weights based on the positions of these centers of gravity. For example, the system control unit 1103 sets the exposure parameter Ev a of the fixed camera 1010a and the exposure parameter Ev b of the fixed camera 1010b, and sets weights w a and w b as follows to calculate the exposure parameter Ev ref of the PTZ camera 1020. Here, it is assumed that w a + w b is 1. Ev ref = w a × Ev a + w b × Ev b

[0050] Here, the weights w a and w bAn explanation will be given. For example, when the left end of the panoramic image is set as the origin (0,0), the system control unit 1103 sets the x coordinate of the center of gravity 601 as x1, the x coordinate of the center of gravity 602 as x2, and the x coordinate of the center of gravity 603 as x3, and w is as follows a and w b may be calculated. When x3 < x1, w a = 1, w b = 0 When x1 ≤ x3 < x2, w a = d2 / (d1 + d2), w b = d1 / (d1 + d2) When x2 ≤ x3, w a = 0, w b = 1

[0051] Here, d1 represents the distance between x3 and x1, and d2 represents the distance between x1 and x3. When either wa or wb becomes 0, the exposure parameter of the PTZ camera 1020 is calculated based on the exposure parameter of one fixed camera in the same manner as in Embodiment 1.

[0052] Note that such weights w a and w b are not necessarily calculated based on the x coordinates of the respective centers of gravity. For example, when the distance between the center of gravity 601 and the center of gravity 602 is d3, and the distance between the center of gravity 602 and the center of gravity 603 is d4, instead of the case where x1 ≤ x3 < x2, the respective weights may be calculated as follows w a = d4 / (d3 + d4), w b = d3 / (d3 + d4)

[0053] Here, the description has been given assuming that there are two fixed cameras, but the number of fixed cameras is not particularly limited. For example, when there are four fixed cameras and two panoramic images synthesized from the images of two fixed cameras each are displayed as display images, a partial region is set for one of those panoramic images, and based on the exposure parameters of the imaging device that captured the imaging images constituting the panoramic image for which the partial region is set, the exposure parameters of the PTZ camera 1020 can be set. Also, for example, when one panoramic image synthesized from all the imaging images of four fixed cameras is displayed as a display image, the exposure parameters of the PTZ camera 1020 can be set based on the exposure parameters of all those imaging devices. Thus, the system control unit 1103 can change the number of imaging devices to be selected for calculating the exposure parameters of the PTZ camera 1020 according to the number of imaging images synthesized in the composite image.

[0054] The disclosure of this specification includes the following imaging device, control method, and program. (Item 1) A first imaging device that acquires a first imaging image, a second imaging device that acquires a second imaging image, and a third imaging device that images a partial region that is a partial region of the first imaging image, a partial region of the second imaging image, or a partial region of a composite image obtained by synthesizing the first imaging image and the second imaging image. First setting means for setting the partial region. Selection means for selecting, from the first imaging device and the second imaging device, an imaging device to be used for setting the exposure parameters of the third imaging device based on the position of the partial region. Second setting means for setting the exposure parameters of the third imaging device based on the exposure parameters of the selected imaging device. An imaging device, characterized by comprising: (Item 2) The third imaging device further includes acquisition means for acquiring exposure parameters corresponding to the exposure value Ev. The second setting means sets, as the exposure parameter of the third imaging device, the exposure parameter corresponding to the exposure value Ev of the selected imaging device acquired by the acquisition means, and the imaging device according to item 1 is characterized in that. (Item 3) The imaging device according to item 1 or 2 further includes correction means for correcting the exposure parameter of the third imaging device. (Item 4) The imaging device according to item 3, wherein the correction means corrects the exposure parameter of the third imaging device based on a user input. (Item 5) The imaging device according to any one of items 1 to 3 further includes control means for performing control so that when an execution condition is satisfied, the second setting means sets the exposure parameter of the third imaging device based on the image signal of the third imaging device. (Item 6) The third imaging device is an imaging device capable of changing an imaging range, The imaging device according to item 5, wherein the execution condition is satisfied when a change speed of the imaging range of the third imaging device is equal to or lower than a predetermined speed. (Item 7) The imaging device according to item 6, wherein the change speed of the imaging range of the third imaging device is evaluated based on a driving speed of a pan motor, a tilt motor, or a zoom motor of the third imaging device. (Item 8) The imaging device according to item 5, wherein the execution condition is satisfied when a histogram in the partial region in the composite image is equal to or lower than a first threshold value and an absolute value of a difference between an average luminance in the partial region in the composite image and an overall average luminance of the composite image is equal to or higher than a second threshold value. (Item 9) The second setting means sets the exposure parameter of the third imaging device by weighted averaging the exposure parameter of the first imaging device and the exposure parameter of the second imaging device using weights determined based on the position of the first captured image, the position of the second captured image, and the position of the partial region in the composite image. The imaging device according to item 1, characterized in that. (Item 10) In the composite image, the position of the first captured image, the position of the second captured image, and the position of the partial region are the center of gravity of the first captured image, the center of gravity of the second captured image, and the center of gravity of the partial region in the composite image, respectively. The imaging device according to item 9, characterized in that. (Item 11) The selection means changes the number of imaging devices used for setting the exposure parameter of the third imaging device according to the number of captured images. The imaging device according to any one of items 1 to 10, characterized in that. (Item 12) The third imaging device is an imaging device capable of changing the imaging range, The imaging device according to any one of items 1 to 11, further comprising a changing means for changing the imaging range of the third imaging device based on the partial region. (Item 13) A control method for an imaging device including a first imaging device that acquires a first captured image, a second imaging device that acquires a second captured image, and a third imaging device that images a partial region that is a partial region of the first captured image, a partial region of the second captured image, or a partial region of a composite image obtained by combining the first captured image and the second captured image. The method includes: A step of setting the partial region; A step of selecting, from the first imaging device and the second imaging device, an imaging device to be used for setting the exposure parameter of the third imaging device based on the position of the partial region; A step of setting the exposure parameter of the third imaging device based on the exposure parameter of the selected imaging device; A control method for an imaging device, characterized by comprising the above steps. (Item 14) A program for causing a computer to function as each means of the imaging device described in any one of Items 1 to 12.

[0055] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and causing one or more processors in a computer of the system or device to read and execute the program. Further, it can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0056] The invention is not limited to the above-described embodiments, and various changes and modifications are possible without departing from the spirit and scope of the invention. Therefore, the claims are attached to disclose the scope of the invention.

Explanation of reference numerals

[0057] 1000: Imaging device, 1100: Information processing device

Claims

1. A first imaging device that acquires a first captured image, a second imaging device that acquires a second captured image, and a third imaging device that images a partial region that is a partial region of the first captured image, a partial region of the second captured image, or a partial region of a composite image obtained by combining the first captured image and the second captured image, a first setting means for setting the partial region, a selection means for selecting, from the first imaging device and the second imaging device, an imaging device to be used for setting an exposure parameter of the third imaging device based on the position of the partial region, a second setting means for setting the exposure parameter of the third imaging device based on the exposure parameter of the selected imaging device, An imaging device, characterized by comprising:

2. The third imaging device further includes an acquisition means for acquiring an exposure parameter corresponding to an exposure value Ev, The second setting means sets, as the exposure parameter of the third imaging device, the exposure parameter corresponding to the exposure value Ev of the selected imaging device acquired by the acquisition means. The imaging device according to claim 1.

3. The imaging device according to claim 1, further comprising a correction means for correcting the exposure parameter of the third imaging device.

4. The correction means corrects the exposure parameter of the third imaging device based on a user input. The imaging device according to claim 3.

5. The imaging device according to claim 1, further comprising a control means for performing control so that when an execution condition is satisfied, the second setting means sets the exposure parameter of the third imaging device based on an image signal of the third imaging device.

6. The third imaging device is an imaging device capable of changing an imaging range, The execution condition is a condition satisfied when a change speed of the imaging range of the third imaging device is equal to or lower than a predetermined speed. The imaging device according to claim 5.

7. The change speed of the imaging range of the third imaging device is evaluated based on a driving speed of a pan motor, a tilt motor, or a zoom motor of the third imaging device. The imaging device according to claim 6.

8. The imaging apparatus according to claim 5, wherein the execution condition is satisfied when the histogram in the partial region in the composite image is equal to or less than a first threshold value, and the absolute value of the difference between the average luminance in the partial region in the composite image and the average luminance of the entire composite image is equal to or greater than a second threshold value.

9. The imaging apparatus according to claim 1, wherein the second setting means sets the exposure parameter of the third imaging apparatus by weighted averaging the exposure parameter of the first imaging apparatus and the exposure parameter of the second imaging apparatus using weights determined based on the position of the first captured image, the position of the second captured image, and the position of the partial region in the composite image.

10. The imaging apparatus according to claim 9, wherein the position of the first captured image, the position of the second captured image, and the position of the partial region in the composite image are the center of gravity of the first captured image, the center of gravity of the second captured image, and the center of gravity of the partial region in the composite image, respectively.

11. The imaging apparatus according to claim 1, wherein the selection means changes the number of imaging apparatuses selected for setting the exposure parameter of the third imaging apparatus according to the number of captured images.

12. The third imaging apparatus is an imaging apparatus capable of changing the imaging range, The imaging apparatus according to claim 1, further comprising a changing means for changing the imaging range of the third imaging apparatus based on the partial region.

13. A control method for an imaging apparatus, comprising: a first imaging apparatus that acquires a first captured image; a second imaging apparatus that acquires a second captured image; and a third imaging apparatus that images a partial region, which is a partial region of the first captured image, a partial region of the second captured image, or a partial region of a composite image obtained by combining the first captured image and the second captured image, the method comprising: a step of setting the partial region; a step of selecting, from the first imaging apparatus and the second imaging apparatus, an imaging apparatus to be used for setting the exposure parameter of the third imaging apparatus based on the position of the partial region; a step of setting the exposure parameter of the third imaging apparatus based on the exposure parameter of the selected imaging apparatus; The control method for an imaging apparatus, characterized by comprising the above steps.

14. A program for causing a computer to function as each means of the imaging apparatus according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Automatic expansion of the zoom function of wide-angle video cameras

    JP2008507229A