Control device, control method and program for control device

Abstract

The object is to improve the operability of moving an imaging unit selected on a graphical user interface from among a plurality of imaging units. [Solution] The control device includes a display control means for controlling the display unit to display a graphical user interface for selecting one of a plurality of imaging units as the object to be moved, and an instruction means for instructing the imaging device to move an imaging unit of the plurality of imaging units that is not the object to be moved so as to expand the range of movement of the imaging unit of the plurality of imaging units that is the object to be moved selected on the graphical user interface.

Description

[Technical Field]

[0001] The present disclosure relates to a control device, a control method for a control device, and a program. [Background technology]

[0002] To enable a single camera to capture images in multiple directions, there are cameras (hereafter referred to as multi-lens cameras) that are configured with multiple imaging units. Among multi-lens cameras, there are imaging devices that have a drive mechanism that enables each imaging unit to be independently driven on a common drive axis, such as on the same circumference. In these imaging devices, the user can independently control the shooting position of each imaging unit from a PC (Personal Computer) or the like connected via a network. Therefore, each time the user changes the shooting position of an imaging unit, they must select the imaging unit they want to operate.

[0003] Patent Document 1 discloses a technique for disabling (fixing) the operation of a driving unit in a multi-lens camera that the user does not want to operate. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-136537 Summary of the Invention [Problem to be solved by the invention]

[0005] However, although the technology disclosed in Patent Document 1 can prevent erroneous operation by fixing the drive unit, the user must release the lock every time he or she wants to move the drive unit.

[0006] Furthermore, even if all the drive units are not locked, it is necessary to select the drive unit to be operated separately from the disable setting, and only the selected drive units can be moved. Therefore, when a user operates the selected drive unit, the range in which it can be driven is limited based on the arrangement of other adjacent drive units arranged on the same drive axis. In order to expand the drive range, it is necessary to operate other drive units, which poses a problem of cumbersome operation.

[0007] An object of the present disclosure is to improve the operability of moving an imaging unit selected on a graphical user interface from among a plurality of imaging units. [Means for solving the problem]

[0008] The control device includes a display control means for controlling the display unit to display a graphical user interface for selecting one of the plurality of imaging units as a target for movement, and an instruction means for instructing the imaging device to move one of the plurality of imaging units that is not a target for movement so as to widen the range of movement of the imaging unit selected on the graphical user interface as a target for movement from among the plurality of imaging units. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to improve the operability of moving an imaging unit selected on a graphical user interface from among a plurality of imaging units. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. [Figure 2] FIG. 1 is a diagram illustrating an imaging device. [Figure 3] FIG. 2 is a side view of the imaging device. [Figure 4] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. [Figure 5] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. [Figure 6] 10 is a flowchart for detecting an object. [Figure 7] FIG. 10 is a diagram showing a display example in a browsing mode. [Figure 8] FIG. 10 is a diagram illustrating an example of a GUI for transitioning to a priority drive mode. [Figure 9] FIG. 10 is a diagram showing a display example of a priority drive mode. [Figure 10] FIG. 10 is a diagram illustrating an example of a slider bar. [Figure 11] FIG. 10 is a diagram illustrating an example in which cameras other than the object detection camera are retracted. [Figure 12] FIG. 10 is a diagram illustrating an example in which cameras other than the object detection camera are retracted. [Figure 13] FIG. 10 is a diagram illustrating an example of control of an imaging unit other than an object detection camera. [Figure 14] 10A and 10B are diagrams illustrating an example of a display for switching the selection of an imaging unit. [Figure 15] FIG. 10 is a diagram showing an example of a display after switching the selection of an imaging unit. [Figure 16] 10 is a flowchart for detecting an object. [Figure 17] FIG. 10 is a diagram illustrating an example of a GUI for a migration method. [Figure 18] 10 is a flowchart for detecting an object. DETAILED DESCRIPTION OF THE INVENTION

[0011] Preferred embodiments will be described in detail below with reference to the drawings. Note that the following embodiments do not limit the scope of the claims. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential, and multiple features may be combined arbitrarily. Furthermore, in the drawings, identical or similar components are designated by reference numerals, and redundant explanations will be omitted.

[0012] (First embodiment) <Imaging system> The configuration of an imaging system 190 according to the first embodiment will be described below with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an imaging system 190 according to the first embodiment. The imaging system 190 includes an imaging device 100 and a client device 200.

[0013] The imaging device 100 has four imaging units 110, 120, 130, and 140, independent driving units 113, 123, 133, and 143 for each imaging unit, an image processing unit 151, a control unit 152, a communication unit 153, and a recording unit 154.

[0014] Specifically, the imaging device 100 has a first imaging section 110, a second imaging section 120, a third imaging section 130, and a fourth imaging section 140. The imaging device 100 also has a first driving section 113, a second driving section 123, a third driving section 133, and a fourth driving section 143.

[0015] In the imaging system 190, the imaging device 100 is connected to a client device 200 via a network 170, and is capable of transmitting image data captured by the imaging device 100 and receiving control signals for the imaging device 100.

[0016] <Image capture unit> The first imaging section 110 has an imaging optical system 111 and a solid-state imaging element 112. The second imaging section 120 has an imaging optical system 121 and a solid-state imaging element 122. The third imaging section 130 has an imaging optical system 131 and a solid-state imaging element 132. The fourth imaging section 140 has an imaging optical system 141 and a solid-state imaging element 142.

[0017] Light transmitted through the imaging optical systems 111, 121, 131, and 141 forms images on the solid-state imaging elements 112, 122, 132, and 142, respectively, and is converted into electrical signals, which are then output as image data through processing in the image processing unit 151. The driving of the solid-state imaging elements 112, 122, 132, and 142 and the signal readout are controlled by the control unit 152.

[0018] The first driver 113 has a first pan driver 114 , a first zoom driver 115 , a first tilt driver 116 , a first rotation driver 117 , and a first focus driver 118 .

[0019] The second driver 123 has a second pan driver 124 , a second zoom driver 125 , a second tilt driver 126 , a second rotation driver 127 , and a second focus driver 128 .

[0020] The third driver 133 has a third pan driver 134 , a third zoom driver 135 , a third tilt driver 136 , a third rotation driver 137 , and a third focus driver 138 .

[0021] The fourth driver 143 has a fourth pan driver 144 , a fourth zoom driver 145 , a fourth tilt driver 146 , a fourth rotation driver 147 , and a fourth focus driver 148 .

[0022] The imaging units 110, 120, 130, and 140 each have a zoom lens that can drive the imaging optical systems 111, 121, 131, and 141 in the optical axis direction. The control unit 152 controls the first zoom driving unit 115, the second zoom driving unit 125, the third zoom driving unit 135, and the fourth zoom driving unit 145, thereby making it possible to control the shooting range of the imaging units 110, 120, 130, and 140.

[0023] The imaging units 110, 120, 130, and 140 each have a focus lens that can be driven in the optical axis direction by the imaging optical systems 111, 121, 131, and 141. The control unit 152 controls the first focus drive unit 118, the second focus drive unit 128, the third focus drive unit 138, and the fourth focus drive unit 148, thereby enabling the focus of the imaging units 110, 120, 130, and 140 to be controlled.

[0024] Furthermore, the imaging units 110, 120, 130, and 140 each have a rotation driver 117, 127, 137, and 147 that can rotate the solid-state imaging elements 112, 122, 132, and 142 about a rotation axis in the optical axis direction. The control unit 152 controls the first rotation driver 117, the second rotation driver 127, the third rotation driver 137, and the fourth rotation driver 147, thereby controlling the imaging angles of the imaging units 110, 120, 130, and 140.

[0025] <Pan / tilt drive unit> The driving units 113, 123, 133, and 143 have pan driving units 114, 124, 134, and 144 and tilt driving units 116, 126, 136, and 146. The pan driving units 114, 124, 134, and 144 and tilt driving units 116, 126, 136, and 146 are driving units for changing the imaging area.

[0026] The first drive unit 113, the second drive unit 123, the third drive unit 133, and the fourth drive unit 143 each have a first pan drive unit 114, a second pan drive unit 124, a third pan drive unit 134, and a fourth pan drive unit 144. Similarly, the first drive unit 113, the second drive unit 123, the third drive unit 133, and the fourth drive unit 143 each have a first tilt drive unit 116, a second tilt drive unit 126, a third tilt drive unit 136, and a fourth tilt drive unit 146, respectively.

[0027] The first pan driving unit 114, the second pan driving unit 124, the third pan driving unit 134, and the fourth pan driving unit 144 have the same rotation axis, and the imaging units are arranged on the same circumference and rotate on the same circumference. This will be specifically described with reference to FIG. 2.

[0028] 2 is a diagram showing the imaging device 100 according to the first embodiment. Hereinafter, to simplify the explanation, the first imaging unit 110 will be used as a representative for the overlapping contents of the imaging units (first imaging unit 110, second imaging unit 120, third imaging unit 130, and fourth imaging unit 140), and explanations of the other imaging units will be omitted. Similarly, the driving units will be described using driving unit 113 as a representative, and explanations of the other driving units will be omitted. Differences between the imaging units will be clearly stated.

[0029] 2 is a structural diagram of the imaging device 100 as seen from above (the +Z axis side). Each pan driving unit 114, 124, 134, and 144 includes a motor and a gear, and drives each imaging unit 110, 120, 130, and 140 by controlling the power that drives the motor.

[0030] The pan driving units 114, 124, 134, and 144 are configured to be rotatable around a shaft 101. A circumference 102 indicates a common circumference that can drive the imaging units 110, 120, 130, and 140 around the shaft 101. The power that drives the motors is controlled by a control unit 152.

[0031] Furthermore, the imaging device 100 is capable of independently driving each of the imaging units 110, 120, 130, and 140, and is also capable of simultaneously independently driving one or more pan driving units 114, 124, 134, and 144. Furthermore, because all of the imaging units 110, 120, 130, and 140 are driven on the same circumference 102, the relative positions of the imaging units 110, 120, 130, and 140 do not change. The multiple imaging units 110, 120, 130, and 140 are arranged on the same circumference 102, and the pan angles on the same circumference 102 can be changed independently.

[0032] The tilt drivers 116, 126, 136, and 146 will be described with reference to Fig. 3. Fig. 3 is a side view (negative X-axis side) of the imaging device 100 according to the first embodiment. Each of the tilt drivers 116, 126, 136, and 146 includes a motor and a gear, and drives each of the imaging units 110, 120, 130, and 140 by controlling the power that drives the motor.

[0033] Tilt drive unit 116 is configured to be rotatable around shaft 103. The power that drives the motor is controlled by control unit 152. Furthermore, imaging device 100 is capable of independently driving each of imaging units 110, 120, 130, and 140, and is also capable of simultaneously and independently driving one or more tilt drive units 116, 126, 136, and 146.

[0034] The dome 104 is made of a transparent material such as plastic or glass, and enables the imaging unit 110 to capture an image of the outer periphery of the imaging device 100. The fixed unit 105 is a fixed member that can be attached to a ceiling, floor, or wall.

[0035] Furthermore, unlike the pan driving units 114, 124, 134, and 144, the tilt driving units 116, 126, 136, and 146 do not physically interfere with the imaging units 110, 120, 130, and 140. Similarly, the zoom driving units 115, 125, 135, and 145, the focus driving units 118, 128, 138, and 148, and the rotation driving units 117, 127, 137, and 147 do not physically interfere with the imaging units 110, 120, 130, and 140.

[0036] <Zoom drive unit / Focus drive unit> Each of the zoom drivers 115, 125, 135, and 145 includes a motor and a gear, and by controlling the power that drives the motor, it is possible to drive the zoom lens of each of the imaging optical systems 111, 121, 131, and 141. Furthermore, the position of the zoom lens can be obtained using a photointerrupter, a hall element, or the like.

[0037] Driving the zoom driving units 115, 125, 135, and 145 makes it possible to change the angle of view (zoom magnification) of the imaging units 110, 120, 130, and 140. The power for driving the motors is controlled by the control unit 152. Furthermore, the imaging device 100 can drive each of the imaging units 110, 120, 130, and 140 independently, and can drive one or more of the zoom driving units 115, 125, 135, and 145 simultaneously.

[0038] Each focus driver 118, 128, 138, and 148 includes a motor and a gear, and can drive the focus lens of each imaging optical system 111, 121, 131, and 141 by controlling the power that drives the motor. Furthermore, the position of the focus lens can be acquired using a photointerrupter, a Hall element, or the like. Driving the focus drivers 118, 128, 138, and 148 can change the focus positions (in-focus positions) of the imaging units 110, 120, 130, and 140. The power that drives the motor is controlled by a control unit 152. Furthermore, the imaging device 100 can independently drive each imaging unit 110, 120, 130, and 140, and can simultaneously drive one or more focus drivers 118, 128, 138, and 148.

[0039] <Rotation drive unit> Each rotation drive unit 117, 127, 137, and 147 includes a motor and gears, and can be independently controlled for each of the imaging units 110, 120, 130, and 140 by controlling the power that drives the motor. By tilting the rotation drive units 117, 127, 137, and 147 by 90 degrees around the optical axis direction, it is possible to change the imaging area from a landscape aspect ratio to a portrait aspect ratio. Furthermore, the rotation drive units 117, 127, 137, and 147 can rotate not only by 90 degrees but also within a range of 0 degrees to 360 degrees. The following description will be given with 0 degrees as the reference, where 0 degrees represents the landscape aspect ratio.

[0040] <Communications Department> The communication unit 153 transfers the image sent from the image processing unit 151 to the client device 200 via a wired or wireless network 170. The communication unit 153 also receives instructions from the client device 200.

[0041] <Control unit> As described above, the control unit 152 includes a CPU (Central Processing Unit) that controls the imaging units 110, 120, 130, and 140, the driving units 113, 123, 133, and 143, the image processing unit 151, and the communication unit 153. The control unit 152 performs overall control of the imaging device 100.

[0042] <Recording Department> The recording unit 154 has a RAM (Random Access Memory) and a ROM (Read Only Memory), and temporarily stores computer programs and stores programs for the control unit 152 to control the imaging device 100.

[0043] <Client device> The client device 200 includes a communication unit 201 , a control unit 202 , a display unit 203 , an instruction unit 204 , and a recording unit 205 .

[0044] A communication unit 201 of the client device 200 can communicate with the image capturing device 100 via a network 170 .

[0045] The display unit 203 is a display device such as a display, and can display the display image transmitted from the imaging device 100.

[0046] The instruction unit 204 has a user interface, accepts operations of a mouse (pointing device) or keyboard performed by a user, and generates a control signal for controlling the imaging device 100 by the control unit 202. The control signal controls, for example, each of the driving units 113, 123, 133, and 143.

[0047] That is, the user can control the pan / tilt drive units and zoom magnification of each of the image capture units 110, 120, 130, and 140 from the client device 200 via the network 170. Also, the user can control the image capture device 100 as described above by operating a graphical user interface (GUI) in the displayed image via a mouse. Here, a mouse is used as an example, but other means such as touch panel operation may also be used.

[0048] The client device 200 is, for example, a device such as a personal computer, and the network 170 is configured with a wired LAN, a wireless LAN, etc. The client device 200 may also be configured to supply power to the imaging device 100 via the network 170.

[0049] The control unit 202 includes the functions of a CPU and performs overall control of the client device 200. The recording unit 205 is configured with RAM and ROM, and temporarily stores computer programs and stores programs used by the control unit 202 to control the client device 200.

[0050] <Image processing unit> The image processing unit 151 performs development processing (calculation) in accordance with a display format for the imaging data (captured images) captured by each of the imaging units 110, 120, 130, and 140. For example, if there are four imaging units 110, 120, 130, and 140 and it is desired to simultaneously display four images, the image processing unit 151 arranges the imaging data in a square hexagonal pattern and develops them into a single display image.

[0051] The image processing unit 151 also includes an object detection unit 161. The object detection unit 161 analyzes the acquired captured image by image processing. For example, when detecting a moving object as an object, the object detection unit 161 calculates the difference in brightness between frames of the captured image, and determines that a moving object has been detected if there is a change in brightness. The user can instruct via the instruction unit 204 what to detect as an object.

[0052] Furthermore, the image processing unit 151 can display (superimpose) a graphical user interface on the captured image data as an OSD (On-Screen Display). The superimposed OSD display is a graphical user interface that can be operated by the user.

[0053] 4 shows an example of the configuration of an imaging system 190. Fig. 4 is a diagram showing an example of the configuration of the imaging system 190 according to the first embodiment. The imaging system 190 includes an imaging device 100, a network 170, a client device 200, and a display unit 203.

[0054] The imaging device 100 is connected to a client device 200 via a network 170. In Fig. 4, the client device 200 is shown as a desktop computer, but the client device 200 may be a notebook computer or a tablet in which the client device 200 and a display unit 203 are integrated.

[0055] 5 shows detailed configurations of the image capturing apparatus 100 and the client apparatus 200. FIG. 5 is a diagram showing a detailed configuration example of the image capturing apparatus 100 and the client apparatus 200 according to the first embodiment.

[0056] The imaging device 100 includes imaging units 110, 120, 130, and 140, driving units 113, 123, 133, and 143, a network I / F 183, a CPU 180, a RAM 181, and a ROM 182.

[0057] The CPU 180 is a central processing unit that performs overall control of the imaging device 100. The CPU 180 also controls the control unit 152, image processing unit 151, and communication unit 153 shown in FIG.

[0058] The RAM 181 temporarily stores computer programs executed by the CPU 180. The RAM 181 also provides a work area used when the CPU 180 executes processing. The RAM 181 also functions as a frame memory and a buffer memory.

[0059] The ROM 182 stores a program for the CPU 180 to control the imaging device 100 and the like.

[0060] The network I / F 183 transmits the developed display image to the client device 200 via the network 170. Image data captured by each of the imaging units 110, 120, 130, and 140 may be stored in an internal storage device such as a RAM 181 or a ROM 182, which will be described later, or in a removable storage medium (not shown) such as a memory card.

[0061] The client device 200 is an information processing device having a CPU 280 , a RAM 281 , a ROM 282 , an input I / F 284 , an output I / F 285 , and a network I / F 283 .

[0062] The CPU 280 is a central processing unit that controls the client device 200 .

[0063] The RAM 281 provides a work area used when the CPU 280 executes data processing. The RAM 281 also functions as a frame memory and a buffer memory.

[0064] The ROM 282 stores a program for the CPU 280 to control the client device 200 and the like.

[0065] 1 is an interface for receiving operations for the client device 200 input from a user via the instruction unit 204. Operation information for the imaging device 100 can also be received by the input I / F 284.

[0066] The output I / F 285 is an interface that is connected to the display unit 203 in FIG. 4 and causes the display unit 203 to display the display image output from the imaging device 100 .

[0067] The network I / F 283 is an interface that connects to the imaging device 100 via the network 170 and inputs operation information for the imaging device 100 that is input via the input I / F 284 to the imaging device 100. The network I / F 283 also receives a display image output from the imaging device 100.

[0068] <Flowchart> Hereinafter, the operation of the imaging device 100 when detecting an object will be described with reference to Fig. 6. Fig. 6 is a flowchart showing a control method for the imaging device 100 according to the first embodiment, and is a flowchart when detecting an object. This flowchart is realized by the CPU 180 of the imaging device 100 executing a program loaded in RAM. Here, the imaging device 100 is an example of a control device. The imaging devices 100 have multiple built-in imaging units 110, 120, 130, and 140.

[0069] The multiple imaging units 110, 120, 130, and 140 can change their imaging areas independently of one another using a pan driver, a tilt driver, a zoom driver, and a rotation driver. The imaging area includes at least one of a pan angle, a tilt angle, a zoom magnification, and a rotation angle. The multiple imaging units 110, 120, 130, and 140 can move independently on the same circumference 102 using the pan driver.

[0070] In step S401, the object detection unit 161 detects an object from each image captured by the multiple image capture units 110, 120, 130, and 140, and determines whether or not an object has been detected. For example, as shown in FIG. 7(b), the object detection unit 161 detects a moving object 505 in an image 501 captured by the image capture unit 110 as an object. If an object is not detected, the process returns to step S401 and enters a standby state. If an object is detected, the process proceeds to step S402. The image capture unit that captured the image in which the object is detected is called an object detection camera.

[0071] In step S402, CPU 180 controls display unit 203 to display images 501 to 504 in the viewing mode, as shown in FIG. 8(b). Image 501 is an image captured by imaging unit 110. Image 502 is an image captured by imaging unit 120. Image 503 is an image captured by imaging unit 130. Image 504 is an image captured by imaging unit 140.

[0072] Furthermore, the CPU 180 controls the display unit 203 to display a frame 506 of a moving object 505 detected in the image 501 .

[0073] Furthermore, the CPU 180 controls the display unit 203 to superimpose a priority drive mode button 507 on the image 501 in which an object is detected, as shown in Fig. 8(b). The priority drive mode button 507 is a graphical user interface (GUI) for selecting whether or not to switch to the priority drive mode. The priority drive mode button 507 also serves as a GUI for switching the display.

[0074] In step S403, CPU 180 determines whether a certain period of time has elapsed since the processing of step S402. If the certain period of time has not elapsed, the processing proceeds to step S404. If the certain period of time has elapsed, the processing of the flowchart in FIG. 6 ends.

[0075] In step S404, CPU 180 determines whether or not the user has selected (by clicking, tapping, or other operations) the priority drive mode button 507. If the priority drive mode button 507 has been selected, the process proceeds to step S405. If the priority drive mode button 507 has not been selected, the process returns to step S403.

[0076] In step S405, CPU 180 transitions from the viewing mode to the priority drive mode. Then, CPU 180 functions as a control unit and controls display unit 203 to display operation area 601 of a GUI for changing the shooting area of ​​image capture unit 110, which is the object detection camera, among the multiple image capture units 110, 120, 130, and 140, as shown in FIG. 9(b). Operation area 601 includes an image capture unit selection panel 611, operation panels 621, 631, and an end button 642.

[0077] Furthermore, the CPU 180 controls the display unit 203 to display images 501 to 504 captured by the multiple image capturing units 110, 120, 130, and 140, as shown in FIG. 9(b).

[0078] Furthermore, CPU 180 records the position of the drive unit of the object detection camera immediately before transitioning to the priority drive mode in recording unit 154 or recording unit 205. The GUI that allows the shooting area of ​​the object detection camera to be changed is displayed in a state where the shooting area of ​​only the object detection camera can be changed.

[0079] Furthermore, in response to an operation on the operation panel 621 or 631 in FIG. 9(b), the CPU 180 instructs the driving unit 113 to change the imaging area of ​​the imaging unit 110 that captured the image 501 in which the object is detected.

[0080] In step S406, CPU 180 determines whether or not the end button 642 in FIG. 9(b) has been selected. If the end button 642 has been selected, the process proceeds to S407, where the priority drive mode is canceled. If the end button 642 has not been selected, the process returns to step S406. Until the end button 642 is selected, the user can operate the object detection camera using the priority drive mode GUI in FIG. 9(b).

[0081] In step S406, even if the end button 642 is not selected, the CPU 180 may proceed to step S407 after a predetermined time has elapsed following the processing of step S405.

[0082] In step S407, CPU 180 reads the position of the drive unit of the object detection camera immediately before transitioning to the priority drive mode from recording unit 154 or recording unit 205. CPU 180 then drives the drive unit of the object detection camera to the read-out position of the drive unit, returning it to the position of the drive unit immediately before transitioning to the priority drive mode.

[0083] 9(b), the CPU 180 can also change the shooting area of ​​the imaging unit selected by the user from among the multiple imaging units. In this case, in step S407, when an end command is issued using the end button 642, the CPU 180 issues a command to return the shooting areas of all of the multiple imaging units to the shooting areas immediately before the display of the operation area 601.

[0084] In step S408, the CPU 180 controls the display unit 203 to end the display in the priority drive mode of FIG. 9(b) and return to the display state in the browsing mode of FIG. 8(b).

[0085] A display method of the browsing mode will be described with reference to Figures 7(a) and (b), which are diagrams showing a display example of the browsing mode according to the first embodiment.

[0086] Figure 7(a) is a diagram showing an example of a structure similar to that of Figure 2, and shows the positional relationship of the imaging units 110, 120, 130, and 140. Figure 7(a) shows a case where a driving end 106 of a pan driving unit is provided. The driving end 106 of the pan driving unit will be described later.

[0087] FIG. 7B shows a state in which images 501, 502, 503, and 504 from the image capturing units 110, 120, 130, and 140 are displayed on the display unit 203 of the client device 200.

[0088] In the viewing mode, in order to simultaneously view multiple images 501 to 504, the GUI dedicated to operations for driving the drive unit is not displayed, and only the images 501 to 504 are displayed. In the viewing mode, it is desirable that the GUI dedicated to operations is not displayed or is displayed small compared to the priority drive mode in Fig. 9(b) described below, and the four images 501 to 504 are displayed large instead.

[0089] 7(b) is a display image developed by the image processing unit 151, and is displayed on the display of the display unit 203. Image 501 is an image captured by the imaging unit 110. Image 502 is an image captured by the imaging unit 120. Image 503 is an image captured by the imaging unit 130. Image 504 is an image captured by the imaging unit 140.

[0090] 7(b) shows an example in which an object is detected in an image 501 of the imaging unit 110. A moving object 505 is captured within the angle of view of the imaging unit 110, and when the moving object 505 moves and a difference in brightness occurs between frames, the object detection unit 161 detects the moving object 505. When the moving object 505 is detected, the detection result is displayed in the image 501 so that the detection result can be seen. In the image 501, a frame 506 of the moving object 505 is displayed on the OSD as the detection result.

[0091] The priority drive mode button 507 will be described with reference to Figures 8(a) and (b). Figures 8(a) and (b) are diagrams showing an example of a GUI in a view mode according to the first embodiment.

[0092] FIG. 8(a) is a diagram showing an example of a structure similar to that of FIG. 7(a), and shows the positional relationship between the imaging units 110, 120, 130, and 140. In FIG.

[0093] Fig. 8(b) shows an example in which a priority drive mode button 507 is displayed on an OSD in an image 501 in which an object has been detected. When the user views the image 501 captured by the imaging unit 110 and wishes to drive the imaging unit 110, the user selects the priority drive mode button 507. Fig. 9(b) shows an example of the priority drive mode displayed when the priority drive mode button 507 is selected.

[0094] A display example of the priority drive mode will be described with reference to Figures 9(a) and (b), which are diagrams showing a display example of the priority drive mode according to the first embodiment.

[0095] FIG. 9(a) is a diagram showing an example of a structure similar to that of FIG. 7(a), and shows the positional relationship between the imaging units 110, 120, 130, and 140. In FIG.

[0096] FIG. 9(b) shows an example in which images 501 to 504 output from the imaging device 100 are displayed on the display unit 203. In FIG. 9(b), when transitioning to priority drive mode, only the imaging unit 110 of the object detection camera is selected, and a GUI for operating the drive unit 113 is displayed. A state in which only the object detection camera is selected means that only the object detection camera is operable. Furthermore, when transitioning to priority drive mode, a GUI dedicated to operation is displayed. The drive end 106 and drive end 715 of the pan drive unit will be described later.

[0097] The operation area 601 is an area that displays not a captured image but a GUI, which is an image for the user to operate the image capture unit 110. The operation area 601 includes an image capture unit selection panel 611, an operation panel 621, an operation panel 631, and an end button 642.

[0098] The imaging unit selection panel 611 is a GUI that indicates which imaging unit drive units can be operated (which are selected). The imaging unit selection button 711 corresponds to the imaging unit 110. The imaging unit selection button 712 corresponds to the imaging unit 120. The imaging unit selection button 713 corresponds to the imaging unit 130. The imaging unit selection button 714 corresponds to the imaging unit 140.

[0099] 9(b), since the imaging unit 110 is an object detection camera, only the imaging unit selection button 711 is displayed in a selected state when transitioning to the priority drive mode. Also, it is desirable that the imaging unit selection panel 611 displays the relative positions of the imaging units 110, 120, 130, and 140 shown in FIG. 9(a) so that the relative positions can be seen.

[0100] When the pan drive unit 114 of the imaging unit 110 is driven, the position of the imaging unit selection button 711 also moves to match the position of the imaging unit 110. In this way, by displaying a GUI that shows the positional relationship with respect to the interfering drive unit, the user can recognize the drive range.

[0101] The operation panel 621 is a GUI for operating the pan driving unit 114, tilt driving unit 116, and rotation driving unit 117. The image capturing unit 110 selected on the image capturing unit selection panel 611 can be operated.

[0102] The pan button 721 and the pan button 722 are buttons for operating the pan drive unit 114. The pan button 721 is a button for rotating the imaging unit 110 clockwise about the rotation axis 101. The pan button 722 is a button for rotating the imaging unit 110 counterclockwise about the rotation axis 101.

[0103] Tilt button 723 and tilt button 724 are buttons for operating tilt drive unit 116. Tilt button 723 is a button for rotating image capture unit 110 upward about rotation axis 103 in Fig. 3. Tilt button 724 is a button for rotating image capture unit 110 downward about rotation axis 103 in Fig. 3.

[0104] The rotation button 725 and the rotation button 726 are buttons for operating the rotation drive unit 117. The rotation button 725 is a button for rotating the solid-state imaging element 112 of the imaging unit 110 clockwise about the optical axis. The rotation button 726 is a button for rotating the solid-state imaging element 112 of the imaging unit 110 counterclockwise about the optical axis.

[0105] While these buttons are pressed, the drive unit 113 operates. Therefore, if the button is pressed for a short time, the amount of drive is small, and if the button is pressed for a long time, the amount of drive is large. In this way, this GUI allows the user to freely control the direction and amount of drive.

[0106] The drive status button 727 is a button that indicates the drive status, and when not driven, is displayed at the reference position (center) of the frame 728. When driven, the position of the drive status button 727 moves.

[0107] When the pan driving unit 114 is driving, the driving status button 727 moves left and right. When the tilt driving unit 116 is driving, the driving status button 727 moves up and down. When both the pan driving unit 114 and the tilt driving unit 116 are driving, the driving status button 727 moves diagonally.

[0108] The direction in which the drive status button 727 moves corresponds to the direction in which each drive unit moves. For example, when the pan button 721 is selected, the drive status button 727 moves to the right. The amount by which the drive status button 727 moves may also be changed depending on the drive speed. The slower the drive speed, the closer the drive status button 727 is positioned to the reference position.

[0109] The drive state button 727 may be an operable GUI, and the user can drive the drive unit in any direction by dragging it.

[0110] Like the operation panel 621, the operation panel 631 is a GUI for operating the drive unit 113 of the imaging device 100, and can operate the pan drive unit 114, tilt drive unit 116, rotation drive unit 117, zoom drive unit 115, and focus drive unit 118.

[0111] The operation panel 631 has a pan button 731, a tilt button 732, a zoom button 733, a focus button 734, and a rotation button 735. Each of the operation buttons 731 to 735 has six buttons, and each of the six buttons can be driven by specifying a different drive amount.

[0112] For example, the pan button 731 displays relative values ​​(not shown) of discrete angles (degrees) to be driven, such as -30, -20, -10, 10, 20, and 30 from the left end. If the user clicks the rightmost button labeled 30, for example, the image capture unit 110 is driven 30 degrees clockwise (the same direction as the pan button 721).

[0113] The tilt button 732 can be operated in the same way as the pan button 731. For example, relative values ​​of discrete angles (degrees) to drive are displayed (not shown), such as -30, -20, -10, 10, 20, and 30 from the left end. For example, if the user clicks the button on the right end labeled 30, the imaging unit 110 is driven upward by 30 degrees (the same direction as the tilt button 723).

[0114] The zoom button 733 can be operated in the same manner as the pan button 731. For example, from the left, discrete relative values ​​to be driven are displayed (not shown), such as -30, -20, -10, 10, 20, and 30. For example, if the user clicks the rightmost button labeled 30, the zoom drive unit 115 is driven by 30 to the telephoto side. The numerical value here is expressed as a dimensionless numerical value proportional to the rotation angle of the motor, with the wide-angle end being 0 and the telephoto end being 100.

[0115] The focus button 734 can also be operated in the same way as the pan button 731. For example, from the left end, discrete relative values ​​to be driven are displayed (not shown), such as -30, -20, -10, 10, 20, and 30. For example, if the user clicks the rightmost button labeled 30, the focus drive unit 118 is driven by 30 to the far side. The numerical value here is expressed as a dimensionless numerical value proportional to the rotation angle of the motor, with the near end being 0 and the far end being 100.

[0116] The rotation button 735 can also be operated in the same way as the pan button 731. For example, relative values ​​of discrete angles (degrees) to be driven are displayed (not shown), such as -30, -20, -10, 10, 20, and 30 from the left end. For example, if the user clicks the button on the right end labeled 30, the solid-state imaging element 112 of the imaging unit 110 is driven 30 degrees clockwise (the same direction as the rotation button 725).

[0117] Here, numerical values ​​have been used as examples, but the present invention is not limited to the described numerical values. Qualitative expressions such as large, medium, and small may also be used instead of numerical values. Also, by displaying an illustration that visually indicates the direction, users can intuitively operate the device, so numerical values ​​may not be displayed.

[0118] The end button 642 is a button for ending the priority drive mode. When the end button 642 is selected, the processes of steps S406 to S408 in Fig. 6 are performed, and the drive position and display return to the viewing mode in Fig. 7.

[0119] As described above, by displaying an operation GUI with only the imaging unit 110 of the object detection camera selected when an object is detected, the user can immediately operate the target imaging unit 110 when an object is detected, thereby improving operability.

[0120] <Display image> In the priority drive mode, the display sizes of images 501 to 504 may be changed as shown in FIG. 9(b). In the priority drive mode, the user operates while viewing image 501 from the object detection camera, so by displaying images 502, 503, and 504 in small sizes, image 501 can be displayed in a larger size in the freed-up space. A GUI dedicated to operation may also be displayed in the freed-up space. In this way, operability is improved by displaying image 501 and the GUI that the user operates in a larger size.

[0121] A GUI dedicated to operation such as operation panel 621 or operation panel 631 may not be necessary. In that case, however, a means for operating another drive unit is provided. For example, the pan drive unit 114 and tilt drive unit 116 may be operated by dragging or tapping on image 501. In that case, only the image 501 of the object detection camera can be operated. For example, only the image 501 is displayed, and a GUI is displayed on the image 501 as an OSD.

[0122] Next, a supplementary explanation will be given regarding the image capture unit selection panel 611. The image capture unit selection panel 611 must have the object detection camera selected when transitioning to the priority drive mode, but it may be possible to reselect an image capture unit after transition. Also, the image capture unit selection panel 611 does not have to be displayed when transitioning.

[0123] The CPU 180 can select an imaging unit in response to a user's operation on the imaging unit selection panel 611. Then, the CPU 180 controls the display unit 203 to display a GUI operation area 601 that allows the shooting area of ​​the imaging unit selected by the user's operation from among the multiple imaging units to be changed.

[0124] It is desirable that the imaging unit selection panel 611 displays the relative positions of the imaging units 110, 120, 130, and 140 shown in Fig. 9(a) so that the user can see them. When the pan drive unit 114 of the imaging unit 110 is driven, the position of the imaging unit selection panel 611 also moves to match the position of the imaging unit 110. The CPU 180 controls the display unit 203 to display the positions of the multiple imaging units 110, 120, 130, and 140 on the circumference 102, just like the imaging unit selection panel 611. In this way, the user can recognize the relative positions of the imaging units 110, 120, 130, and 140, which clarifies the driving range and improves operability.

[0125] <Drive end> FIG. 9(a) shows the drive end 106 of the pan drive unit. Each of the imaging units 110, 120, 130, and 140 cannot be operated beyond the drive end 106 of the pan drive unit. The drive end 106 may be a physical drive end defined by hardware, or may be a drive end that the user cannot specify in software. When such a drive end 106 is present, it is desirable to display a message indicating the non-driveable position, as shown by the drive end 715 on the imaging unit selection panel 611. This allows the user to know the range of possible drive, improving operability.

[0126] <GUI for operation (slider bar)> FIG. 9(b) shows an example of operations on the operation panels 621 and 631, but the operation panels 621 and 631 may be something like a slider bar, and modifications and variations are possible.

[0127] An example of a slider bar is shown in Figures 10(a) and 10(b), which are diagrams showing an example of a slider bar according to the first embodiment, and show a display example of a priority drive mode, similar to Figures 9(a) and 9(b).

[0128] 10(b) is a GUI for operating the pan driving unit 114. Since the imaging units 110, 120, 130, and 140 are arranged on the same circumference 102 and the driving range of the pan driving unit changes depending on the relative positions of the imaging units 110, 120, 130, and 140, it is desirable to arrange the pan driving unit so that the positions of all the imaging units can be seen.

[0129] 9B, the positional relationship between the imaging units 110, 120, 130, and 140 is shown on the imaging unit selection panel 611, but in FIG. 10B, the positional relationship between the imaging units 110, 120, 130, and 140 is shown on a pan operation bar 651 of a slider bar.

[0130] 10(b), a pan button 751 corresponds to the imaging unit 110. A pan button 752 corresponds to the imaging unit 120. A pan button 753 corresponds to the imaging unit 130. A pan button 754 corresponds to the imaging unit 140.

[0131] 10(b), the object detection camera (pan button 751) is selected, similarly to the image capture unit selection panel 611 in FIG. 9(b). At this time, the user can drive the pan drive unit 114 of the selected image capture unit 110 by clicking any position on the slider. However, panning from the current position is limited to a range that does not exceed the drive end 106 or the position of another image capture unit.

[0132] The position corresponding to drive end 106 in Figure 10(a) is drive range 755 in Figure 10(b), and the slider bar is created so that it is at the end of the slider bar. In this case, the range in which pan button 751 of imaging unit 110 can be moved is the range from drive range 755 corresponding to drive end 106 to pan button 752 corresponding to imaging unit 120, and this range is represented by arrow 756.

[0133] As shown in FIG. 10(b), the range in which the imaging unit 110 (pan button 751) can be operated is displayed, thereby improving the operability for the user.

[0134] The tilt operation bar 661 indicates the range within which the tilt drive unit 116 of the imaging unit 110 can move. In addition, a tilt button 761 is displayed at the current position of the tilt drive unit 116. Unlike the pan drive unit 114, the tilt drive unit 116 does not interfere with the position of other imaging units, and therefore only the tilt button 761 corresponding to the selected imaging unit 110 is displayed.

[0135] Also, as an operation method using a slider bar, an example of specifying an arbitrary position on the slider bar has been shown, but it is also possible to drag the pan button 751 or use it in combination with the operation panel of FIG. 9(b).

[0136] Although the slider bar has been described using the pan driving unit 114 and the tilt driving unit 116 as examples, other driving units can also be applied in the same manner as the tilt driving unit 116.

[0137] <Image capture unit and drive unit> Although the configuration having four imaging units 110, 120, 130, and 140 has been described, the present invention is applicable to an imaging device 100 having two or more imaging units that can be driven independently.

[0138] Also, although an example has been shown in which the image capturing units 110, 120, 130, and 140 have the pan driving units 114, 124, 134, and 144 arranged on the same circumference 102, this arrangement is not necessarily required. The present invention can be applied to an image capturing device 100 having a plurality of image capturing units, each with its own driving unit.

[0139] <highlight> The CPU 180 can highlight the image 501 captured by the object detection camera to make it easier for the user to view the image that should be focused on. Highlighting refers to adding color to the frame 506 of the image 501 in Figures 8(b) and 9(b) or enlarging the image 501 in Figure 9(b).

[0140] <Electronic zoom> Although an example in which the zoom driving unit 115 is driven when changing the zoom magnification has been shown, the same can be applied to electronic zoom using digital processing.

[0141] <Additional information on how to switch between browsing mode and priority driving mode> The same GUI for operation may be displayed in both the viewing mode and the priority drive mode. However, when switching to the priority drive mode, the image capture unit 110 of the object detection camera is selected, and the other image capture units 120, 130, and 140 are deselected. This allows the user to operate the device without having to select the image capture unit 110.

[0142] <How to switch priority drive modes> While Fig. 8(b) shows an example in which the priority drive mode button 507 is displayed when an object is detected, it is also possible to forcibly switch to the priority drive mode shown in Fig. 9(b) when an object is detected. This allows the object detection camera to be operated immediately, improving user operability. This method of switching to the priority drive mode regardless of user selection is called a forced transition.

[0143] 8(b), by displaying the priority drive mode button 507 and allowing the user to select it, unnecessary transitions to the priority drive mode can be suppressed, and the operation can be performed as intended by the user. This method of transitioning to the priority drive mode at the user's discretion is called optional transition.

[0144] <How to transition between priority drive modes depending on the type of object detected> The CPU 180 may determine whether to perform a forced transition or an optional transition based on the type of object detection. Here, a GUI may be provided that allows the user to set the transition method for each type of object detection by providing three options for transitioning to the priority drive mode: "1. Do not transition," "2. Optional transition," and "3. Forced transition."

[0145] Here, three types of object detection (moving object detection, person detection, and abnormal behavior detection) will be used for explanation. In moving object detection, person detection, and abnormal behavior detection, detection is performed in the order of moving object detection, person detection, and abnormal behavior detection. That is, an object detected as a moving object by moving object detection is determined to be a person by person detection. If the object is determined to be a person and person detection is performed, abnormal behavior detection is used to detect whether the object is behaving abnormally. Therefore, the frequency of detection by moving object detection is highest, and the frequency of detection by abnormal behavior detection is lowest.

[0146] An example of the GUI for the migration method will be described with reference to Fig. 17. Fig. 17 is a diagram showing an example of the GUI for the migration method. Fig. 17 shows only the GUI portion for the migration method, but like other GUIs, it is displayed in part of the display image 500.

[0147] The CPU 180 displays an image capture unit selection panel 801, an object detection selection panel 802, a transition method panel 803, a valid / invalid setting panel 804, and an add button 805 as a GUI for the transition method.

[0148] The imaging unit selection panel 801 is used to select the imaging unit to be configured. The object detection selection panel 802 is used to set the object detection method. The area to be detected can be set by operating a GUI (not shown). The transition method panel 803 is used to set the transition method when an object is detected. It is desirable that the transition method panel 803 can be set for each imaging unit and each object. The enable / disable setting panel 804 is used to select whether or not to perform object detection. The add button 805 can be used to add object detection settings.

[0149] Here, we will explain the case where a user performs object detection by focusing on whether a suspicious person has entered a specific area. The explanation will be based on the assumption that the user wants to ignore the intruding moving object if it is an animal or the like, but conversely, wants to operate the imaging unit so that if it is a person behaving abnormally, the user can immediately focus on the moving object.

[0150] The object detection types are moving object detection, human detection, and abnormal behavior detection. The detection methods for each object will be described later.

[0151] The level of risk to the user also increases in the order of motion detection, person detection, and abnormal behavior detection. Therefore, users should set motion detection, which has the lowest level of risk, to "1. Do not transition," person detection to "2. Optional transition," and abnormal behavior detection to "3. Forced transition."

[0152] This allows the user to operate the object detection camera immediately the higher the risk (the more of an object the user wants to focus on).Also, when the risk is low, it is easier to pay attention to the display of imaging units other than the object detection camera while remaining in viewing mode.

[0153] As shown in Figure 17, the CPU 180 can set the setting to "1. No transition", "2. Optional transition", or "3. Forced transition" for each imaging unit and type of object detection in response to user operation.

[0154] If "2. Optional transition" is set, CPU 180 performs the processes of steps S401 to S408 in Fig. 6. If "3. Forced transition" is set, CPU 180 proceeds to step S405 after "yes" in step S401 in the flowchart in Fig. 6, regardless of the user's operation.

[0155] <Additional information on migration method> Although an example has been described in which there is a GUI for setting the transition method, the transition method may be determined for each type of object detection. For example, when the type of object detection is the first type, CPU 180 performs "voluntary transition" processing. When the type of object detection is the second type, CPU 180 performs "forced transition" processing.

[0156] The transition method may also be determined based on the object detection frequency. If the object detection frequency is high, the transition method is set to "1. No transition," if the detection frequency is medium, the transition method is set to "2. Optional transition," and if the detection frequency is low, the transition method is set to "3. Forced transition." For example, if the object detection frequency is a first detection frequency, the CPU 180 performs the "Optional transition" process. If the object detection frequency is a second detection frequency, the CPU 180 performs the "Forced transition" process.

[0157] Additionally, machine learning may be used to learn user operations after transitioning to priority drive mode. Initially, when an object is detected, the system transitions to priority drive mode, allowing the user to operate the object detection camera. After that, if the object is not operated by the user (or is operated infrequently), the transition to object detection mode is reset to "1. Do not transition." Conversely, if the object is operated by the user (or is operated frequently), the transition to object detection mode is reset to "3. Forced transition."

[0158] An example of setting a transition method for each type of object detection has been described above, but even if the objects are of the same type, if the setting conditions such as the detection area are different, it is desirable to be able to set a transition method for each object rather than for each type.

[0159] The following provides additional information about the types and methods of object detection. The types and methods of object detection described here are not limited to those described herein, and modifications and variations are possible.

[0160] <Motion detection> When there is a difference in brightness between frames, the object detection unit 161 can detect a moving object. When a moving object is detected, the object detection unit 161 detects the moving object as a moving object.

[0161] <Person detection> The object detection unit 161 may calculate edges / feature points of the detection area of ​​the moving object and perform attribute classification to perform classification based on the shape of the edges / feature points (for example, the shape of the head). For example, when the object is determined to be a person by attribute classification, the object detection unit 161 detects it as a person.

[0162] <Abnormal behavior detection> When a person is detected, the object detection unit 161 may make a determination based on the person's behavior (behavior identification). For example, when the detected person is looking around or running, the object detection unit 161 determines that the behavior is suspicious and detects it as abnormal behavior.

[0163] <Other detections> Some examples of types of object detection are as follows: The object detection unit 161 calculates the edges of an image area (object) specified by the user, and can perform object movement detection to detect whether an object has been taken away or left behind based on changes in the edges.

[0164] Moreover, the present invention is not limited to people, and can also be applied to cars, animals, etc. When a person is detected, the object detection unit 161 may make a determination based on the person's behavior (behavior identification).

[0165] Furthermore, the object detection unit 161 can perform specific person detection, which determines whether or not a photographed person is a specific person registered in advance, based on facial feature points of the person. For example, the object detection unit 161 compares the shape and size of the eyes, nose, mouth, etc. of the photographed person with image data of a person registered in advance to determine the degree of match. If the degree of match is high, the object detection unit 161 determines that the person is a specific person.

[0166] Furthermore, the object detection unit 161 can calculate edges / feature points of the detection area of ​​the moving object and perform attribute classification to estimate age, sex, etc. from the shapes of the edges / feature points.

[0167] <Detection of movement vector> When the object detected by edge detection is a moving object, the object detection unit 161 can calculate the moving direction (movement vector) of the moving object by taking the difference between frames.

[0168] The CPU 180 may set the transition method depending on the speed of the moving object based on the movement vector. If the moving speed of the moving object is fast, an immediate operation may be required, so the transition method is set to "3. Forced transition." Conversely, if the moving speed of the moving object is slow, it may take some time for the user to switch operations, so the transition method is set to "1. Do not transition."

[0169] In addition, although the migration method has been described as being set to either "1. Do not migrate" or "3. Forced migration," it is not limited to this. It can be changed in stages between "1. Do not migrate" and "2. Optional migration," "2. Optional migration" and "3. Forced migration," or "1. Do not migrate," "2. Optional migration," and "3. Forced migration," and can be changed arbitrarily.

[0170] Although an example has been shown in which each imaging unit has a drive mechanism on the circumference 102 common to the pan drive unit, each imaging unit may have a common drive mechanism other than the pan drive unit.

[0171] (Second embodiment) In the first embodiment, a method for performing image processing in the image processing unit 151 of the imaging device 100 has been described. In the second embodiment, a case where at least a part of the functions of the image processing unit 151 is in the client device 200 will be described. For example, object detection may be performed in the client device 200, and image processing for OSD display may be performed in the client device 200. Differences between the second embodiment and the first embodiment will be described below.

[0172] Fig. 18(a) is a flowchart showing a control method for the imaging device 100 according to the second embodiment, and Fig. 18(b) is a flowchart showing a control method for the client device 200 according to the second embodiment. The flowchart in Fig. 18(a) is realized by the CPU 180 of the imaging device 100 executing a program loaded in RAM. The flowchart in Fig. 18(b) is realized by the CPU 280 of the client device 200 executing a program loaded in RAM. Here, the client device 200 is an example of a control device. The multiple imaging units 110, 120, 130, and 140 are provided outside the client device 200.

[0173] In step S1801, CPU 180 of imaging device 100 transmits the captured images of each imaging unit 110, 120, 130, and 140 in frame units of the captured image to client device 200 via network I / F 183. Furthermore, CPU 180 may transmit information such as the pan angle, tilt angle, zoom magnification, rotation angle, and focus position of each imaging unit 110, 120, 130, and 140 in frame units of the captured image to client device 203 as needed.

[0174] In step S1802, the CPU 280 of the client device 200 receives the captured images of each of the imaging units 110, 120, 130, and 140 on a frame-by-frame basis from the imaging device 100 via the network I / F 283. The CPU 280 may also receive information such as the pan angle, tilt angle, zoom magnification, rotation angle, and focus position of each of the imaging units 110, 120, 130, and 140 from the imaging device 100 on a frame-by-frame basis.

[0175] In step S401, CPU 280 detects an object from images captured by multiple imaging units 110, 120, 130, and 140, and determines whether or not an object has been detected. For example, as shown in FIG. 7(b), CPU 280 detects moving object 505 in image 501 captured by imaging unit 110 as the object. If an object has not been detected, the process returns to step S1802. If an object has been detected, the process proceeds to step S402.

[0176] In step S402, the CPU 280 controls the display unit 203 to display images 501 to 504 in the viewing mode and a frame 506 of a moving object 505, as shown in Fig. 8(b). Furthermore, the CPU 280 causes the display unit 203 to superimpose a priority drive mode button 507 on the image 501 in which an object has been detected, as shown in Fig. 8(b). The priority drive mode button 507 is a GUI for selecting whether or not to switch to the priority drive mode.

[0177] In step S403, CPU 280 determines whether a certain period of time has elapsed since the processing of step S402. If the certain period of time has not elapsed, the processing proceeds to step S404. If the certain period of time has elapsed, the processing of the flowchart in FIG. 18(b) ends.

[0178] In step S404, CPU 280 determines whether or not the user has selected (by clicking, tapping, or other operations) priority drive mode button 507. If the priority drive mode button 507 has been selected, the process proceeds to step S405. If the priority drive mode button 507 has not been selected, the process returns to step S403.

[0179] In step S405, CPU 280 transitions from the viewing mode to the priority drive mode. Then, CPU 280 controls display unit 203 to display operation area 601 of a GUI that allows changing the shooting area of ​​only image capture unit 110, the object detection camera, among the multiple image capture units 110, 120, 130, and 140, as shown in FIG. 9(b). Operation area 601 includes an image capture unit selection panel 611, operation panels 621, 631, and an end button 642.

[0180] Furthermore, the CPU 280 controls the display unit 203 to display images 501 to 504 captured by the multiple image capturing units 110, 120, 130, and 140, as shown in FIG. 9(b).

[0181] Furthermore, CPU 280 records the position of the drive unit of the object detection camera immediately before transitioning to the priority drive mode in recording unit 205. The GUI that allows the shooting area of ​​the object detection camera to be changed is displayed in a state where the shooting area of ​​only the object detection camera can be changed.

[0182] Furthermore, in response to an operation on the operation panel 621 or 631 in FIG. 9(b), the CPU 280 instructs the imaging device 100 to change the imaging area of ​​the imaging section 110 that captured the image 501 in which the object is detected.

[0183] In step S406, CPU 280 determines whether or not end button 642 in FIG. 9(b) has been selected. If end button 642 has been selected, the process proceeds to S1803, where the priority drive mode is canceled. If end button 642 has not been selected, the process returns to step S406. Until end button 642 is selected, the user can operate the object detection camera using the priority drive mode GUI in FIG. 9(b).

[0184] In step S406, CPU 280 may proceed to step S1803 after a predetermined time has elapsed following the processing of step S405, even if end button 642 is not selected.

[0185] In step S1803, CPU 280 reads the position of the drive unit of the object detection camera immediately before transitioning to the priority drive mode from recording unit 205. Then, CPU 280 transmits control signals such as the pan angle, tilt angle, zoom magnification, rotation angle, and focus position of imaging units 110, 120, 130, and 140 to imaging device 100 via network I / F 283 so as to return the drive unit of the object detection camera to the position it had immediately before transitioning to the priority drive mode.

[0186] 9(b), the CPU 280 can also change the shooting area of ​​an imaging unit selected by the user from among the multiple imaging units. In this case, in step S1803, when an end command is issued using the end button 642, the CPU 280 issues a command to return the shooting areas of all of the multiple imaging units to the shooting areas immediately before the display of the operation area 601.

[0187] In step S1804, the CPU 180 of the imaging device 100 determines whether or not control signals such as the pan angle, tilt angle, zoom magnification, rotation angle, and focus position of the imaging units 110, 120, 130, and 140 have been received from the client device 200 via the network I / F 183. If no control signals have been received, the process returns to step S1801. If no control signals have been received, the process proceeds to step S407.

[0188] In step S407, based on the received control signal, CPU 180 controls the pan angle, tilt angle, zoom magnification, rotation angle, focus position, etc. of imaging units 110, 120, 130, and 140. Specifically, CPU 180 controls the object detection camera drive units to return to the positions they had immediately before switching to the priority drive mode.

[0189] In step S408, the CPU 280 of the client device 200 controls the display unit 203 to end the display in the priority drive mode of FIG. 9(b) and return to the display state in the browsing mode of FIG. 8(b).

[0190] (Third embodiment) In the first embodiment, a display example of the priority drive mode was described. In the first embodiment, it was shown that the drive range 755 of the pan drive unit is limited depending on the positions of other imaging units (adjacent imaging units), as shown in FIG. 10(b). Therefore, in order for the user to operate the pan drive unit 114 of the object detection camera beyond the limited drive range 755, it becomes necessary to operate the pan drive unit (adjacent imaging unit) of an imaging unit other than the object detection camera to expand the drive range of the object detection camera.

[0191] However, if the user operates an imaging unit other than the object detection camera, the user will have to operate multiple imaging units, which can be cumbersome. Therefore, in the third embodiment, a method will be described in which the driving range of the object detection camera is expanded by controlling an imaging unit other than the object detection camera in priority drive mode, without the user having to operate multiple imaging units.

[0192] Control of the cameras other than the object detection cameras in the third embodiment will be described with reference to Fig. 11 to Fig. 13. In Fig. 11 to Fig. 13, control of the pan drive units of the imaging units other than the object detection cameras will be described.

[0193] 11(a) and (b) are diagrams showing an example in which imaging units other than the object detection camera are retracted when the drive end 106 according to the third embodiment is present. Figures 11(a) and (b) show how the imaging device 100 retracts the imaging units other than the object detection camera in the priority drive mode of Figures 9(a) and (b). Figures 11(a) and (b) show how the imaging units other than the object detection camera are panned to widen the driveable range of the object detection camera.

[0194] By selecting the image capture unit selection buttons 712 to 714, the pan drive unit, tilt drive unit, and rotation drive unit of the image capture units 120, 130, and 140 can be driven, respectively.

[0195] 11(b), when transitioning to the priority drive mode, the imaging unit selection button 711 is in a selected state, as in FIG. 9(b). At this time, the control unit 152 controls the pan drive units 124, 134, and 144 of the imaging units 120, 130, and 140 other than the object detection camera to positions where the drive range of the imaging unit 110 of the object detection camera is expanded.

[0196] To widen the driving range of the object detection camera, the control unit 152 drives the pan driving units 124, 134, and 144 in directions that move the imaging units 120, 130, and 140 other than the object detection camera away from the object detection camera.

[0197] 11(a) shows the case where there is a driving end 106. The driving end 106 is located in the counterclockwise direction of the imaging unit 110, and this limits the driving range. Therefore, it can be seen that the driving range in the counterclockwise direction is not limited by the other imaging units 120, 130, and 140.

[0198] In contrast, the imaging unit 120 is located in the clockwise direction of the imaging unit 110, limiting the driving range. Therefore, by driving the pan driving unit 124 of the imaging unit 120 clockwise, the driving range of the imaging unit 110 can be widened. Driving the pan driving unit 124 of the imaging unit 120 clockwise will cause interference with the imaging unit 130, so it is desirable to drive the imaging unit 130 clockwise as well as the imaging unit 120. It is also desirable to drive the imaging unit 140 clockwise as well.

[0199] In FIG. 11A, the imaging unit 140 is moved as close as possible to the drive end 106, and the imaging units 130 and 120 are also moved as close as possible to the drive end 106 as possible, thereby maximizing the drive range of the imaging unit 110.

[0200] As described above, movement of imaging unit 110 of the object detection camera in the first direction on circumference 102 is restricted by drive end 106. In this case, CPU 180 instructs imaging unit 120, which is adjacent to imaging unit 110 that captured image 501 in which an object is detected in the second direction opposite to the first direction on circumference 102, to move in the second direction on circumference 102.

[0201] Also, for example, if the object detection camera is the imaging unit 120, the pan drive unit 114 of the imaging unit 110 is driven counterclockwise to move it closer to the drive end 106, and the imaging units 140 and 130 are driven clockwise to move it closer to the drive end 106.

[0202] In this way, CPU 180 instructs imaging unit 110, which is adjacent in the first direction on circumference 102 to imaging unit 120 that captured image 502 in which the object was detected, to move in the first direction on circumference 102. The first direction is, for example, a counterclockwise direction.

[0203] Furthermore, CPU 180 instructs imaging unit 130, which is adjacent to imaging unit 120 that captured image 502 in which the object was detected, in a second direction opposite to the first direction on circumference 102, to move in the second direction on circumference 102. The second direction is, for example, a clockwise direction.

[0204] In this way, by driving the object detection camera based on the positional relationship between the object detection camera and the other imaging units, it is possible to maximize the driving range of the object detection camera (imaging unit 120).

[0205] 12(a) and (b) are diagrams showing an example in which components other than the object detection camera are retracted when there is no drive end 106 according to the third embodiment. When there is no drive end 106, the image capture units 120, 130, and 140 are driven to positions facing the image capture unit 110 (a position where the relative position of the pan angle is 180 degrees). This makes it possible to maximize the drive range of the image capture unit 110 of the object detection camera.

[0206] 11 and 12 show examples in which, when transitioning to the priority drive mode, the other image capture units 120, 130, and 140 are driven. Fig. 13 explains a method for controlling the image capture units 120, 130, and 140 other than the object detection camera in response to the user's operation of the object detection camera during the priority drive mode.

[0207] 13(a) and (b) are diagrams showing an example of control of the imaging units 120, 130, and 140 other than the object detection camera in response to a user's operation of the object detection camera in priority drive mode according to embodiment 3. Figures 13(a) and (b) illustrate control of the imaging units 120, 130, and 140 other than the object detection camera when a user operates the pan drive unit 114 of the imaging unit 110 of the object detection camera and another imaging unit 120, 130, or 140 is in the drive direction.

[0208] 13(a) and (b), in contrast to FIGS. 9(a) and (b), show a state in which a user presses and holds the pan button 721 for the image capture unit 110, which is an object detection camera. When the pan drive unit 114 of the image capture unit 110 drives clockwise, it interferes with the image capture unit 120, thereby limiting the drive range.

[0209] Therefore, as shown in Figures 13(a) and (b), the driving range of the imaging unit 110 can be expanded by operating the pan driving unit 114 of the object detection camera to move the other imaging units 120 in the same direction (clockwise).

[0210] Furthermore, if the imaging unit 120 is driven clockwise, it will interfere with the imaging unit 130, so it is desirable to drive the imaging unit 130 clockwise as well. The same applies to the imaging unit 140.

[0211] As described above, assume that an instruction is given to move image capturing unit 110, which captured image 501 in which an object is detected, in a first direction on circumference 102 by operating operation panel 621 or 631. The first direction is, for example, a clockwise direction. In this case, CPU 180 instructs image capturing unit 110, which captured image 501 in which an object is detected, to move in the first direction, and also instructs image capturing unit 120, which is adjacent in the first direction to image capturing unit 110, which captured image 501 in which an object is detected, to move in the first direction.

[0212] This allows the user to operate the object detection camera without having to control the other imaging units 120, 130, and 140, and allows the driving range of the object detection camera to be widened.

[0213] Furthermore, the imaging unit 120 can be driven (moved) at a speed equal to or greater than that of the imaging unit 110, thereby further preventing the operation of the imaging unit 110 from being hindered. Furthermore, the imaging unit 120 may start panning when the imaging unit 110 issues an instruction to move in the direction of the imaging unit 120 or when the difference in pan angles between the imaging unit 120 and the imaging unit 110 becomes equal to or less than a threshold, rather than starting panning after interference with the imaging unit 110. This further prevents the operation of the imaging unit 110 from being hindered.

[0214] Furthermore, if the imaging unit 120 has been driven clockwise and then the imaging unit 110 is instructed to rotate counterclockwise, the imaging unit 120 may also be driven counterclockwise in conjunction with the imaging unit 110.

[0215] Here, the imaging unit 120 has been described, but the same applies to the imaging units 130 and 140.

[0216] Furthermore, when the end button 642 is selected, it is desirable to return the positions of all of the imaging units 110, 120, 130, and 140 to the state before transition to the priority drive mode, thereby enabling the user to start operation from the state before object detection.

[0217] 13(a) and 13(b), the imaging unit 110 and imaging unit selection button 711, which are indicated by dotted lines, are shown in the positions before being driven (the same positions as in FIG. 9) for clarity of explanation.

[0218] In this way, by automatically controlling the imaging units 120, 130, and 140 other than the object detection camera, the driving range of the object detection camera is widened, and operability for the user is improved.

[0219] In the third embodiment, a method for driving the imaging units 120, 130, and 140 other than the object detection cameras has been described, but the imaging units 120, 130, and 140 other than the object detection cameras may capture images in directions unexpected by the user.

[0220] Therefore, it is desirable that the user be able to specify the imaging units whose imaging areas the user does not want to change and fix their positions. The CPU 180 can set whether or not to fix the imaging range (e.g., pan drive unit) of each of the multiple imaging units 110, 120, 130, and 140 for each of the imaging units. That is, the CPU 180 can set whether or not to fix the position of each of the multiple imaging units 110, 120, 130, and 140 on the same circumference for each of the imaging units 110, 120, 130, and 140.

[0221] For example, in FIG. 13, when the user fixes the position of the imaging unit 120, even if the imaging unit 110 is in the priority drive mode as an object detection camera, the drive range of the pan drive unit is the same as that in FIG.

[0222] Furthermore, the user's setting for fixing the position (fixing instruction) can be set at the time of initial installation of the imaging device 100. Furthermore, the imaging unit selection panel 611 in Fig. 9(b) may be a GUI having this function.

[0223] Furthermore, in the third embodiment, the client device 200 may perform the processing, as in the second embodiment.

[0224] <Control GUI for setting priority> Although the above describes the control and UI for transitioning to the priority drive mode when an event such as moving object detection, human body detection, or abnormal behavior detection is detected, the present invention is not limited to this. For example, when the image capture unit 110 detects an event in which it has received an operation instruction from the user, it can also transition to the priority drive mode, and the other image capture units 120, 130, and 140 that have not received an operation instruction from the user move in a direction that widens the drive range of the image capture unit 110.

[0225] The CPU 180 also has a function of setting the priority of each of the image capturing units 110, 120, 130, and 140, and can determine whether or not the image capturing units 120, 130, and 140 that do not receive an operation instruction will operate based on the priority.

[0226] An operation when there are two levels of priority, high and low, will be described with reference to Fig. 13. When the priority of the imaging unit 110 is high and the priority of the imaging unit 120 is low, the imaging unit 120 moves in a direction that widens the driving range of the imaging unit 110.

[0227] On the other hand, if the priority of the image capturing unit 110 is low and the priority of the image capturing unit 120 is high, the image capturing unit 120 does not move.

[0228] Similarly, if the imaging units 110 and 120 have the same priority, the imaging unit 120 will not move. To allow the imaging unit with a higher priority to be set preferentially, the operation from the user may be disabled for the imaging unit determined to have a lower priority.

[0229] The CPU 180 determines that the imaging unit 110 that the user is instructing to operate has a higher priority than the imaging units 120, 130, and 140 that the user is not instructing to operate, and can set the priority of each of the imaging units 110, 120, 130, and 140. Alternatively, the CPU 180 may perform control to display a GUI that allows the user to set the priority in advance. The CPU 180 can set the priority of each of the imaging units 110, 120, 130, and 140 according to the user settings on the GUI.

[0230] By allowing the CPU 180 to detect the priority, the user can freely set the imaging unit that he or she wants to move or not move, thereby improving operability.

[0231] Alternatively, the CPU 180 may control to display a graphical user interface that allows the user to select whether to switch to the priority drive mode, and the user may select whether to enable or disable the priority drive mode.

[0232] Furthermore, in the viewing mode, in order to switch to the priority drive unit mode, the priority drive mode button 507 in FIG. 8 is always displayed on the display image 500. The display location may be superimposed as shown in FIG. 8. In this case, the priority drive mode button 507 is displayed on all images 501 to 504. When the user selects the priority drive mode button 507, the priority drive mode button 507 switches the imaging units 110, 120, 130, and 140 corresponding to the images 501 to 504 displayed on the OSD to the priority drive mode.

[0233] Furthermore, the priority drive mode button 507 may be displayed in an area other than the captured images 501 to 504. In this case, it is desirable to arrange the priority drive mode button 507 near each of the images 501 to 504 corresponding to the imaging units 110, 120, 130, and 140, respectively, so that the corresponding imaging units 110, 120, 130, and 140 are clearly visible.

[0234] Furthermore, if it is not possible to arrange the priority drive mode buttons 507 near the images 501 to 504, the priority drive mode buttons 507 may be arranged with different notation for each of the imaging units 110, 120, 130, and 140. Alternatively, the CPU 180 may perform control to display a graphical user interface for selecting the imaging unit 110, 120, 130, and 140, and the priority drive mode button 507 may be applied to the selected imaging unit.

[0235] Here, an example has been shown in which the priority drive mode button 507 can be selected for each of the image capture units 110, 120, 130, and 140, but it would also be possible to allow the user to select the image capture units 110, 120, 130, and 140 on which to place the priority drive mode button 507. The display area can be increased by the area of ​​the priority drive mode buttons 507 that are not placed.

[0236] For example, by selecting the priority drive mode button 507 corresponding to the image 501, the CPU 180 sets the image capture unit 110 corresponding to the image 501 as the operation target in the operation area 601. In this case, the other image capture units 120, 130, and 140 are not the operation targets. The pan button 721 and the pan button 722 are buttons for operating the pan drive unit 114 of the image capture unit 110 that is the operation target (movement target).

[0237] The pan driving units 114, 124, 134, and 144 control the positions of the imaging units 110, 120, 130, and 140 on the circumference 102. The imaging units 110, 120, 130, and 140 in FIG.

[0238] The CPU 180 functions as a display control unit, and controls the display unit 203 to display an operation area 601 of a GUI for selecting one of the plurality of image capturing units 110, 120, 130, and 140 as an image capturing unit to be moved.

[0239] As described above, the CPU 180 functions as an instruction unit and instructs the imaging units 110, 120, 130, and 140 that are not the target of movement to be moved so as to expand the movable range of the imaging unit that is the target of movement selected on the GUI of the operation area 601 among the multiple imaging units 110, 120, 130, and 140. The CPU 180 instructs the imaging unit that is the target of movement to be moved in response to the operation of the pan buttons 721 and 722.

[0240] As described above, CPU 180 can set the priorities of the multiple imaging units 110, 120, 130, and 140. If the priority of an imaging unit that is not the target of movement is lower than the priority of an imaging unit that is the target of movement, CPU 180 instructs the imaging unit that is not the target of movement to be moved. Furthermore, if the priority of an imaging unit that is not the target of movement is higher than the priority of an imaging unit that is the target of movement, CPU 180 does not instruct the imaging unit that is not the target of movement to be moved.

[0241] As described above, the priority of an imaging unit to be moved can be set higher than the priority of an imaging unit that is not to be moved. Furthermore, the CPU 180 can set the priority of the multiple imaging units 110, 120, 130, and 140 in response to a user operation.

[0242] If the priority of the imaging unit to be moved is higher than the priority of all imaging units that are not to be moved, the CPU 180 instructs the imaging unit to be moved in response to operation of the pan buttons 721 and 722.

[0243] Furthermore, if the priority of the imaging unit to be moved is lower than the priority of any of the imaging units that are not to be moved, the CPU 180 will not instruct the imaging unit to be moved in response to the operation of the pan buttons 721 and 722.

[0244] Pan buttons 721 and 722 are GUIs for moving the imaging unit selected in response to a user operation of the priority drive mode button 507 .

[0245] As described above, according to this embodiment, when the user moves the imaging unit selected from the plurality of imaging units 110, 120, 130, and 140, operability can be improved.

[0246] (Fourth embodiment) In the third embodiment, a method for controlling an imaging unit other than the object detection camera was described, but an imaging unit other than the object detection camera may capture an image in a direction that the user does not expect. Therefore, in the fourth embodiment, a method for switching the selection of an imaging unit by limiting the driving range of the object detection camera will be described.

[0247] Control of switching the selection of the imaging unit of the object detection camera will be described with reference to Fig. 14 and Fig. 15. A method of switching the selection of the imaging unit that is the object detection camera will be described with reference to Fig. 14 and Fig. 15.

[0248] 14(a) and (b) are diagrams showing an example of a display for switching the selection of the imaging unit of the object detection camera according to the fourth embodiment. In comparison with FIGS. 9(a) and (b), Figures 14(a) and (b) show a state in which the moving object 505 moves in the clockwise direction of the pan driving unit 114 relative to the imaging unit 110, and the user operates the pan button 721 in accordance with the movement of the moving object 505.

[0249] At this time, the imaging unit 110 can drive the pan driving unit 114 up to the point where it interferes with the imaging unit 120. However, because of the imaging unit 120, the imaging unit 110 cannot move clockwise any further. Figures 14(a) and (b) show a state in which the moving object 505 continues to move, moves out of the imaging area of ​​the imaging unit 110, and enters the image 502 of the imaging area of ​​the imaging unit 120.

[0250] Here, if the imaging unit 110 is driven to a position just before it interferes with the imaging unit 120 (or if the user continues to operate the pan button 721 even though it is at a position where it cannot be driven any further), the selection of the imaging unit is switched.

[0251] At this time, it is desirable to notify the user that the image capture unit selection will be switched before switching the image capture unit selection, and an example of such a display is shown in Fig. 14(b). In Fig. 14(b), a display that makes it clear that switching will be made is displayed within the display image 500.

[0252] An arrow 643 indicates the image before switching (image 501) and the image after switching (image 502), so that it is clear that the object detection camera is being switched. Similarly, an arrow 644 in the image capture unit selection panel 611 indicates the image capture unit selection button 711 and the image capture unit selection button 712 before switching.

[0253] Furthermore, if the user does not want to switch, the CPU 180 controls to display a stop button 645 so that the user can cancel the switching. If the stop button 645 is selected by the user, the imaging units are not switched.

[0254] Furthermore, if a certain period of time has passed without the cancel button 645 being selected, the selected imaging unit is switched. Furthermore, if the user wishes to switch immediately, the user can select the switch button 646 to switch the selected imaging unit immediately.

[0255] An example of a display after switching the selection of an imaging unit will be described with reference to Figures 15(a) and (b). Figures 15(a) and (b) are diagrams showing an example of a display after switching the selection of an imaging unit according to the fourth embodiment. In Figures 15(a) and (b), the imaging unit 110 (imaging unit selection button 711) that was previously selected as the object detection camera is released, and the imaging unit 120 (imaging unit selection button 712) is selected as a new object detection camera that can be operated.

[0256] The imaging unit selection button 712 is in a selected state, and the pan driving unit 124, tilt driving unit 126, and rotation driving unit 127 of the imaging unit 120 become drivable.

[0257] 15(b), the displayed images may be swapped between image 501 and image 502. This allows the user to widen the imaging range of the object detection camera.

[0258] 14 and 15 will be described with reference to the flowchart of FIG. 16. FIG. 16 is a flowchart showing a control method for the imaging device 100 according to the fourth embodiment. This flowchart is realized by the CPU 180 of the imaging device 100 executing a program loaded in RAM. The flowchart of FIG. 16 adds steps S801, S802, S803, S804, S805, S806, and S807 to the flowchart of FIG. 6. Steps S801, S802, S803, S804, S805, S806, and S807 are all steps in the priority drive mode. Where the description of FIG. 16 overlaps with that of FIG. 6, the description will be omitted.

[0259] First, imaging device 100 performs the processes of steps S401 to S405, similar to Fig. 6. Then, in step S801, CPU 180 determines whether or not imaging unit 110 of the object detection camera is located in a position just before interference with another imaging unit 120, as shown in Fig. 14(a). If not located in a position just before interference, the object detection camera can be driven, so there is no need to switch the selection of the imaging unit, and the process proceeds to step S406. If located in a position just before interference, the process proceeds to step S802 to determine whether or not to switch the selection of the imaging unit.

[0260] If the movement of the imaging unit 110 of the object detection camera on the circumference 102 is restricted, the CPU 180 may proceed to step S802.

[0261] In step S802, the CPU 180 controls the display unit 203 to display the switch button 646 and the cancel button 635 of the GUI for switching the imaging unit, as shown in FIG. 14(b), and notifies the user.

[0262] In step S803, the CPU 180 determines whether or not the stop button 645 has been selected, as shown in Fig. 14(b). If the stop button 645 has not been selected, the process proceeds to step S804. If the stop button 645 has been selected, the process proceeds to step S807, where the selection of the imaging unit is not switched and the display of the switch is hidden.

[0263] In step S804, the CPU 180 determines whether or not the switching button 646 has been selected by a user operation, as shown in Fig. 14(b). If the switching button 646 has not been selected, the process proceeds to step S805. If the switching button 646 has been selected, the process proceeds to step S806, where the selection of the imaging unit is switched.

[0264] In step S805, CPU 180 determines whether a certain period of time has elapsed since the processing of step S802. If the certain period of time has elapsed, the processing proceeds to step S806, where the selection of the imaging unit is switched. If the certain period of time has not elapsed, the processing returns to step S803, where the processing waits for a user selection.

[0265] In step S806, the CPU 180 controls the display unit 203 to display a display image 500 for switching the selection of the imaging unit as shown in FIG. 15(b).

[0266] For example, when movement of the imaging unit 110 of the object detection camera in a first direction on the circumference 102 is restricted, the CPU 180 controls to display an operation area 601 in which the shooting area of ​​the imaging unit 120 adjacent to the imaging unit 110 of the object detection camera in the first direction on the circumference 102 can be changed.

[0267] Furthermore, when movement of imaging unit 110 of the object detection camera in the first direction on circumference 102 is restricted, CPU 180 performs control to swap the display positions of the image of imaging unit 110 of the object detection camera and the image of imaging unit 120 adjacent in the first direction. Thereafter, the process proceeds to step S807.

[0268] In step S807, CPU 180 controls display unit 203 to change the GUI for switching image capture unit selection displayed in step S802 to hidden. Specifically, CPU 180 controls display unit 203 to not display arrow 643, arrow 644, cancel button 645, and switch button 646.

[0269] In this way, when the object detection camera interferes with other imaging units and the driving range is restricted, by controlling the switching of the selection of the imaging unit (the imaging unit interfering with the object detection camera), the driving range of the object detection camera is expanded, improving operability for the user.

[0270] <Supplementary explanation> FIG. 14(b) shows an example in which the moving object 505 moves from image 501 to image 502, but it is possible to switch the selection of the imaging unit even if the imaging position of the moving object 505 does not change.

[0271] Furthermore, when the moving object 505 moves from image 501 to image 502, object detection is performed by the image capturing unit 120, and therefore the image capturing unit 120 that captured the moving object 505 may be used as the object detection camera to switch the selection of the image capturing unit. This allows the user to select the image capturing unit without switching the selection of the image capturing unit.

[0272] Although it has been described that the selected imaging unit is switched when the imaging unit 110 is positioned just before interfering with the imaging unit 120 (or when the user continues to operate the pan button 721 even though the imaging unit 110 is in a position where it cannot be driven any further), the present invention is not limited to this. The condition for switching the selected imaging unit may also be when there is another imaging unit near the object detection camera (when the position of the pan driver is equal to or less than the threshold), or when the operated pan driver of the object detection camera interferes with another imaging unit.

[0273] 14(b) shows an example in which the user selects the switch button 646 to instantly switch the selection of the imaging unit, but other buttons may be used instead. For example, even in a situation in which the imaging unit 110 cannot be moved clockwise by the imaging unit 120, if the pan button 721 is continuously pressed, the same determination is made as when the switch button 646 is selected. This makes it possible for the user to capture the imaging area that they wish to operate.

[0274] 14(b) shows an example in which the switch button 646 and the cancel button 645 are displayed simultaneously, but this is not limiting. Only the switch button 646 may be displayed, and the switching may be canceled if no selection is made for a certain period of time. Alternatively, only the cancel button 645 may be displayed, and the switching may be performed if no selection is made for a certain period of time. Alternatively, the switch button 646 and the cancel button 645 may not be displayed, and the switching may be forced.

[0275] The method of switching from the browsing mode to the priority drive mode using the priority drive mode button 507 shown in FIG. 8(b) of the first embodiment can also be modified in a similar manner. A cancel button may be displayed simultaneously with the priority drive mode button 507, or only one of them may be displayed. Alternatively, the button may not be displayed and the mode may be forcibly switched to the priority drive mode. As with the fourth embodiment, the switching may be performed or canceled if the button is not selected for a certain period of time.

[0276] In step S805 of FIG. 16, it has been explained that when a certain period of time has elapsed, the process proceeds to step S806 and the selected image capture unit is switched, but the process may proceed to step S807 and no switching is performed.

[0277] It is also desirable to align the shooting conditions of the imaging units other than the object detection camera to be switched with those of the object detection camera. The shooting conditions include the positions of the tilt drive unit, rotation drive unit, zoom drive unit, and focus drive unit. It is also desirable to align the exposure, gain, shutter speed, white balance, and so on. The timing for alignment is when the switch button 646 in FIG. 14(b) is displayed or when the switch button 646 in FIG. 14(b) is selected.

[0278] As described above, according to the first to fourth embodiments, the imaging system 190 has a plurality of imaging units 110, 120, 130, and 140, and when an object is detected, the operability of changing the imaging area of ​​the imaging unit can be improved.

[0279] (Other embodiments) The present disclosure can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program. The present disclosure can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0280] Although the preferred embodiments have been described above, the present invention is not limited to these embodiments and various modifications and changes are possible within the scope of the gist thereof.

[0281] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) a display control means for controlling the display unit to display a graphical user interface for selecting one of the plurality of imaging units as a moving target; and an instruction means for instructing the imaging device to move an imaging unit among the plurality of imaging units that is not a target to be moved so as to widen the movable range of the imaging unit that is the target to be moved and that is selected on the graphical user interface among the plurality of imaging units. (Configuration 2) 2. The control device according to configuration 1, wherein the instruction means instructs the imaging device to move the imaging unit that is the object to be moved in response to an operation on the graphical user interface. (Configuration 3) the plurality of imaging units are capable of moving independently on the same circumference; The control device according to configuration 1 or 2, characterized in that, when movement of the imaging unit to be moved in a first direction on the circumference is restricted, the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in a second direction on the circumference opposite to the first direction on the circumference, in the second direction on the circumference. (Configuration 4) the plurality of imaging units are capable of moving independently on the same circumference; The control device according to configuration 1 or 2, wherein the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in a first direction on the circumference in the first direction on the circumference. (Configuration 5) The control device according to configuration 4, wherein the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in a second direction on the circumference opposite to the first direction. (Configuration 6) the plurality of imaging units are capable of moving independently on the same circumference; The control device according to configuration 1 or 2, characterized in that when an instruction is given through operation of the graphical user interface to move the imaging unit that is the object to be moved in a first direction on the circumference, the instruction means instructs the imaging device to move the imaging unit that is the object to be moved in the first direction and to move an imaging unit adjacent to the imaging unit that is the object to be moved in the first direction in the first direction. (Configuration 7) 7. The control device according to configuration 6, wherein the adjacent imaging unit moves at a speed equal to or greater than the speed of the imaging unit to be moved. (Configuration 8) The instruction means setting priorities of the plurality of imaging units; instructing the imaging device to move the imaging unit that is not the object to be moved when the priority of the imaging unit that is not the object to be moved is lower than the priority of the imaging unit that is the object to be moved; The control device according to any one of configurations 1 to 7, characterized in that when the priority of the imaging unit that is not to be moved is higher than the priority of the imaging unit that is to be moved, the control device does not instruct the imaging device to move the imaging unit that is not to be moved. (Configuration 9) 9. The control device according to configuration 8, wherein the priority of the imaging unit that is the moving target is higher than the priority of the imaging unit that is not the moving target. (Configuration 10) 9. The control device according to configuration 8, wherein the instruction means sets priorities of the plurality of imaging units in response to a user operation. (Configuration 11) The instruction means instructing the imaging device to move the imaging unit to be moved in response to an operation of the graphical user interface when the priority of the imaging unit to be moved is higher than the priority of all imaging units among the imaging units that are not to be moved; The control device according to any one of configurations 8 to 10, characterized in that when the priority of the imaging unit to be moved is lower than the priority of any of the imaging units that are not to be moved, the control device does not instruct the imaging device to move the imaging unit to be moved in response to operation of the graphical user interface. (Configuration 12) 12. The control device according to any one of configurations 1 to 11, wherein the graphical user interface is a graphical user interface for moving an imaging unit selected in response to a user operation. (Configuration 13) 13. The control device according to any one of configurations 1 to 12, wherein it is possible to set whether or not to fix the position of each of the plurality of imaging units for each of the imaging units. (Configuration 14) The control device according to any one of configurations 1 to 13, characterized in that the instruction means instructs the imaging device to return the positions of all of the imaging units of the plurality of imaging units to the positions they had immediately before the display of the graphical user interface when an instruction to end the display of the graphical user interface is given or after a predetermined time has elapsed since the display of the graphical user interface. (Configuration 15) 15. The control device according to any one of configurations 1 to 14, wherein the plurality of imaging units are provided outside the control device. (Configuration 16) 16. The control device according to any one of configurations 1 to 15, wherein the display control means controls the display unit to display images captured by the plurality of imaging units. (Method 1) a display control step of controlling the display unit to display a graphical user interface for selecting one of the plurality of imaging units as a moving target; and an instruction step of instructing the imaging device to move an imaging unit among the plurality of imaging units that is not a target to be moved so as to widen the movable range of the imaging unit that is a target to be moved and that is selected on the graphical user interface among the plurality of imaging units. (Program 1) A program for causing a computer to function as the control device according to any one of configurations 1 to 16. [Explanation of symbols]

[0282] 100 imaging device; 110, 120, 130, 140 imaging unit; 113, 123, 133, 143 drive unit; 114, 124, 134, 144 pan drive unit; 115, 125, 135, 145 zoom drive unit; 116, 126, 136, 146 tilt drive unit; 117, 127, 137, 147 rotation drive unit; 118, 128, 138, 148 focus drive unit; 151 image processing unit; 152, 202 control unit; 153, 201 communication unit; 154, 205 recording unit; 200 client device; 203 display unit; 204 instruction unit

Claims

1. a display control means for controlling the display unit to display a graphical user interface for selecting one of the plurality of imaging units as a moving target; and an instruction means for instructing the imaging device to move an imaging unit among the plurality of imaging units that is not a target to be moved so as to widen the movable range of the imaging unit that is the target to be moved and that is selected on the graphical user interface among the plurality of imaging units.

2. 2. The control device according to claim 1, wherein the instruction means instructs the imaging device to move the imaging unit that is the object to be moved in response to an operation on the graphical user interface.

3. the plurality of imaging units are capable of moving independently on the same circumference; The control device according to claim 1, characterized in that, when the movement of the imaging unit to be moved in a first direction on the circumference is restricted, the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in a second direction on the circumference opposite to the first direction on the circumference.

4. the plurality of imaging units are capable of moving independently on the same circumference; 2. The control device according to claim 1, wherein the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in the first direction on the circumference.

5. The control device according to claim 4, characterized in that the instruction means instructs the imaging device to move an imaging unit adjacent to the imaging unit to be moved in a second direction on the circumference opposite to the first direction.

6. the plurality of imaging units are capable of moving independently on the same circumference; 2. The control device according to claim 1, wherein, when an instruction is given by operating the graphical user interface to move the imaging unit to be moved in a first direction on the circumference, the instruction means instructs the imaging device to move the imaging unit to be moved in the first direction and to move an imaging unit adjacent to the imaging unit to be moved in the first direction in the first direction.

7. The control device according to claim 6 , wherein the adjacent imaging unit moves at a speed equal to or greater than that of the imaging unit to be moved.

8. The instruction means setting priorities of the plurality of imaging units; instructing the imaging device to move the imaging unit that is not the object to be moved when the priority of the imaging unit that is not the object to be moved is lower than the priority of the imaging unit that is the object to be moved; 2. The control device according to claim 1, wherein when the priority of the imaging unit that is not the object of movement is higher than the priority of the imaging unit that is the object of movement, the control device does not instruct the imaging device to move the imaging unit that is not the object of movement.

9. 9. The control device according to claim 8, wherein the priority of the imaging unit that is the moving target is higher than the priority of the imaging unit that is not the moving target.

10. The control device according to claim 8 , wherein the instruction unit sets priorities of the plurality of image capturing units in response to a user operation.

11. The instruction means instructing the imaging device to move the imaging unit to be moved in response to an operation of the graphical user interface when the priority of the imaging unit to be moved is higher than the priority of all imaging units among the imaging units that are not to be moved; The control device according to claim 8, characterized in that if the priority of the imaging unit to be moved is lower than the priority of any of the imaging units that are not to be moved, the control device does not instruct the imaging device to move the imaging unit to be moved in response to operation of the graphical user interface.

12. 2. The control device according to claim 1, wherein the graphical user interface is a graphical user interface for moving an imaging unit selected in response to a user operation.

13. 2. The control device according to claim 1, wherein it is possible to set whether or not the position of each of the plurality of imaging units is fixed for each of the imaging units.

14. The control device according to claim 1, characterized in that the instruction means instructs the imaging device to return the positions of all of the multiple imaging units to their positions immediately before the display of the graphical user interface when an instruction to end the display of the graphical user interface is given or after a predetermined time has elapsed since the display of the graphical user interface.

15. The control device according to claim 1 , wherein the plurality of image capturing units are provided outside the control device.

16. 2. The control device according to claim 1, wherein the display control means controls the display unit to display images captured by the plurality of image capturing units.

17. a display control step of controlling the display unit to display a graphical user interface for selecting one of the plurality of imaging units as a moving target; and an instruction step of instructing the imaging device to move an imaging unit among the plurality of imaging units that is not a target to be moved so as to widen the movable range of the imaging unit that is a target to be moved and that is selected on the graphical user interface among the plurality of imaging units.

18. A program for causing a computer to function as the control device according to any one of claims 1 to 16.

Images