Information processing device, imaging system, information processing method, and program

Abstract

The imaging system has poor operability, leading to errors. [Solution] The information processing device is an information processing device that accepts user operations for driving a plurality of imaging means, and has a UI generation means for generating an operation screen for accepting the user operations, and the UI generation means generates an operation screen that includes a first user interface for accepting input of the amount of drive of the imaging means and displays the amount of drive, and a second user interface for displaying the position of the imaging means, along with at least one of the drive position corresponding to the amount of drive and the amount of drive up to the drive range that the imaging means can drive.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an imaging system, an information processing method, and a program.

Background Art

[0002] In an imaging system including an imaging unit such as a camera, an imaging system including a drive mechanism for driving a member such as the imaging unit or a lens of the imaging unit is known. For example, Patent Document 1 discloses a technology of an imaging system also called a multi-eye camera that independently moves a plurality of imaging devices. In the technology of Patent Document 1, by pressing a button marked with an arrow on a user interface (UI), the user can drive the selected imaging device in the direction of the arrow (clockwise or counterclockwise).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] [[ID=�4]] In the technology of Patent Document 1, although the imaging device can be driven in the direction of the arrow indicated by the button, it is difficult for the user to recognize the driving amount of the imaging unit to be driven, and there are problems such as low operability and causing misoperations.

[0005] Therefore, the present invention provides a technology of an imaging system with high operability and capable of suppressing misoperations.

Means for Solving the Problems

[0006] To solve this problem, for example, the information processing apparatus of the present invention has the following configuration. That is, An information processing device that accepts user input for driving multiple imaging means, The system includes a UI generation means for generating an operation screen that accepts user input, The UI generation means is A first user interface that displays the drive amount for receiving input of the drive amount of the imaging means, A second user interface that displays, along with the position of the imaging means, at least one of the drive position corresponding to the drive amount and the drive amount up to the drive range in which the imaging means can be driven, Generates an operation screen that includes this information. [Effects of the Invention]

[0007] The present invention provides a technology for an imaging system that offers high operability and suppresses errors. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram showing the functional configuration of the imaging system according to the first embodiment. [Figure 2] A plan view showing the arrangement and operation of the imaging device as seen from above in the first embodiment. [Figure 3] A diagram of the position display UI of the first embodiment. [Figure 4] A diagram of the imaging unit designation UI and position display UI of the first embodiment. [Figure 5] A diagram of the imaging unit operation UI of the first embodiment. [Figure 6] A diagram showing the image displayed on the display unit of the first embodiment. [Figure 7] A diagram of a UI screen including an image and UI displayed on the display unit of the first embodiment. [Figure 8] A diagram showing the scale display of the position display UI of the first embodiment. [Figure 9] A diagram showing a modified example of the scale display of the position display UI of the first embodiment. [Figure 10] A block diagram showing the functional configuration of the imaging system according to the second embodiment. [Figure 11]Diagram of the scale display of the position display UI of the second embodiment. [Figure 12] Diagram showing the flowchart of the image display processing of the imaging system of the second embodiment. [Figure 13] Block diagram showing the functional configuration of the imaging system of the third embodiment. [Figure 14] Diagram for explaining the tilt drive of the imaging unit by the tilt drive unit of the third embodiment. [Figure 15] Diagram for explaining the rotation drive of the imaging unit by the rotation drive unit of the third embodiment. [Figure 16] Example of the scale display other than the pan drive unit of the third embodiment. [Figure 17] Example of the UI displayed on the display unit of the third embodiment. [Figure 18] Block diagram showing the hardware configuration of the control unit. [Figure 19] Diagram showing the scale display of the circular position display UI of the first embodiment.

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] (First Embodiment) <Scale Display of the Driveable Drive Amount> The configuration of the imaging system according to the first embodiment of the present invention will be described below with reference to Figure 1. Figure 1 is a block diagram showing the functional configuration of the imaging system 300. The imaging system 300 includes an imaging device 100 and a client device 200. Based on user instructions from the client device 200, the imaging system 300 generates images by capturing images of a subject from different positions and directions using the imaging device 100, and transmits these images to the client device 200. In the following description, the term "image" may include still images, moving images, video footage, and their data.

[0011] <Client device> The client device 200 is an example of an information processing device, and is a device that includes a computer, such as a Personal Computer (hereinafter referred to as PC). The client device 200 may also supply power to the imaging device 100 via the network 180.

[0012] The client device 200, for example, displays a user interface (hereinafter referred to as UI) to receive operation requests for the imaging device 100 from the user. The client device 200 includes a communication unit 201, a control unit 202, a display unit 203, an instruction unit 204, and an image generation unit 208 including a UI generation unit 210. The communication unit 201 of the client device 200 can communicate with the imaging device 100 via the network 180.

[0013] The image generation unit 208 generates an image and displays it on the display unit 203. The image generation unit 208 may be a processor such as a GPU (Graphics Processing Unit), or one or more circuits such as an ASIC (Application Specific Integrated Circuit). Alternatively, the image generation unit 208 may be one of the functions implemented by the control unit 202 after reading a program. For example, the image generation unit 208 generates an image for display using image data transmitted from the imaging device 100. The image generation unit 208 also has a UI generation unit 210 that generates UI (User Interface) images to be displayed on the display unit 203. For example, when the UI generation unit 210 receives a control signal from the imaging device 100, it generates a UI (hereinafter referred to as the imaging unit operation UI) that accepts an operation to drive the imaging units 110 and 120 via the drive units 113 and 123 (described later), a UI for displaying the positions of the imaging units 110 and 120 (hereinafter referred to as the position display UI), and a UI for specifying the imaging unit 110 and 120 to be driven (hereinafter referred to as the imaging unit specification UI). Each UI screen will be described later. The imaging unit operation UI is an example of the first user interface. The position display UI is an example of the second user interface.

[0014] The UI generation unit 210 may also be located within the image processing unit 130 of the imaging device 100. In this case, one of the imaging unit operation UI, position display UI, or imaging unit designation UI generated by the image processing unit 130 is sent to the client device 200 via the network 180 and displayed on the display unit 203.

[0015] The instruction unit 204 receives user input (user operation) via input devices such as a mouse and keyboard. The instruction unit 204 outputs the received operation to the control unit 202.

[0016] The control unit 202 may be a computer. The control unit 202 is responsible for the overall control of the client device 200. Based on the operations obtained from the instruction unit 204, the control unit 202 generates control signals to control the imaging device 100. These control signals are, for example, signals to control the first drive unit 113 and the second drive unit 123. That is, the user controls the first imaging unit 110 and the second imaging unit 120 independently from the client device 200 via the network 180.

[0017] The display unit 203 is a display device such as an organic EL (Electro-Luminescence) display or a liquid crystal display. The display unit 203 displays display images transmitted from the imaging device 100, as well as UI screens including an imaging unit operation UI, a position display UI, and an imaging unit selection UI.

[0018] <Network> Network 180 includes wired LAN (Local Area Network) and wireless LAN, etc. Network 180 relays the transmission and reception of signals between the client device 200 and the imaging device 100.

[0019] <Imaging device> The imaging device 100 may be a digital camera or the like that transmits image data to a device such as a client device 200. The imaging device 100 includes a first imaging unit 110 and a second imaging unit 120, a first drive unit 113, a second drive unit 123, an image processing unit 130, a control unit 140, a position detection unit 150, a communication unit 160, and a collision detection unit 170. The communication unit 160 of the imaging device 100 is connected to the client device 200 via a network 180. As a result, the imaging device 100 transmits captured image data to the client device 200 and receives control signals from the client device 200.

[0020] <Photography Department> The first imaging unit 110 captures a subject and generates an electrical signal that becomes image data. The first imaging unit 110 includes an imaging optical system 111 and a solid-state image sensor 112. The imaging optical system 111 transmits light from the subject and forms an image on the solid-state image sensor 112. The solid-state image sensor 112 may be a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, etc. The solid-state image sensor 112 converts the formed light into an electrical signal and outputs it to the image processing unit 130.

[0021] The image processing unit 130 processes the electrical signals acquired from the imaging units 110 and 120 and outputs them as image data. The second imaging unit 120 has an imaging optical system 121 and a solid-state image sensor 122, and operates in the same manner as the first imaging unit 110, so its description is omitted. The driving of the solid-state image sensors 112 and 122 and the reading of signals are controlled by the control unit 140.

[0022] <Pan drive unit> The first drive unit 113 has a first pan drive unit 114. The second drive unit 123 has a second pan drive unit 124. The first pan drive unit 114 and the second pan drive unit 124 each control the imaging direction of the first imaging unit 110 and the second imaging unit 120 in the same plane (XY plane). For example, the pan drive units 114 and 124 drive the imaging units 110 and 120 on the pan drive circumference. Multiple pan drive units 114 and 124 are an example of multiple drive means.

[0023] Figure 2 is a plan view showing the arrangement and operation of the imaging device 100 as seen from above (+Z axis side). Referring to Figure 2, the pan drive and imaging direction control of the imaging unit by the pan drive unit of the first embodiment, and collision determination will be described. The function of the collision detection unit 170 may be implemented by the control unit 140. The plane including the XY direction indicated by the arrows in Figure 2 (XY plane) is, for example, the horizontal plane. The Z axis is, for example, the vertical direction. In the following description of pan drive, the first imaging unit 110 will be described as the target for pan drive. The first pan drive unit 114 and the second pan drive unit 124 each include a motor and a gear.

[0024] Figure 2(a) is a diagram illustrating the drive range of the first imaging unit 110. Specifically, Figure 2(a) shows the range in which the first imaging unit 110 can be driven, depending on the positional relationship between the imaging units 110 and 120 on the pan drive circumference 102 or their positional relationship with the pan drive end 103.

[0025] As shown in Figure 2(a), the first pan drive unit 114 drives the pan by controlling the power that drives the motor, using the pan axis 101, which is parallel to the Z-axis, as the axis of rotation (also called the drive axis) to rotate the first imaging unit 110 around the axis of rotation. The power that drives the motor of the first pan drive unit 114 may be controlled by the control unit 140. The second pan drive unit 124 rotates the second imaging unit 120 around the pan axis 101. Therefore, the first imaging unit 110 and the second imaging unit 120 move on a common pan drive circumference 102 with the same pan axis 101 as the axis of rotation. The pan drive end 103, which is the limit of the driving range of the pan drive units 114 and 124, may be on the pan drive circumference 102.

[0026] Since the imaging device 100 can simultaneously and independently control one or more pan drive units 114, 124, each imaging unit 110, 120 can be driven independently. Furthermore, since all imaging units 110, 120 are driven on a common pan drive circumference 102, the relative positions of the imaging units 110, 120 will not be reversed.

[0027] Here, the range in which the first imaging unit 110 can be driven toward the second imaging unit 120 is defined as the inter-imaging unit driveable range 107. The inter-imaging unit driveable range 107 is an example of the positional relationship with adjacent imaging means. The range in which the first imaging unit 110 can be driven toward the pan drive end 103 is defined as the pan drive end driveable range 108. One end of the driveable range is an example of the limit position. The pan drive end driveable range 108 is an example of the positional relationship with the limit position. The combined range of the inter-imaging unit driveable range 107 and the pan drive end driveable range 108 is defined as the driveable range 109. The driveable range 109 changes depending on the positional relationship with adjacent imaging units 120 or pan drive end 103.

[0028] Figure 2(b) illustrates the state in which the imaging units 110 and 120 are approaching each other. Specifically, Figure 2(b) shows the case when the first imaging unit 110 is driven in the direction of approaching the second imaging unit 120, and the driveable range 107 between the imaging units falls below a predetermined threshold. At this time, the collision detection unit 170 determines that it is "not possible to drive", and the first imaging unit 110 cannot be driven clockwise on the pan drive circumference 102.

[0029] Figure 2(c) shows the state in which the first imaging unit 110 is approaching the pan drive end 103. Specifically, Figure 2(c) shows the case when the first imaging unit 110 is driven in the direction approaching the pan drive end 103, and the driveable range 108 of the pan drive end falls below a predetermined threshold. At this time, the collision detection unit 170 determines that it is "not possible to drive", and the first imaging unit 110 cannot be driven counterclockwise on the pan drive circumference 102. Thus, even if there is no physical contact between the imaging units 110 and 120, if it is in a "not possible to drive" state, it will be described as a collision state.

[0030] <Position detection unit> The position detection unit 150 detects the positions of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102 and notifies the control unit 140 and the collision detection unit 170 of the position detection result. The position detection unit 150 may detect the position by moving the positions of the first imaging unit 110 and the second imaging unit 120 to a specific position on the pan drive circumference 102, such as the pan drive end, when the imaging device 100 is powered on or during initialization, and counting the number of times drive pulses are generated from that position. The position detection unit 150 may also detect the position using a photo interrupter and an encoder or the like. In this way, the distance or angle between the imaging units 110 and 120 can be calculated from the position detected by the position detection unit 150. Not limited to the pan drive units 114 and 124, the position of other drive units, as shown in the third embodiment described later, can also be calculated in the same way.

[0031] <Collision detection unit> The collision detection unit 170 determines whether or not the imaging units 110 and 120 can be driven based on the positions of the imaging units 110 and 120 and the position of the drive end. For example, the collision detection unit 170 acquires the positions of the imaging units 110 and 120 detected by the position detection unit 150. Based on these positions, the collision detection unit 170 determines that "driving is not possible" if the driveable range between imaging units 107 or the driveable range of the pan drive end 108 falls below a predetermined first threshold or second threshold. The collision detection unit 170 notifies the control unit 140 of the determination result. Figure 2(b) shows the situation when the driveable range between imaging units 107 falls below the first threshold. The first and second thresholds may be preset values, or any of the discrete drive amounts, X1, X2, and X3, indicated by the pan button 631 of the imaging unit operation UI 205 (see Figure 5). The control unit 140 may calculate the driveable range between imaging units 107 and the driveable range at the pan drive end 108 based on the position information of the first imaging unit 110 and the second imaging unit 120 detected by the position detection unit 150. Either the position detection unit 150 or the collision detection unit 170 may calculate the driveable range between imaging units 107 and the driveable range at the pan drive end 108. Furthermore, sensors for detecting the distance between imaging units 110 and 120 may be provided.

[0032] <Communications Department> The communication unit 160 transfers image data sent from the image processing unit 130 or position information of the first imaging unit 110 or the second imaging unit 120 detected by the position detection unit 150 to the client device 200 via a network 180 such as a wired LAN or wireless LAN.

[0033] <Department Head> The control unit 140 may be a computer. The control unit 140 controls the first imaging unit 110, the second imaging unit 120, the first drive unit 113, the second drive unit 123, the image processing unit 130, the position detection unit 150, the communication unit 160, and the collision detection unit 170.

[0034] Figure 18 is a block diagram showing the hardware configuration of a control device 185, which is an example of the control unit 202 of the client device 200. The control device 185 is an example of a computer. The control device 185 of the control unit 202 has a processor 181, memory 182, storage 183, and a bus 187. The processor 181, memory 182, and storage 183 are connected to each other via the bus 187 so that they can send and receive information.

[0035] The processor 181 is an arithmetic processing unit, such as a CPU (Central Processing Unit). The control unit 185 may have other processors, such as an MPU (Micro Processing Unit), GPU (Graphics Processing Unit), NPU (Neural Processing Unit), and QPU (Quantum Processing Unit), in place of or in addition to the CPU. The processor 181 implements various functions by reading programs stored in the storage 183 and loading them into the memory 182. For example, the processor 181 may implement some or all of the functions of the image generation unit 208 and the UI generation unit 210 by reading programs. Some or all of the functions of the image generation unit 208 and the UI generation unit 210 may be implemented by one or more circuits, such as an ASIC (Application Specific Integrated Circuit) and a PLD (Programmable Logic Device) including an FPGA (Field Programmable Gate Array).

[0036] Memory 182 is a high-speed read / write storage device, such as RAM (Random Access Memory). Memory 182 functions as a work area when the processor 181 executes a program. Memory 182 temporarily stores the program and parameters necessary for program execution.

[0037] The storage 183 is a non-volatile storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage 183 retains computer programs (hereinafter referred to as programs), parameters necessary for program execution, and the results of program execution even when power is not supplied. The storage 183 stores, for example, user interface data generated by the UI generation unit 210.

[0038] Furthermore, the control unit 140 of the imaging device 100 may have the same configuration as the control device 185 of the control unit 202.

[0039] <Location display UI> Referring to Figure 3, a method for displaying the positions of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102 according to the first embodiment will be described. Figure 3 is a diagram of the position display UI 206 of the first embodiment. The position display UI 206 displays the positions of the imaging units 110 and 120, as well as at least one of the drive position corresponding to the discrete drive amount described later and the drive amount up to the drive range that the imaging units 110 and 120 can drive. Figure 3(a) is a diagram showing the position display UI 206 as a circle. Figure 3(b) is a diagram showing the position display UI 206 as a line. The position display UI 206 is a UI that displays the position information of the first imaging unit 110 and the second imaging unit 120 detected by the position detection unit 150 via the network 180 on the display unit 203. When the UI generation unit 210 receives a signal from the imaging device 100, it generates the position display UI 206. The control signal may be a signal relating to the position information of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102.

[0040] The position display UI 206 accepts user operations from the instruction unit 204. The position detection unit 150 acquires the positions of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102. The position of the first imaging unit 110 is displayed on the position display UI 206 by symbol 310. The position of the second imaging unit 120 is displayed on the position display UI 206 by symbol 320. The pan drive circumference 102 is displayed on the position display UI 206 by pan drive circumference symbol 331. The pan drive end 103 is displayed on the position display UI 206 by pan drive end symbol 332.

[0041] As shown in Figure 3(a), by displaying the position in a circular shape, the positions of the symbol 310 corresponding to the first imaging unit 110 and the symbol 320 corresponding to the second imaging unit 120 correspond to the actual positions of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102. Therefore, users can intuitively grasp the positional relationship between the imaging units 110 and 120. Furthermore, by representing the position display UI 206 in a linear shape as shown in Figure 3(b), the display space of the UI is reduced compared to when the position display UI 206 is represented in a circular shape, and the display image displayed on the display unit 203 can be made larger.

[0042] Figures 3(a) and 3(b) show examples where the position indicator UI206 is circular or linear, but its shape is not limited to a specific shape such as a circle or a line.

[0043] The symbols 310 of the first imaging unit 110 and 320 of the second imaging unit 120 may each have a number superimposed to identify them. In Figures 3(a) and 3(b), the number "1" is displayed as number 311 within the symbol 310 of the first imaging unit 110, and the number "2" is displayed as number 321 within the symbol 320 of the second imaging unit 120. When the first imaging unit 110 and the second imaging unit 120 are driven on the pan drive circumference 102 by user operation, the symbols 310 of the first imaging unit 110 and 320 of the second imaging unit 120 on the position display UI 206 also change in conjunction with the pan drive. The position display UI 206 displays the position of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference 102 and the progress of their drive.

[0044] <Image Unit Designated UI> Referring to Figure 4, the display method for selecting the imaging unit to be driven according to the first embodiment will be described. Figure 4 is a diagram of the imaging unit specification UI207 and position display UI206 of the first embodiment. Figure 4(a) is a diagram of the imaging unit specification UI207 of the first embodiment. Figure 4(b) is a diagram of the position display UI206 after the imaging unit has been specified. In Figure 4, the imaging unit specification UI207 and the position display UI206 are displayed as separate UIs. The imaging unit specification UI207 and the position display UI206 are generated by the UI generation unit 210 and displayed on the display unit 203.

[0045] The imaging unit selection UI 207 accepts mouse and keyboard operations from the user via the instruction unit 204. The user selects an imaging unit to be driven by inputting the number "1" superimposed on the symbol 310 of the first imaging unit 110 in the imaging unit selection UI 207, or the number "2" superimposed on the symbol 320 of the second imaging unit 120. The selection operation may also be performed by clicking with the mouse. Alternatively, the user may select the imaging unit to be driven by selecting the number "1" superimposed on the symbol 310 of the first imaging unit 110 or the number "2" superimposed on the symbol 320 of the second imaging unit 120 on the position display UI 206. Here, the imaging unit selected by the user is referred to as the first imaging unit 110. In this case, as shown in Figure 4, the UI generation unit 210 highlights the symbol 310 of the first imaging unit 110 with a thick line. This allows users to intuitively understand which imaging unit is selected by looking at the highlighted symbol on the imaging unit selection UI207 or the position display UI206.

[0046] The display format indicating that an imaging unit has been selected may be other than highlighting the symbol 310 of the first imaging unit 110 and the symbol 320 of the second imaging unit 120 with a thick line on the imaging unit designation UI207 or position display UI206. Other methods include filling them with color, changing the color, changing the shape of the symbols, or enclosing them in a shape. The UI generation unit 210 may also display a string indicating that an imaging unit is selected on the position display UI206. The imaging unit designation UI207 may be displayed as a UI integrated with the position display UI206.

[0047] The display methods described above also apply when the user selects two or more imaging units. For example, multiple symbols on the position display UI206 may be surrounded by the same color, enclosed in a shape, or highlighted with a thick line, similar to how they are displayed when only one imaging unit is selected.

[0048] <Image Unit Operation UI> Referring to Figure 5, the operation of the pan drive of the imaging unit using the imaging unit operation UI 205 according to the first embodiment will be described. Figure 5 is a diagram of the imaging unit operation UI 205 according to the first embodiment. The imaging unit operation UI 205 is a UI that accepts operations from input devices such as a mouse and keyboard via the instruction unit 204. The imaging unit operation UI 205 is generated by the UI generation unit 210 and displayed on the display unit 203. The imaging unit operation UI 205 is a UI that allows the user to operate the pan drive units 114 and 124 of the imaging device 100. The imaging unit operation UI 205 includes a plurality of pan buttons 631.

[0049] Figure 5(a) shows the pan buttons 631 on the imaging unit operation UI 205. The user can operate the pan drive units 114 and 124 via the pan buttons 631 to pan-drive the imaging units 110 and 120. Each of the multiple pan buttons 631 corresponds to a different drive amount. Therefore, based on the drive amount corresponding to the pan button 631 selected by the user, the control unit 140 controls one of the pan drive units 114 and 124 to drive the imaging units 110 and 120 selected by the user. The pan buttons 631 display discrete angle (°) relative values ​​as drive amounts, such as -X3, -X2, -X1, X1, X2, and X3 from left to right. The discrete angle here corresponds to the drive angle of the pan drive. For example, relative values ​​of discrete angles (°) to be driven, such as -30 (=-X3), -20 (=-X2), -10 (=-X1), 10 (=X1), 20 (=X2), and 30 (=X3), are displayed as the drive amount on each pan button 631 (not shown). Also, for example, positive numbers indicate clockwise rotation, and negative numbers indicate counterclockwise rotation.

[0050] As an example, Figure 5(a) shows the case where there are six discrete values ​​displayed on the pan button 631, namely -X3, -X2, -X1, X1, X2, and X3. However, the number of pan buttons 631 is not limited to a specific number. Similarly, the external shape of the imaging unit operation UI205 is not limited to a specific shape such as rectangle, square, or circle.

[0051] Figure 5(b) is a diagram showing the arrangement of imaging units 110 and 120 of the imaging device 100 as viewed from above (+Z axis side). In Figure 5(b), the first imaging unit 110 is driven on the pan drive circumference 102 with the pan axis 101 as the axis of rotation. In Figure 5(b), the second imaging unit 120 is omitted to explain the pan drive of the first imaging unit 110. The first imaging unit 110 before driving is represented by a dotted line 129. The user can select a predetermined drive amount by selecting from -X3, -X2, -X1, X1, X2, and X3 shown on the pan button 631 of the imaging unit specification UI 207. If the user selects the pan button 631, which shows X3 as the rightmost discrete value 209 among the multiple pan buttons, the first pan drive unit 114 drives the first imaging unit 110 clockwise by X3° on the pan drive circumference 102. For example, if X3 indicates a drive angle of 30°, the first pan drive unit 114 will pan the first imaging unit 110 clockwise by 30° on the pan drive circumference 102.

[0052] Figure 5(c) is a diagram of the position display UI 206 showing the movement of the first imaging unit 110 on the pan drive circumference. The symbol corresponding to the first imaging unit 110 before driving is represented by the dotted line 119. The UI generation unit 210, in conjunction with the movement of the first imaging unit 110 on the pan drive circumference 102, pan drives the symbol 310 of the first imaging unit 110 on the position display UI 206 on the pan drive circumference symbol 331 in the same direction and with the same amount of drive, and displays it at a position corresponding to the position of the first imaging unit 110.

[0053] <Image> Referring to Figure 6, the configuration of the image displayed on the display unit 203 according to the first embodiment will be described. Figure 6 is a diagram of the image displayed on the display unit 203. The image generation unit 208 displays each image on the display unit 203 based on the image data generated by the first imaging unit 110 and the second imaging unit 120 acquired from the imaging device 100. Figure 6(a) shows image 601 corresponding to the image data of the first imaging unit 110. Figure 6(b) shows image 602 corresponding to the image data of the second imaging unit 120. The image generation unit 208 may also indicate on images 601 and 602 which imaging unit 110 or 120 on the pan drive circumference 102 captured the image. For example, the image generation unit 208 may superimpose the number 311 superimposed on the symbol 310 of the first imaging unit 110 on the position display UI 206 and the number 321 superimposed on the symbol 320 of the second imaging unit 120 onto images 601 and 602.

[0054] <UI display on the display unit> Referring to Figure 7, an example of display on the display unit 203 according to the first embodiment will be described. Figure 7 is a diagram of the operation screen including the images and UI described above. Figure 7(a) is a diagram of the operation screen in which the position display UI 206, the imaging unit designation UI 207, the pan button 631, image 601 and image 602 are displayed so that they can be viewed simultaneously on the display unit 203. The position display UI 206 is the UI described in Figure 3(b). The imaging unit designation UI 207 is the UI described in Figure 4. The imaging unit operation UI 205, including the pan button 631, is the UI described in Figure 5(a). Image 601 and image 602 are the images described in Figure 6.

[0055] <Image Unit Designated UI> The UI generation unit 210 generates the imaging unit specification UI 207 as a separate UI from the position display UI 206. The user specifies the imaging unit to be operated on by selecting either the number "1" indicated by the number 311 superimposed on the symbol 310 of the first imaging unit 110 on the imaging unit specification UI 207 or the number "2" indicated by the number 321 superimposed on the symbol 320 of the second imaging unit 120 on the position display UI 206. In this case, the imaging unit selected by the user is the first imaging unit 110. In this case, the UI generation unit 210 may highlight the symbol 310 of the first imaging unit 110 on the imaging unit specification UI 207 and the position display UI 206 with a thick line, as shown in Figure 7(a). Figure 7(b) shows an example of an operation screen including a UI in which the position display UI 206 is displayed in a circle on the display unit 203. Figure 7(b) is an operation screen that differs from Figure 7(a) in that the position display UI206 is displayed in a circular shape, but otherwise it is the same. Therefore, the explanation of Figure 7(b) will be omitted, and Figure 7(a) will be explained.

[0056] <Relationship between position display UI206 and image unit operation UI> Refer to Figure 7(a) for a supplementary explanation of the position display UI 206 and the imaging unit operation UI 205. Figure 7(a) is a diagram of the operation screen in which the position display UI 206 is shown as a straight line. In the position display UI 206 of Figure 7(a), the positions of the first imaging unit 110 and the second imaging unit 120 on the pan drive circumference symbol 331 are displayed as symbols 310 and 320, respectively. In this case, the imaging unit selected by the user is the first imaging unit 110, and in Figure 7(a), the symbol 310 of the first imaging unit 110 is highlighted with a thick line. The imaging unit operation UI 205 has multiple pan buttons 631. Each of the multiple pan buttons 631 displays the amount of drive required to drive the selected imaging unit on the pan drive circumference 102. In this case, the user specifies the amount of drive required for the first imaging unit 110 using the pan buttons 631.

[0057] The following describes the case where the user operates the first imaging unit 110 while the operation screen shown in Figure 7(a) is displayed on the display unit 203. The user pans the first imaging unit 110 to a position where they can capture the desired image while viewing images 601 and 602 and the position display UI 206.

[0058] However, when a user pans the first imaging unit 110 by selecting the pan button 631 while looking at the position display UI 206, the user cannot intuitively determine which direction and by how much the symbol 310 of the first imaging unit 110 on the position display UI 206 will move. Thus, simply displaying the position display UI 206 and the pan button 631 may cause the user to mistakenly select either the rotation direction or the amount of drive, resulting in the imaging unit being moved to an unintended position.

[0059] <Features of the first embodiment> Referring to Figure 8, an example of displaying a scale on the position indicator UI206 of the first embodiment will be described. Figure 8 is a diagram illustrating the scale display on the position indicator UI206 of the first embodiment. Figure 8(a) is a diagram of the scale display on the pan drive circumference symbol 331 of the position indicator UI206 of the first embodiment. Figure 8(b) is a diagram of the imaging unit operation UI205 of the first embodiment.

[0060] If the first imaging unit 110 is selected, the UI generation unit 210 displays the discrete values ​​-X3, -X2, -X1, X1, X2, X3, indicated by the pan button 631 of the imaging unit operation UI 205 shown in Figure 8(b), as scales on the pan drive circumference symbol 331 on the position display UI 206, as shown in Figure 8(a), for the symbol 310 of the first imaging unit 110. The scales indicate the position of the imaging unit after it has been driven by the amount driven by the user selecting the pan button 631, i.e., the driven position. For example, if the discrete values ​​indicated by the pan button 631 are -30, -20, -10, 10, 20, 30, the UI generation unit 210 displays -30, -20, -10, 10, 20, 30 as scales on the pan drive circumference symbol 331 for the symbol 310 of the first imaging unit 110. Also, in Figure 8, the scales are spaced at regular intervals. Furthermore, in Figure 8, the scale interval of 350 at this time is illustrated with an arrow for explanatory purposes. Here, the scale interval of 350 represents 10°, which is the difference between the values ​​of the adjacent pan button 631.

[0061] By displaying the scale in this way, the user can see which direction and to what extent the symbol 310 of the first imaging unit 110 will move on the pan drive circumference symbol 331 when they press any of the discrete values ​​indicated by the pan button 631: -X3, -X2, -X1, X1, X2, or X3.

[0062] This embodiment allows the user to easily recognize the position of the imaging unit after it has been driven by displaying a scale corresponding to the amount of pan drive of the imaging unit being driven. As a result, this embodiment improves user operability and suppresses erroneous operations that cause the user to drive the selected imaging unit to an unintended position (direction, amount).

[0063] <Modification example: Displaying scale markings on the location display UI> Referring to Figure 9, a modified example of the scale display on the position indicator UI 206 of the first embodiment will be described. Figure 9 is a diagram of a modified example of the scale display on the position indicator UI of the first embodiment.

[0064] Figure 9(a) shows the distance (angle) between the selected imaging unit and an adjacent imaging unit, or the distance (angle) to the pan drive end 103, displayed on the position display UI 206. The distance (angle) between the selected imaging unit and an adjacent imaging unit, or the distance (angle) to the pan drive end 103, is an example of the amount of drive to the drive range. Here, D1 is the angle between the first imaging unit 110 and the pan drive end 103, and D2 is the angle between the first imaging unit 110 and the second imaging unit 120. In this case, the UI generation unit 210 also displays the angle on the position display UI 206. For example, if the angle between the first imaging unit 110 and the pan drive end 103 is 80°, the UI generation unit 210 displays "80" between the symbol 310 of the first imaging unit 110 and the pan drive end symbol 332 on the position display UI 206. Furthermore, if the angle between the first imaging unit 110 and the second imaging unit 120 is 40°, the UI generation unit 210 displays "40" between the symbol 310 of the first imaging unit 110 and the symbol 320 of the second imaging unit 120. This allows the user to understand how far the imaging unit to be driven can be driven from its current position on the pan drive circumference 102 by comparing it with the discrete value of the pan button 631.

[0065] Figures 9(b) and 9(c) illustrate how the scale notation is changed when the drive range of an imaging unit selected by an adjacent imaging unit or pan drive end 103 is narrowed to a predetermined angle. Here, we consider the case when the driveable range between imaging units 107 or the driveable range at the pan drive end 108 of the selected imaging unit is narrowed due to the positional relationship with an adjacent imaging unit or pan drive end 103. Figure 9(b) shows the position display UI 206 when the driveable range between imaging units 107 of the first imaging unit 110 is narrowed by the second imaging unit 120, and it can only be driven up to X3'°. The UI generation unit 210 changes X3 to X3' among the scales displayed on the position display UI 206. However, X2 <X3’<X3とする。

[0066] Furthermore, the UI generation unit 210 changes X3 of the discrete value 209 of the pan button 631 to X3' as shown in the discrete value 312 in Figure 9(b).

[0067] For example, there is a pan button 631 that drives the imaging unit selected at -30, -20, -10, 10, 20, and 30. Consider the case where the first imaging unit 110 can only be driven up to 25° from its current position by the adjacent second imaging unit 120. In this case, the UI generation unit 210 displays the scale on the position display UI 206 as -30, -20, -10, 10, 20, and 25. At this time, the UI generation unit 210 changes the "30" representing the discrete value 209 shown on the pan button 631 to "25". In this case, the UI generation unit 210 may change the scale interval 351 from the interval corresponding to "30" to the interval corresponding to "25". The scale with the changed interval is an example of the driveable drive amount.

[0068] For example, when the user presses -30, -20, -10, 10, 20, or 25 indicated on the pan button 631, they can see how far the imaging unit being driven can move on the pan drive circumference 102 before it makes a collision.

[0069] This allows the user to intuitively understand how much further the imaging unit being driven can move on the pan drive circumference 102.

[0070] Furthermore, the UI generation unit 210 may change the interval between the X2 scale and the X3 scale to display the X3 scale on the position display UI 206. Figure 9(c) illustrates that the scale interval 351 is shorter than the scale interval 350 in Figure 8. In this case, it is desirable to shorten the scale interval in conjunction with the interval of the angle that can no longer be driven. For example, even if one scale indicates 10°, if only 8° can be driven, the UI generation unit 210 may shorten the interval between the X2 and X3 scales by 2° (=10°-8°). This makes it possible for the user to visually confirm that the driveable angle has been shortened, even when operating the position display UI 206.

[0071] Figure 9(d) shows a diagram in which the scale of the area that cannot be driven is not displayed when the drive range of the imaging unit selected by adjacent imaging units or pan drive ends 103 is narrower than a predetermined angle. The UI generation unit 210 may display the scale up to the point where the selected imaging unit does not collide with the adjacent imaging unit or pan drive end 103 as the scale displayed on the position display UI 206. If the discrete value 209 indicating X3 is selected on the pan button 631 and the imaging units collide, the UI generation unit 210 may change the notation 313 on the pan button 631 to "Collision".

[0072] For example, consider a case where there is a pan button 631 that drives the selected imaging unit at -30, -20, -10, 10, 20, and 30, and the first imaging unit 110 can only be driven up to 25° by the adjacent second imaging unit 120. In this case, the UI generation unit 210 displays the scale up to 20 on the position display UI 206. At this time, the UI generation unit 210 may change the notation 313, which indicates a collision, for the discrete value 30 shown by -30, -20, -10, 10, 20, and 30 of the pan button 631. Figure 9(d) shows an example where the notation 313 has been changed to "collision".

[0073] This allows the user to intuitively understand whether the imaging unit being driven will collide with an adjacent imaging unit.

[0074] Figure 9(e) shows the scale display when the drive range of an imaging unit selected by an adjacent imaging unit or pan drive end 103 is narrower than a predetermined angle, and the scale displayed on the position display UI 206 overlaps with the symbol of an adjacent imaging unit. When the scale displayed on the position display UI 206 overlaps with an adjacent imaging unit, the UI generation unit 210 may display the scale with a dotted line. For example, consider a case where there is a pan button 631 that drives the selected imaging unit at -30, -20, -10, 10, 20, and 30 degrees, and the first imaging unit 110 can only be driven up to 25° by the adjacent second imaging unit 120. In this case, if the scale is displayed up to 30°, the scale will overlap with the symbol 320 of the adjacent second imaging unit 120. In this case, the UI generation unit 210 may display the scale indicating 30° with a dotted line, as shown in Figure 9(e). The UI generation unit 210 may also display the scale using a method other than a dotted line to distinguish it from other scales. For example, the UI generation unit 210 may display the scale using a thick line, a different color, or the like.

[0075] Figure 9(f) shows the adjustment of the scale interval of the position display UI. When the driveable range 109 is narrowed due to the positional relationship of the selected imaging unit with an adjacent imaging unit or pan drive end 103, the UI generation unit 210 may adjust the scale interval 314 of the position display UI 206 and display it. The UI generation unit 210 may also change the numerical values ​​of the scale and the discrete values ​​209 of the pan button 631 in accordance with the adjustment. For example, consider a case where there is a pan button 631 that drives the selected imaging unit at -30, -20, -10, 10, 20, and 30, and the first imaging unit 110 can only be driven up to 24° by the adjacent second imaging unit 120. In this case, if the angle of 24° up to the symbol 320 of the adjacent second imaging unit 120 is averaged and divided by the three scales, the interval between the scales becomes 8°. Therefore, as shown in Figure 9(f), the UI generation unit 210 displays the scale so that the scale interval 314 of the position display UI 206 is from 10° to 8°.

[0076] This allows the user to operate the imaging unit without causing it to collide with adjacent imaging units.

[0077] According to the first embodiment, by displaying the discrete values ​​-X3, -X2, -X1, X1, X2, and X3 indicated by the pan button 631 on the position display UI 206, it is possible to suppress the user from accidentally moving the selected imaging unit to an unintended position (direction, amount).

[0078] Referring to Figure 10, the scale display of the circular position indicator UI206 will be described. Figure 10 is a diagram showing the scale display of the circular position indicator UI206 of the first embodiment. The UI generation unit 210 may place the scale on the circular pan drive circumference symbol 331 in the circular position indicator UI206. Here, the UI generation unit 210 places the scale at positions of discrete values, -X3, -X2, -X1, X1, X2, and X3 drive angles (also called rotation angles) from the symbol 310 representing the imaging unit 110 to be driven, with the center of the pan drive circumference symbol 331 as the axis of rotation. For example, the UI generation unit 210 places the scale at positions of -30°, -20°, -10°, 10°, 20°, and 30° from the symbol 310. The UI generation unit 210 may also apply the same modifications as those shown in Figures 9(a) to 9(f) above to Figure 10.

[0079] (Second Embodiment) <Scale display when multiple imaging units are selected> The operation of the imaging system 300 according to the second embodiment will be described below with reference to Figure 10. Figure 10 is a schematic diagram showing the functional configuration of the imaging system 300 together with the imaging device 100 and the client device 200. In the second embodiment, the control of the pan drive unit when multiple imaging units are selected will be described. The imaging device 100 has three imaging units 110, 120, and 190. The imaging device 100 has a first imaging unit 110, a second imaging unit 120, a third imaging unit 190, a first drive unit 113, a second drive unit 123, a third drive unit 173, an image processing unit 130, a control unit 140, a position detection unit 150, a communication unit 160, and a collision detection unit 170. The third imaging unit 190 has an imaging optical system 191 and a solid-state image sensor 192. The third drive unit 173 has a third pan drive unit 174. The imaging device 100 is connected to the client device 200 via the network 180. The imaging device 100 transmits captured image data and receives control signals from the client device 200 via the network 180.

[0080] This section describes the control of the pan drive unit when multiple imaging units are selected. When the user selects multiple imaging units and operates the pan button 631, the selected imaging units will be panned by a specified amount from their current position on the pan drive circumference. Furthermore, if an imaging unit to be driven collides with an adjacent imaging unit or pan drive end 103, or if a collision occurs due to driving, the control unit 140 stops the driving of the pan drive unit that is in a collision state. However, the control unit 140 stops only the pan drive unit of the imaging unit that is in a collision state. Therefore, in pan driving when two imaging units are selected, if one is in a collision state and the other is not, each pan drive unit will operate differently. Specifically, the control unit 140 stops the pan drive unit of the imaging unit in a collision state and continues panning the pan drive unit that is not in a collision state. Furthermore, if both (or all) imaging units are in a collision state, the control unit 140 does not operate the pan drive units of both (or all) imaging units. Furthermore, if both (or all) of the imaging units are not in a collision state, the control unit operates the pan drive units of both (or all) of the imaging units.

[0081] The following describes the scale display of the position display UI 206 when multiple imaging units are selected by the user according to the second embodiment, with reference to Figure 11. Figure 11 is a diagram of the scale display of the position display UI according to the second embodiment. In Figure 11, we consider the case when two imaging units are selected. Here, the symbol corresponding to the third imaging unit 190 on the position display UI 206 is set to symbol 390, and the number 391 superimposed on symbol 390 is set to "3".

[0082] When multiple imaging units are selected, the scale is displayed on the position display UI206 for each symbol, making it difficult for the user to determine which scale to look at and operate. Therefore, in the second embodiment, when multiple imaging units are selected, a determination is made as to whether or not to display the scale based on predetermined conditions.

[0083] For example, if adjacent imaging units are selected as targets for driving, the UI generation unit 210 hides the display of the scale between the symbols of the selected adjacent imaging units. In the second embodiment, if multiple imaging units are selected as targets for driving, the UI generation unit 210 determines whether or not to hide the scale based on the positional relationship of the imaging units, including those that are not selected. If multiple imaging units are selected as targets for driving, the UI generation unit 210 determines whether or not to hide the scale between imaging units (i.e., between symbols) based on the collision state of the imaging units, including those that are not selected. Specifically, the UI generation unit 210 may determine whether or not to display the scale based on at least one of the distance and angle between adjacent imaging units.

[0084] Figure 11(a) shows the scale displayed for each symbol because all selected symbols are not adjacent. Figure 11(b) shows the scale hidden between adjacent selected imaging symbols. Figure 11(c) is an explanatory diagram for determining whether to hide or display based on the collision state.

[0085] Figure 11(a) shows the scale display when two imaging units are selected. This time, we consider the case where the imaging units selected by the user are the first imaging unit 110 and the third imaging unit 190. As shown in Figure 11(a), the UI generation unit 210 displays the discrete values ​​-X3, -X2, -X1, X1, X2, and X3, indicated by the pan button 631 of the first embodiment, on the position display UI 206 for each of the symbols 310 of the first imaging unit 110 and 390 of the third imaging unit 190. For example, consider the case where the discrete values ​​indicated by the pan button 631 are -30, -20, -10, 10, 20, and 30. At this time, since the selected imaging units 110 and 190 are not adjacent, the UI generation unit 210 displays -30, -20, -10, 10, 20, and 30 as scales for the symbol 310 of the first imaging unit 110 and the symbol 390 of the third imaging unit 190 on the position display UI 206, respectively.

[0086] Figure 11(b) shows the scale display when the selected imaging units are adjacent to each other on the pan drive circumference 102. Assume that the imaging units selected by the user are the first imaging unit 110 and the second imaging unit 120. The UI generation unit 210 displays discrete values, -X3, -X2, -X1, X1, X2, and X3 as scales on the position display UI 206 for the symbol 310 of the first imaging unit 110 and the symbol 320 of the second imaging unit 120, respectively. In this case, as shown in Figure 11(b), the scales between adjacent imaging units are omitted and not displayed. Here, since the first imaging unit 110 and the second imaging unit 120 are adjacent, the UI generation unit 210 omits the scale between the symbol 310 of the first imaging unit 110 and the symbol 320 of the second imaging unit 120 in the display. For example, consider the case where the discrete values ​​indicated by the pan button 631 are -30, -20, -10, 10, 20, and 30. The UI generation unit 210 displays -30, -20, and -10 as scales on the symbol 310 of the first imaging unit 110 on the position display UI 206, and 10, 20, and 30 as scales on the symbol 320 of the second imaging unit 120. In this case, the scales between the symbol 310 of the first imaging unit 110 and the symbol 320 of the second imaging unit 120 are hidden. Furthermore, although the scales between the symbols are not visible to the user, the scales of symbol 310 (-X3, -X2, -X1) and the scales of symbol 320 (X1, X2, X3) can still be seen, so the second embodiment can suppress user errors in the same way as the first embodiment. Also, in this case, the imaging unit 110 and the imaging unit 120 have the same drive amount. Furthermore, by hiding the scales between symbols, the number of scales that the user needs to focus on is reduced, thus the second embodiment can suppress errors caused by misinterpretation.

[0087] Figure 11(c) shows the display of the scale when the selected imaging units are adjacent to each other on the pan drive circumference 102 and collide with an adjacent imaging unit or pan drive end 103. If there is a collision symbol, the scale may be displayed without the process of hiding the scale. Collision detection is performed by the collision detection unit 170. In Figure 11(c), the adjacent first imaging unit 110 and second imaging unit 120 are selected. The second imaging unit 120 is colliding with the third imaging unit 190. In this case, the UI generation unit 210 displays the discrete values ​​of the pan buttons 631, -X3, -X2, -X1, X1, X2, and X3, on the position display UI 206 between the selected first imaging unit 110 and the second imaging unit 120. When there is a collision symbol (imaging unit) in this way, the user may want to drive in the direction of resolving the collision. Therefore, the UI generation unit 210 displays the memory for colliding symbols (symbol 320 in Figure 11(c)) even if the selected imaging units are adjacent. In this case, the UI generation unit 210 may display the scale for symbol 310 as shown in Figure 11(c), or it may hide it as shown in Figure 11(b). By doing so, even when there are symbols (imaging units) in a collision state, the second embodiment can improve user operability by displaying the scale in the direction of resolving the collision state.

[0088] Furthermore, if the selected imaging units are adjacent to each other and are in a collision state, there is no need to determine the collision state between the selected imaging units because they will not collide if they are driven in the same direction.

[0089] The above description concerns the case with three imaging units, but the imaging system may have more than three imaging units. Furthermore, while the example shows the case where two imaging units are selected, the configuration of the second embodiment described above can be similarly applied when three or more imaging units are selected.

[0090] In the above embodiment, the timing for displaying the scale was assumed to be when the imaging unit was selected, but this timing is not limited to this. For example, if a mouse (pointing device) cursor is present on or around the pan button 631 (i.e., on the first user interface), the UI generation unit 210 may display the scale. The cursor is just one example of a selection means. This way, the scale is displayed at the time of user operation. Switching the display in this way makes it easier for the user to see the position of the scale.

[0091] <Processing flow of the second embodiment> The image display processing by the UI generation unit of the imaging system in the second embodiment will now be described with reference to Figure 12. Figure 12 shows a flowchart of the image display processing performed by the UI generation unit 210 of the second embodiment. Here, the UI generation unit 210 starts the image display processing when the user selects one or more imaging units.

[0092] (S1001) The UI generation unit 210, with at least one of the imaging unit designation UI 207 and the position display UI 206 displayed, determines whether the user has selected multiple imaging units. If the UI generation unit 210 determines that the user has selected multiple imaging units, it proceeds to S1002. On the other hand, if the UI generation unit 210 determines that the user has not selected multiple imaging units, it proceeds to S1004.

[0093] (S1002) The UI generation unit 210 determines whether the multiple imaging units selected by the user are adjacent to each other. If the UI generation unit 210 determines that the imaging units are adjacent to each other, it proceeds to S1003. If the UI generation unit 210 determines that the imaging units are not adjacent to each other, it proceeds to S1004.

[0094] (S1003) The UI generation unit 210 determines whether there is an imaging unit among the selected imaging units that has been determined to be "undriveable" by the collision detection unit 170. If the UI generation unit 210 determines that there is an imaging unit that has been determined to be "undriveable", it proceeds to S1005. On the other hand, if the UI generation unit 210 determines that there is no imaging unit that has been determined to be "undriveable", it proceeds to S1004.

[0095] (S1004) The UI generation unit 210 displays a scale on the position display UI 206 for each imaging unit selected by the user, similar to the first embodiment (Figure 11(a)).

[0096] (S1005) The UI generation unit 210 displays a scale on the position display UI 206 for each imaging unit selected by the user, similar to the first embodiment. However, the UI generation unit 210 omits some of the scales. For example, if the selected imaging units are adjacent, the UI generation unit 210 omits the display of scales between symbols (between imaging units) (Figure 11(b)). Also, if the selected imaging unit is likely to collide with another imaging unit and is determined to be "undriveable", the UI generation unit 210 omits the scales between the selected imaging unit and the imaging unit that would collide with it (Figure 11(c)).

[0097] Figure 11(b) shows an example where the scale is hidden when the imaging units selected by the user are adjacent to each other. However, the UI generation unit 210 may also hide the scale when the distance (angle) between the imaging units (symbols) selected by the user is small. When the distance between symbols is small, the scales of the symbols overlap, making it difficult for the user to see the scale. Therefore, the UI generation unit 210 performs a process to hide the scale when the distance (angle) between the imaging units (symbols) is small. Specifically, the UI generation unit 210 performs a process to hide the scale when the angle between the imaging units is less than or equal to the scale threshold (twice |X3| (the scale of each symbol)). For example, if X3=30, the threshold may be set to 60°. In this way, when the scales overlap, the UI generation unit 210 hides the scale, making it easier for the user to see the scale and improving usability.

[0098] (Third embodiment) <Scale display for tilt drive, rotation drive, zoom drive, and focus drive> In the first and second embodiments, the case where the drive unit of the imaging unit is a pan drive unit was described, but the drive unit is not limited to this. In the third embodiment, the case where the drive unit is something other than a pan drive unit will be described.

[0099] Referring to Figure 13, the configuration of the imaging system 300 according to the third embodiment will be described. Figure 13 is a schematic diagram showing the functional configuration of the imaging system 300 together with the imaging device 100 and the client device 200.

[0100] The imaging device 100 of the third embodiment shown in Figure 13 has a first drive unit 113 and a second drive unit 123. The first drive unit 113 has a tilt drive unit 115, a rotation drive unit 116, a zoom drive unit 117, and a focus drive unit 118, each of which can be driven independently. The second drive unit 123 has a tilt drive unit 125, a rotation drive unit 126, a zoom drive unit 127, and a focus drive unit 128, each of which can be driven independently.

[0101] <Tilt drive unit> The first tilt drive unit 115 and the second tilt drive unit 125 are equipped with motors and gears. The power driving the motors of the first tilt drive unit 115 and the second tilt drive unit 125 is controlled by the control unit 140. The first tilt drive unit 115 and the second tilt drive unit 125 each drive the first imaging unit 110 and the second imaging unit 120 to tilt in a plane perpendicular to the XY plane with the pan axis 101 perpendicular. The tilt drive will be described with reference to Figure 14. Figure 14 is a diagram illustrating the tilt drive of the imaging unit by the tilt drive unit of the third embodiment. Figure 14 is a layout diagram of the imaging unit 110 of the imaging device 100 according to the third embodiment, viewed from the +X axis side. At this time, it is assumed that the first imaging unit 110 is imaging in the positive direction of the Y axis. Therefore, the first imaging unit 110 is driven by the tilt drive unit 115 within a plane perpendicular to the X-axis (YZ plane).

[0102] Figure 14 illustrates the tilt drive of the first imaging unit 110, but the tilt drive of the second imaging unit 120 is similar. The first imaging unit 110 and the second imaging unit 120 are configured to be tilt-driven using a tilt axis 104 parallel to the X-axis as the axis of rotation. If we define the upward direction as the + direction and the downward direction as the - direction, for example, the tilt drive units 115 and 125 can tilt the imaging units 110 and 120 within a drive range of -30° to +90°, with the horizontal direction 134 as the reference 0°. -30° and +90° are examples of tilt drive ends 137. If we define the tilt position 133 with respect to the horizontal direction 134, the tilt position 133 is the angle between the horizontal direction 134 and the tilt direction 141.

[0103] If the angle between the tilt position 133 and the tilt drive end 137 is below a threshold, the collision detection unit 170 determines that "driving is not possible," similar to the pan drive, and notifies the control unit 140 of the determination result.

[0104] The tilt drive units 115 and 125 use the tilt position 133 at the time of driving as a reference position and tilt the imaging unit upward (+) or downward (-) from there. The positions of the tilt drive units 115 and 125 may be acquired by a photointerrupter or Hall element, etc. Each imaging unit 110 and 120 has an independent tilt axis, and the tilt drive units 115 and 125 can be controlled independently for each imaging unit 110 and 120. The user can operate each tilt drive unit 115 and 125 using the tilt buttons described later.

[0105] <Rotation drive unit> The rotation drive unit will be described with reference to Figure 15. Figure 15 is a diagram illustrating the rotation drive of the imaging unit by the rotation drive unit of the third embodiment. Figure 15 is a front view of the imaging unit 110, and the lens of the imaging optical system 111 and the solid-state image sensor 112 are shown superimposed (transparently) for illustrative purposes. As with Figure 14, the first imaging unit 110 is assumed to be capturing images in the positive direction of the Y axis. The rotation axis 106, which is the rotation axis of the rotation drive units 116 and 126, coincides, for example, with the optical axis of the imaging optical system 111. The rotation drive units 116 and 126 each have an independent rotation axis 106 for the imaging units 110 and 120. The first rotation drive unit 116 will be described here, but the second rotation drive unit 126 is similar and can be controlled independently. Each rotation drive unit 116 and 126 is equipped with a motor and gears. The power to drive the motors of each rotation drive unit 116, 126 is independently controlled for each imaging unit 110, 120 by the control unit 140. The control unit 140 controls the rotation drive units 116, 126 to tilt the solid-state image sensor 112 of the imaging unit 110 by 90 degrees around the rotation axis 106, which is the optical axis, thereby changing the imaging area from a horizontal aspect ratio to a vertical aspect ratio. The rotation drive units 116, 126 may also rotate the imaging units 110, 120 by 0° to +360°, not limited to 90 degrees. The position of the rotation drive units 116, 126 may be acquired by a photointerrupter or Hall element, etc. In the rotation drive, there may be a rotation limit end 132. Figure 15 shows the state after rotation from the rotation drive end 132, which is the reference 0°, in the positive direction (here referred to as the rotation direction 142). The angle between the rotation drive end 132 and the rotation direction 142 is represented as the rotation angle 131. The rotation drive units 116 and 126 can rotate the solid-state image sensor 112. Here, it has been explained that the solid-state image sensor 112 is rotated, but the imaging unit 110 itself may also be rotated.

[0106] If the distance (angle) between the rotation angle 131 and the rotation drive end 132 is less than or equal to a threshold, the collision detection unit 170 determines that "driving is not possible," similar to the case of pan driving, and notifies the control unit 140 of the determination result.

[0107] The rotation drive units 116 and 126 drive in the + or - direction, using the rotation angle 131 used for driving as the reference angle. The rotation drive units 116 and 126 can independently control the imaging unit selected by the user, regardless of the driving position of other imaging units. Each rotation drive unit 116 and 126 can be operated by the rotation buttons described later, similar to the pan button 631.

[0108] <Zoom drive unit> The first imaging unit 110 and the second imaging unit 120 have a zoom lens that can be driven in the optical axis direction of the imaging optical system. The first zoom drive unit 117 and the second zoom drive unit 127 are controlled by the control unit 140 to drive the zoom lens, thereby changing the zoom position of the zoom lens and the shooting range of the imaging units 110 and 120. Each zoom drive unit 117 and 127 is equipped with a motor and gears. The control unit 140 can drive the zoom lens of each imaging optical system by controlling the power that drives the motor. Furthermore, the position of the zoom lens is acquired by a photointerrupter and a Hall element, etc. The zoom drive units 117 and 127 can change the angle of view (zoom magnification) by driving the zoom lens. In zoom driving, there is a zoom drive end, which is the limit of how the zoom lens can be driven. When the distance between the zoom lens position and the zoom drive end is below a threshold, the collision detection unit 170 determines that "driving is not possible" and notifies the control unit 140, similar to the case of pan driving. The power driving the motor is controlled by the control unit 140. Furthermore, the imaging device 100 can independently drive the zoom drive units 117 and 127 of each imaging unit 110 and 120, and can drive one or more zoom drive units 117 and 127 simultaneously. Here, the telephoto end direction is defined as the + direction, and the wide-angle end direction as the - direction. Each zoom drive unit 117 and 127 can be operated by a zoom button, similar to the pan button 631, as described later.

[0109] <Focus drive unit> The first imaging unit 110 and the second imaging unit 120 have a focus lens that can be driven in the optical axis direction of the imaging optical system. The first focus drive unit 118 and the second focus drive unit 128 are controlled by the control unit 140 to change the focus position by driving the focus lens. Each focus drive unit 118 and 128 is equipped with a motor and gears. The control unit 140 drives the focus lens of each imaging optical system by controlling the power that drives the motor. Furthermore, the position of the focus lens is acquired by a photointerrupter and a Hall element, etc. The focus drive units 118 and 128 change the focus position (focused position) by driving the focus lens. In focus driving, there is a focus drive end, which is the limit of the focus lens's movement. When the distance between the focus lens position and the focus drive end is below a threshold, the collision detection unit 170 determines that "driving is not possible," as in the case of pan driving, and notifies the control unit 140 of the determination result. The power driving the motor is controlled by the control unit 140. The control unit 140 can independently drive the focus drive units 118 and 128 of each imaging unit 110 and 120, and can drive one or more focus drive units 118 and 128 simultaneously. Here, the far direction is the + direction and the near direction is the - direction. Each focus drive unit 118 and 128 can be operated by the focus button, which will be described later, similar to the pan button 631.

[0110] <Position detection unit> The position detection unit 150 detects the tilt position 133 shown in Figure 14 and notifies the control unit 140 of the position detection result. Note that the tilt position 133 is independently determined by the first imaging unit 110 and the second imaging unit 120.

[0111] Furthermore, the position detection unit 150 detects the rotation angle 131 shown in Figure 15 and notifies the control unit 140 of the detection result. Note that the rotation angle 131 is independently determined by the first imaging unit 110 and the second imaging unit 120.

[0112] Furthermore, the position detection unit acquires the positions of the solid-state image sensors 112, 122 and the imaging optical systems 111, 121, which are independently located in the first imaging unit 110 and the second imaging unit 120, respectively, and notifies the control unit 140 of the detection results.

[0113] <UI of the third embodiment> The scale display of the UI according to the third embodiment will be described below with reference to Figures 16 and 17. Figure 16 shows an example of the scale display other than the pan drive unit according to the third embodiment. Figure 16(a) is the scale display for the tilt drive. Figure 16(b) is the scale display for the rotation drive. Figure 16(c) shows the scale displays for the zoom drive and focus drive. In the explanation of Figure 16, it is assumed that the user has selected the first imaging unit 110. Figure 17 is an example of the UI displayed on the display unit 203 of the third embodiment.

[0114] As shown in Figure 17, the UI generation unit 210 displays a screen on the display unit 203 that includes a position indicator UI 901 for pan drive, a position indicator UI 902 for tilt drive, and a position indicator UI 903 for rotation drive. The position indicator UI 901 for pan drive is the same as the position indicator UI 206 described above. In Figure 17, some reference numerals have been omitted for clarity. The UI generation unit 210 also displays an imaging unit operation UI 205 that includes a pan button 631, a tilt button 632, a rotation button 633, a zoom button 634, and a focus button 635. Figure 17 shows the user selecting the first imaging unit 110 and the second imaging unit 120. The UI generation unit 210 may change the display of the scales for position indicator UIs other than the pan drive unit according to the collision state, as in the first embodiment. Furthermore, the collision detection unit 170 may determine the collision state for each drive unit (pan drive unit, tilt drive unit, rotation drive unit, zoom drive unit, focus drive unit) of each imaging unit 110, 120.

[0115] <Image Unit Operation UI> As shown in Figure 17, the imaging unit operation UI 205 of the third embodiment has a tilt button 632 similar to the pan button 631. The user operates the tilt drive unit of the selected imaging unit using the tilt button 632. The tilt button 632 has multiple buttons. Each of the multiple buttons is associated with a different drive amount. Therefore, by selecting any of the buttons, the user can tilt the selected imaging unit with the drive amount associated with that button. The tilt button 632 displays relative values ​​of discrete angles (°) to be driven, such as -X3, -X2, -X1, X1, X2, X3 from the left end. For example, the tilt button 632 displays relative values ​​of discrete angles (°) to be driven, such as -30, -20, -10, 10, 20, 30 (not shown). If the user clicks, for example, the button labeled "30" on the far right, the control unit 140 controls the corresponding tilt drive unit to drive the imaging unit selected by the user 30° upward (+). The -X3, -X2, -X1, X1, X2, and X3 described here may not be numerical values ​​but rather qualitative expressions such as large, medium, and small. Furthermore, the UI generation unit 210 displays an illustration on the imaging unit operation UI 205 that visually indicates the direction, allowing the user to operate intuitively. In this case, the UI generation unit 210 does not need to display numerical values ​​or other information on the imaging unit operation UI 205. The number of discrete values ​​displayed on the tilt button 632 is not limited to a specific number.

[0116] The imaging unit operation UI 205 has a rotation button 633 similar to the pan button 631. The user can operate the rotation drive unit of the selected imaging unit using the rotation button 633. The rotation button 633 has multiple buttons. Each of the multiple buttons is associated with a different drive amount. Therefore, by selecting any button, the user can rotate the selected imaging unit with the drive amount associated with that button. The rotation button 633 displays relative values ​​of discrete angles (°) to be driven, such as -X3, -X2, -X1, X1, X2, X3 from the left end. For example, the rotation button 633 displays relative values ​​of discrete angles (°) to be driven, such as -30, -20, -10, 10, 20, 30 (not shown). If the user clicks the button labeled 30 on the right end, for example, the control unit 140 controls the corresponding rotation drive unit to drive the imaging unit 30° clockwise (+). The -X3, -X2, -X1, X1, X2, and X3 described here may not be numerical values ​​but rather qualitative expressions such as large, medium, and small. Furthermore, the UI generation unit 210 displays illustrations on the imaging unit operation UI 205 that visually indicate direction, allowing the user to operate intuitively. In this case, the UI generation unit 210 does not need to display numerical values ​​on the imaging unit operation UI 205. The number of discrete values ​​displayed on the rotation button 633 is not limited to a specific number.

[0117] The image sensor operation UI 205 has a zoom button 634 similar to the pan button 631. The user can operate the zoom drive unit of the selected image sensor using the zoom button 634. The zoom button 634 has multiple buttons. Each of the multiple buttons is associated with a different drive amount. Therefore, by selecting any button, the user can zoom the zoom lens of the selected image sensor with the drive amount associated with that button. The zoom button 634 displays discrete, dimensionless relative values ​​that drive, such as -X3, -X2, -X1, X1, X2, and X3 from left to right. For example, the zoom button 634 displays discrete, dimensionless relative values ​​that drive, such as -100, -60, -30, 30, 60, and 100 (not shown). If the user clicks the button labeled 100 on the right, for example, the control unit 140 controls the corresponding zoom drive unit to zoom the zoom lens by 100 units towards the telephoto side. The discrete values ​​-X3, -X2, -X1, X1, X2, and X3 of the zoom button 634 are represented as dimensionless numbers proportional to the motor's rotation angle, with the wide-angle end being 0 and the telephoto end being 100. The -X3, -X2, -X1, X1, X2, and X3 described here are not numerical values, but can also be qualitative expressions such as large, medium, and small. Furthermore, the UI generation unit 210 displays illustrations on the image unit operation UI 205 that visually indicate direction, allowing the user to operate intuitively. In this case, the UI generation unit 210 does not need to display numerical values ​​on the image unit operation UI 205. The number of discrete values ​​displayed on the zoom button 634 is not limited to a specific number.

[0118] The image sensor operation UI 205 has a focus button 635 similar to the pan button 631. The user can operate the focus drive unit of the selected image sensor using the focus button 635. The focus button 635 has multiple buttons. Each of the multiple buttons is associated with a different drive amount. Therefore, by selecting any button, the user can focus the focus lens of the selected image sensor with the drive amount associated with that button. The focus button 635 displays discrete dimensionless relative values ​​that drive, such as -X3, -X2, -X1, X1, X2, X3 from left to right. For example, discrete dimensionless relative values ​​that drive, such as -100, -60, -30, 30, 60, 100, are displayed (not shown). If the user clicks the button labeled 100 on the far right, for example, the focus lens of the image sensor will be driven 100 units further away. If the user clicks the button labeled 100 on the far right, for example, the focus drive unit will be driven 100 units further away. The discrete values ​​-X3, -X2, -X1, X1, X2, and X3 of the focus button 635 are represented as dimensionless numbers proportional to the motor's rotation angle, with the nearest end being 0 and the farthest end being 100. The -X3, -X2, -X1, X1, X2, and X3 described here are not numerical values, but can also be qualitative expressions such as large, medium, and small. Furthermore, the UI generation unit 210 displays illustrations that visually indicate direction, allowing the user to operate intuitively. In this case, the UI generation unit 210 does not need to display numerical values. Also, the number of discrete values ​​displayed on the focus button 635 is not limited to a specific number.

[0119] Figure 16(a) is a diagram of the position display UI 902, which includes a scale indicating the tilt position of the first imaging unit 110. The selected tilt position 133 of the first imaging unit 110 is acquired by the position detection unit 150 and displayed on the position display UI 902 as a symbol 310 corresponding to the first imaging unit 110. The UI generation unit 210 superimposes "1" as the number 311 indicating the imaging unit 110 on the symbol 310 corresponding to the first imaging unit 110. The UI generation unit 210 displays the discrete values ​​of the tilt button 632, -X3, -X2, -X1, X1, X2, and X3, which indicate the amount of drive from the symbol 310 corresponding to the first imaging unit 110, as scales on the position display UI 902. For example, if the discrete values ​​displayed on the tilt button 632 are -30, -20, -10, 10, 20, and 30, the UI generation unit 210 will mark -30, -20, -10, 10, 20, and 30 on the position display UI 902 for the symbol 310 corresponding to the first imaging unit 110. In this way, the UI generation unit 210 clarifies the drive position when driving the tilt by marking the discrete values ​​indicated on the tilt button 632 on the position display UI 902.

[0120] As described above, the third embodiment can prevent users from accidentally tilting the imaging unit they have selected to an unintended position (direction, amount) when tilting the unit.

[0121] Figure 16(b) is a diagram of the position display UI903 showing the rotation angle 131 of the first imaging unit 110. The UI generation unit 210 displays the rotation drive end 132 shown in Figure 15 as the initial position symbol 135 on the position display UI903. The UI generation unit 210 displays the rotation angle 131 on the position display UI903, which is the angle rotated by the rotation drive unit from the initial position symbol 135 (0°). The rotation angle 131 of the first imaging unit 110 is acquired by the position detection unit 150. The UI generation unit 210 displays the rotation angle 131 on the position display UI903 as the angle made with the rotation symbol 136 corresponding to the rotation direction of the first imaging unit 110. In the third embodiment, the UI generation unit 210 displays the discrete values ​​of the rotation button 633, -X3, -X2, -X1, X1, X2, and X3, as scales for the rotation symbol 136 corresponding to the first imaging unit 110. For example, when the discrete values ​​displayed on the rotation button 633 are -30, -20, -10, 10, 20, and 30, the UI generation unit 210 displays -30, -20, -10, 10, 20, and 30 as scales on the position display UI 903 for the rotation symbol 136 corresponding to the first imaging unit 110. In this way, the UI generation unit 210 makes the drive position when driving the rotation clear by displaying the discrete values ​​indicated by the rotation button 633 as scales on the position display UI 903. Figure 16(b) shows an example with a circular shape, but the shape may also be a linear shape.

[0122] As described above, the third embodiment can prevent the user from erroneously manipulating the rotation position (direction, amount) to an unintended position when rotating the imaging unit selected by the user.

[0123] Figure 16(c) shows the acquisition of the position of the imaging optical system 111 of the first imaging unit 110 and its display on the position display UI 904. The position display UI 904 for the zoom lens position (also called the zoom position) and the focus lens position (also called the focus position) of the imaging optical system 111 are almost the same, so here we will explain the position display UI 904 for the zoom position. The position of the selected imaging optical system 111 of the first imaging unit 110 is acquired by the position detection unit 150, and the UI generation unit 210 displays it on the position display UI 904 as a symbol 310 corresponding to the first imaging unit 110. The UI generation unit 210 superimposes "1" as the number 311 indicating the imaging unit 110 on the symbol 310 corresponding to the first imaging unit 110. The UI generation unit 210 displays the discrete values ​​of the zoom button 634 (or focus button 635), -X3, -X2, -X1, X1, X2, and X3, as scales on the position display UI 904 for the symbol 310 corresponding to the first imaging unit 110. For example, when the discrete values ​​displayed on the zoom button 634 are -100, -60, -30, 30, 60, and 100, the UI generation unit 210 displays -100, -60, -30, 30, 60, and 100 as scales on the position display UI 904 for the symbol 310 corresponding to the first imaging unit 110. By displaying the discrete values ​​indicated by the zoom button 634 (or focus button 635) as scales on the position display UI 904 in this way, the drive position of the imaging optical system 111 when zooming (or focusing) becomes clear.

[0124] As described above, the third embodiment can prevent unintended positional (direction, amount) errors when zooming or focusing the imaging optical system 111 of the imaging unit selected by the user.

[0125] The UI display of the imaging unit applying the present invention has been explained above using Figures 16(a), 16(b), and 16(c), but these may be combined for display. Also, although the position display UI 904 for zoom position and focus position is omitted in Figure 17, it may be displayed. Furthermore, the position display UI 206 for the pan drive unit having a common rotation axis displays the symbol of the imaging unit on a symbol indicating the same drive range (pan drive circumference symbol 331) so that it is clear that imaging units may collide with each other. In contrast, for other drive units having independent rotation axes, the symbol of the imaging unit may be displayed on a symbol indicating the drive range for each imaging unit. Alternatively, for other drive units having independent rotation axes, the symbols of each imaging unit may be displayed on the symbol indicating the drive range in a position that does not interfere with each other. Specifically, the symbols of other imaging units are not displayed in the direction of the symbol of an imaging unit that moves due to the drive of a drive unit. This allows the user to understand whether other imaging units will collide with each other for each drive unit.

[0126] In the embodiments described above, discrete drive quantities were used as examples, but the drive quantities do not have to be discrete. For example, the drive quantities may be continuous quantities.

[0127] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. Furthermore, the present invention can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0128] The disclosures herein include the following information processing devices, imaging systems, information processing methods, and programs. (Item 1) An information processing device that accepts user input for driving multiple imaging means, The system includes a UI generation means for generating an operation screen that accepts user input, The UI generation means is A first user interface that displays the drive amount for receiving input of the drive amount of the imaging means, A second user interface that displays, along with the position of the imaging means, at least one of the drive position corresponding to the drive amount and the drive amount up to the drive range in which the imaging means can be driven, Generate an operation screen that includes this. An information processing device characterized by the following: (Item 2) The UI generation means generates the second user interface which includes a scale indicating the drive position corresponding to discrete drive amounts. The information processing device described in item 1, characterized by the features described herein. (Item 3) The plurality of driving means that drive the plurality of imaging means are a plurality of pan driving means that pan each of the plurality of imaging means, The UI generation means generates the second user interface which shows discrete drive amounts corresponding to the drive angle of the pan drive. An information processing device according to item 1 or 2, characterized by the above. (Item 4) The UI generation means changes the display of the scale indicating the discrete drive amount on the second user interface when the positional relationship between the target imaging means and an adjacent imaging means is below a threshold. The information processing device described in item 3, characterized by the features described herein. (Item 5) The UI generation means modifies the display of at least one of the discrete drive amount and the drive range in the second user interface based on at least one of the positional relationship between the target imaging means and an adjacent imaging means, and the positional relationship between the target imaging means and the limit position of the drive range. An information processing device according to item 3 or 4, characterized by the features described herein. (Item 6) The plurality of pan driving means drive the plurality of imaging means around the same drive axis, The UI generation means modifies the display of the discrete drive amount in the first user interface based on at least one of the positional relationship between the imaging means to be driven and an adjacent imaging means, and the positional relationship between the imaging means to be driven and the limit position of the drive range. An information processing device according to any one of items 3 to 5, characterized by the features described herein. (Item 7) The UI generation means modifies the display of the scale indicating the drive position corresponding to the discrete drive amount in the second user interface by at least one of the following: erasing the scale on the side of the imaging means to be driven and adjacent imaging means, displaying the scale with a dotted line, and changing the interval of the scale. An information processing device according to any one of items 3 to 6, characterized in that it is an information processing device. (Item 8) If, among the plurality of imaging means, an adjacent imaging means is selected by the user as the target to be driven, The UI generation means hides the scale in the second user interface that indicates the drive position corresponding to the discrete drive amount between the imaging means to be driven and the adjacent imaging means. An information processing device according to any one of items 3 to 7, characterized by the features described herein. (Item 9) If, among the aforementioned plurality of imaging means, a plurality of imaging means are selected by the user as the target to be driven, The UI generation means determines in the second user interface whether or not to display a scale indicating the drive position corresponding to the discrete drive amount between the plurality of imaging means, depending on the positional relationship between the plurality of imaging means. An information processing device according to any one of items 3 to 8, characterized by the above. (Item 10) If, among the aforementioned plurality of imaging means, a plurality of imaging means are selected by the user as the target to be driven, The UI generation means determines in the second user interface whether or not to display a scale indicating the drive position corresponding to the discrete drive amount between the plurality of imaging means, depending on at least one of the distance and angle between the plurality of imaging means. An information processing device according to any one of items 3 to 9, characterized in that it is an information processing device. (Item 11) The plurality of driving means for driving the plurality of imaging means are tilt driving means for independently tilting each of the plurality of imaging means, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the tilt position of the imaging means to be driven. An information processing device according to any one of items 1 to 10, characterized by the features described herein. (Item 12) The plurality of driving means for driving the plurality of imaging means are rotation driving means for independently rotating each of the plurality of imaging means, The UI generation means generates the second user interface which displays at least one of a discrete drive amount and the drive range with respect to the rotation position of the imaging means to be driven. An information processing device according to any one of items 1 to 11, characterized by the features described herein. (Item 13) The aforementioned plurality of imaging means are a plurality of zoom lenses in an optical system, The plurality of driving means for driving the plurality of imaging means are zoom driving means for independently zooming each of the plurality of zoom lenses, The UI generation means generates the second user interface which displays at least one of a discrete drive amount and the drive range with respect to the zoom position of the zoom lens to be driven. An information processing device according to any one of items 1 to 12, characterized by the features described herein. (Item 14) Multiple imaging means are multiple focusing lenses of an optical system, The plurality of driving means for driving the plurality of imaging means are focus driving means for independently focusing each of the plurality of focus lenses, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the focus position of the focus lens to be driven. An information processing device according to any one of items 1 to 13, characterized by the features described herein. (Item 15) The plurality of driving means that drive the plurality of imaging means are A pan drive means for independently panning each of the aforementioned multiple imaging means, A tilt drive means for independently tilting each of the aforementioned multiple imaging means, Rotation driving means for independently rotating each of the aforementioned plurality of imaging means, A zoom drive means for independently zooming each of the zoom lenses of the optical systems of the plurality of imaging means, and This includes at least one of the focus driving means for independently driving the focus lenses of the optical systems of the plurality of imaging means. An information processing device according to any one of items 1 to 14, characterized by the features described in item 1 to 14. (Item 16) The UI generation means is The imaging means is selected as the target to be driven, and A selection means exists on or around the first user interface. In at least one of the following cases, the discrete drive amount and at least one of the drive range are displayed in the second user interface. An information processing device according to any one of items 1 to 15, characterized by the features described herein. (Item 17) The information processing device described in item 1, The plurality of imaging means which are the plurality of driven means, The plurality of driving means that drive the plurality of imaging means, A collision detection means that determines whether or not it can be driven based on the position of the imaging means to be driven, An imaging system characterized by comprising the following features. (Item 18) An information processing method that accepts user input for driving multiple imaging means, An operation screen that accepts the aforementioned user input is generated, In generating the aforementioned operation screen, A first user interface that displays the drive amount for receiving input of the drive amount of the imaging means, A second user interface that displays, along with the position of the imaging means, at least one of the drive position corresponding to the drive amount and the drive amount up to the drive range in which the imaging means can be driven, Generate an operation screen that includes this. An information processing method characterized by the following: (Item 19) A program to cause a computer to function as one of the means of an information processing device described in any one of items 1 through 16.

[0129] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0130] 100...Imaging device, 101...Pan axis, 109...Driveable range, 110, 120, 190...Imaging unit, 111, 121...Imaging optical system, 114, 124...Pan drive unit, 115, 125...Tilt drive unit, 116, 126...Rotation drive unit, 117, 127...Zoom drive unit, 118,...Focus drive unit, 170...Collision detection unit, 200...Client device, 202...Control unit, 208...Image generation unit, 205...Imaging unit operation UI, 206, 901, 902, 903, 904...Position display UI, 209, 312...Discrete values, 210...UI generation unit, 300...Imaging system, 350, 351...Scale interval.

Claims

1. An information processing device that accepts user input for driving multiple imaging means, The system includes a UI generation means for generating an operation screen that accepts user input, The UI generation means is A first user interface that displays the drive amount for receiving input of the drive amount of the imaging means, A second user interface that displays, along with the position of the imaging means, at least one of the drive position corresponding to the drive amount and the drive amount up to the drive range in which the imaging means can be driven, Generate an operation screen that includes this. An information processing device characterized by the following:

2. The UI generation means generates the second user interface which includes a scale indicating the drive position corresponding to a discrete drive amount. The information processing apparatus according to feature 1.

3. The plurality of driving means that drive the plurality of imaging means are a plurality of pan driving means that pan each of the plurality of imaging means, The UI generation means generates the second user interface which shows discrete drive amounts corresponding to the drive angle of the pan drive. The information processing apparatus according to feature 1.

4. The UI generation means changes the display of the scale indicating the discrete drive amount on the second user interface when the positional relationship between the imaging means to be driven and an adjacent imaging means is below a threshold. The information processing apparatus according to claim 3.

5. The UI generation means modifies the display of at least one of the discrete drive amount and the drive range in the second user interface based on at least one of the positional relationship between the imaging means to be driven and an adjacent imaging means, and the positional relationship between the imaging means to be driven and the limit position of the drive range. The information processing apparatus according to claim 3.

6. The plurality of pan driving means drive the plurality of imaging means around the same drive axis, The UI generation means modifies the display of the discrete drive amount in the first user interface based on at least one of the positional relationship between the imaging means to be driven and an adjacent imaging means, and the positional relationship between the imaging means to be driven and the limit position of the drive range. The information processing apparatus according to claim 3.

7. The UI generation means modifies the display of the scale indicating the drive position corresponding to the discrete drive amount in the second user interface by at least one of the following: erasing the scale on the side of the imaging means to be driven and adjacent imaging means, displaying the scale with a dotted line, and changing the interval of the scale. The information processing apparatus according to claim 3.

8. If, among the plurality of imaging means, an adjacent imaging means is selected by the user as the target to be driven, The UI generation means hides the scale in the second user interface that indicates the drive position corresponding to the discrete drive amount between the imaging means to be driven and the adjacent imaging means. The information processing apparatus according to claim 3.

9. If, among the aforementioned plurality of imaging means, a plurality of imaging means are selected by the user as the target to be driven, The UI generation means determines in the second user interface whether or not to display a scale indicating the drive position corresponding to the discrete drive amount between the plurality of imaging means, depending on the positional relationship between the plurality of imaging means. The information processing apparatus according to claim 3.

10. If, among the aforementioned plurality of imaging means, a plurality of imaging means are selected by the user as the target to be driven, The UI generation means determines in the second user interface whether or not to display a scale indicating the drive position corresponding to the discrete drive amount between the plurality of imaging means, depending on at least one of the distance and angle between the plurality of imaging means. The information processing apparatus according to claim 3.

11. The plurality of driving means for driving the plurality of imaging means are tilt driving means for independently tilting each of the plurality of imaging means, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the tilt position of the imaging means to be driven. The information processing apparatus according to feature 1.

12. The plurality of driving means for driving the plurality of imaging means are rotation driving means for independently rotating each of the plurality of imaging means, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the rotation position of the imaging means to be driven. The information processing apparatus according to feature 1.

13. The aforementioned plurality of imaging means are a plurality of zoom lenses in an optical system, The plurality of driving means for driving the plurality of imaging means are zoom driving means for independently zooming each of the plurality of zoom lenses, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the zoom position of the zoom lens to be driven. The information processing apparatus according to feature 1.

14. Multiple imaging means are multiple focusing lenses of an optical system, The plurality of driving means for driving the plurality of imaging means are focus driving means for independently focusing each of the plurality of focus lenses, The UI generation means generates a second user interface that displays at least one of a discrete drive amount and the drive range with respect to the focus position of the focus lens to be driven. The information processing apparatus according to feature 1.

15. The plurality of driving means that drive the plurality of imaging means are A pan drive means for independently panning each of the aforementioned multiple imaging means, A tilt drive means for independently tilting each of the aforementioned multiple imaging means, Rotation driving means for independently rotating each of the aforementioned plurality of imaging means, A zoom drive means for independently zooming each of the zoom lenses of the optical systems of the plurality of imaging means, and This includes at least one of the focus driving means for independently driving the focus lenses of the optical systems of the plurality of imaging means. The information processing apparatus according to feature 1.

16. The UI generation means is The imaging means is selected as the target to be driven, and A selection means exists on or around the first user interface. In at least one of the following cases, the discrete drive amount and at least one of the drive range are displayed in the second user interface. The information processing apparatus according to feature 1.

17. The information processing apparatus according to claim 1, Multiple imaging means, Multiple driving means for driving the multiple imaging means, A collision detection means that determines whether or not it can be driven based on the position of the imaging means to be driven, An imaging system characterized by comprising the following features.

18. An information processing method that accepts user input for driving multiple imaging means, An operation screen that accepts the aforementioned user input is generated, In generating the aforementioned operation screen, A first user interface that displays the drive amount for receiving input of the drive amount of the imaging means, A second user interface that displays, along with the position of the imaging means, at least one of the drive position corresponding to the drive amount and the drive amount up to the drive range in which the imaging means can be driven, Generate an operation screen that includes this. An information processing method characterized by the following:

19. A program for causing a computer to function as one of the means of an information processing device according to any one of claims 1 to 16.

Images