Control unit, and control method

Abstract

To provide a technique to prevent an imaging apparatus that is not a control target from operating.SOLUTION: A control unit determines if an imaging apparatus set as a control target executes an automatic control function, in a case where a user operation to remove the imaging apparatus set as the control target from the control target is executed, when determining that the imaging apparatus does not execute the automatic control function, transmits, to the imaging apparatus, a command for stopping control of a specific function of the imaging apparatus, and when determining that the imaging apparatus executes the automatic control function, continues the control of the specific function of the imaging apparatus.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a control technique for an imaging device. [Background technology]

[0002] Currently, in the video production market, systems that remotely control multiple remote cameras (hereinafter simply referred to as "cameras") connected to a network are increasing so that fewer cameramen can control multiple cameras. In such systems, an application is used that can change the settings of each camera and control PTZ (pan-tilt-zoom) while displaying images from multiple cameras. In PTZ control, focus control, and the like, it is also possible to control multiple cameras collectively. With such an application, because it has the feature of being able to connect to multiple cameras, it is possible to select whether or not to make each camera a control target. In the invention disclosed in Patent Document 1, a camera control system is proposed that acquires the camera status from the camera to be controlled, and displays the fact that the camera is not controllable when it is determined that the camera is not controllable. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3996960 Summary of the Invention [Problem to be solved by the invention]

[0004] Certain functions such as PTZ control and focus control are controlled by a control method called start / stop control, in which a control start command and a control stop command are used in combination. In the above-mentioned application, if a camera is removed from the controlled objects without a control stop command being sent after a control start command for the specific function is sent, there is a problem that the camera reaches the limit of the range of motion of the specific function without a command to stop the specific function being sent to the camera. In order to operate in accordance with the operator's intention, cameras that are not controlled should stop operating. The present invention provides a technique for suppressing the operation of imaging devices that are not controlled. [Means for solving the problem]

[0005] One aspect of the present invention is characterized in that it comprises a judgment means for judging whether an imaging device set as a control target is executing an automatic control function, and a control means for, when a user operation is performed to remove the imaging device set as a control target from the control target, sending a command to the imaging device to stop control of a specific function of the imaging device if the judgment means judges that the imaging device is not executing the automatic control function, and continuing control of the specific function of the imaging device if the judgment means judges that the imaging device is executing the automatic control function. Effect of the Invention

[0006] According to the configuration of the present invention, it is possible to prevent an imaging device that is not a control target from operating. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 shows an example of the configuration of a camera system 1000. [Diagram 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the imaging device 102. [Diagram 3] FIG. 2 is a block diagram showing an example of the hardware configuration of a control device 103. [Figure 4]FIG. 2 is a diagram showing an example of computer programs and data stored in a primary storage device 202 and a secondary storage device 203. [Diagram 5] FIG. 3 shows an example of computer programs and data stored in a primary storage device 302 and a secondary storage device 303. [Figure 6] 5 is a flowchart of a control command transmission process performed by the control device 103. [Figure 7] 6 is a flowchart of a process performed by the control device 103 to edit flag information of a desired imaging device 102. [Figure 8] 11 is a flowchart of a process performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. [Figure 9] FIG. 3 shows an example of computer programs and data stored in a primary storage device 302 and a secondary storage device 303. [Figure 10] 11 is a flowchart of a process performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. [Figure 11] 11 is a flowchart of a process performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0009] [First embodiment] An example of the configuration of a camera system 1000 according to this embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the camera system 1000 has a plurality of imaging devices (imaging device 102a, imaging device 102b, imaging device 102c, imaging device 102d) and a control device 103, and the plurality of imaging devices and the control device 103 are connected to a network 101.

[0010] First, the network 101 will be described. The network 101 is composed of, for example, a plurality of routers, switches, cables, etc. that comply with the Ethernet (registered trademark) communication standard. Note that the communication standard, scale, and configuration of the network 101 are not limited to a specific communication standard, a specific scale, or a specific configuration, so long as the network 101 is capable of data communication between a plurality of imaging devices and the control device 103. The network 101 may be composed of the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or a combination of these.

[0011] Next, the multiple imaging devices will be described. In this embodiment, the multiple imaging devices, ie, imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d, are all devices having the same configuration and similar functions, and therefore, hereinafter, these imaging devices will be referred to as imaging device 102. Therefore, the following description of imaging device 102 is similarly applied to imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d. Also, although the number of imaging devices 102 is four in FIG. 1, the number is not limited to this number.

[0012] The imaging device 102 captures a moving image and transmits an image of each frame in the moving image as a captured image to the control device 103 via the network 101. The imaging device 102 also performs various controls in response to a control command transmitted from the control device 103. The imaging device 102 may be a device that captures a still image periodically or irregularly and transmits the captured still image as a captured image to the control device 103 via the network 101. The imaging device 102 may compress and encode the captured image and then transmit it to the control device 103 via the network 101. The imaging device 102 may transmit the captured image to the control device 103 in response to a request from the control device 103, or may transmit the captured image to the control device 103 without receiving the request. The imaging device 102 may transmit the captured image to other devices in addition to the control device 103.

[0013] Next, a description will be given of the control device 103. The control device 103 is a computer device such as a PC (personal computer), a tablet terminal device, a smartphone, etc. The control device 103 may be a device such as a dedicated controller device for operating the imaging device 102.

[0014] The control device 103 receives captured images transmitted from the imaging device 102, stores them, displays them, and transfers them to other devices. The control device 103 also transmits control commands input in response to user operations to the imaging device 102. The control commands are "control commands for making the imaging device 102 execute a specific function." Examples of such control commands include control commands for controlling the pan, tilt, and zoom of the imaging device 102. Examples of such control commands include control commands for controlling the focus and white balance of the imaging device 102, and control commands (image acquisition requests) for requesting the imaging device 102 to transmit captured images. Examples of the control commands also include control commands for making the imaging device 102 perform various settings. In this way, the control device 103 is a device that manages the settings and control of the imaging device 102.

[0015] Next, an example of the hardware configuration of the image capture device 102 will be described with reference to the block diagram of Fig. 2. Note that the configuration shown in Fig. 2 is an example of a hardware configuration applicable to the image capture device 102, and is not intended to be limiting.

[0016] The CPU 201 executes various processes using computer programs and data stored in the primary storage device 202 and the secondary storage device 203. In this way, the CPU 201 controls the overall operation of the imaging device 102, and executes or controls each process that will be described as being performed by the imaging device 102.

[0017] The primary storage device 202 is a "high-speed readable / writable storage device" such as a RAM. The primary storage device 202 has an area for storing computer programs and data loaded from the secondary storage device 203, and an area for storing captured images input from the imaging unit 205 via the image input I / F 204. The primary storage device 202 further has an area for storing data such as control commands received from the control device 103 via the network I / F 207, and a work area used by the CPU 201 when executing various processes. In this way, the primary storage device 202 can provide various areas as appropriate.

[0018] The secondary storage device 203 is a non-volatile storage device such as an HDD, a flash memory, or an SD card, and may be a storage device within the imaging device 102, may be a storage device external to the imaging device 102, or may be a storage device removable from the imaging device 102. The secondary storage device 203 stores an OS (operating system) and computer programs and data for causing the CPU 201 to execute or control various processes described as being performed by the imaging device 102. The computer programs and data stored in the secondary storage device 203 are loaded into the primary storage device 202 as appropriate under the control of the CPU 201, and become targets for processing by the CPU 201.

[0019] The imaging unit 205 includes an optical system, a driving unit for driving the optical system, an imaging element for photoelectrically converting light incident through the optical system into a digital image signal, and a circuit for forming an image based on the digital image signal and performing various image processing on the image. The imaging element is a sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and converts an image formed on its light receiving surface into an electrical signal. The image captured by the imaging unit 205 is transferred to the primary storage device 202 or the secondary storage device 203 via the image input I / F 204 and the internal bus 208.

[0020] The PTZ driving unit 206 drives a motor (not shown) and the like under the control of the CPU 201 to control the pan (P), tilt (T), and zoom (Z) of the imaging unit 205. This allows the imaging device 102 to function as a so-called PTZ camera.

[0021] The network I / F 207 is an interface for connecting the image capturing device 102 to the network 101 , and the image capturing device 102 performs data communication with the control device 103 via the network I / F 207 .

[0022] The CPU 201 , the primary storage device 202 , the secondary storage device 203 , the image input I / F 204 , the PTZ driving unit 206 , and the network I / F 207 are all connected to an internal bus 208 .

[0023] Next, a hardware configuration example of the control device 103 will be described with reference to the block diagram of Fig. 3. Note that the configuration shown in Fig. 3 is an example of a hardware configuration applicable to the control device 103, and is not intended to be limiting to this configuration.

[0024] The CPU 301 executes various processes using computer programs and data stored in the primary storage device 302 and the secondary storage device 303. As a result, the CPU 301 controls the overall operation of the control device 103, and executes or controls each process described as being performed by the control device 103.

[0025] The primary storage device 302 is a "high-speed read / write storage device" such as a RAM. The primary storage device 302 has an area for storing computer programs and data loaded from the secondary storage device 303, and an area for storing data such as captured images received from the imaging device 102 via the network I / F 305. The primary storage device 302 further has a work area used when the CPU 301 executes various processes. In this way, the primary storage device 302 can provide various areas as appropriate.

[0026] The secondary storage device 303 is a non-volatile storage device such as a HDD, a flash memory, or an SD card, and may be a storage device within the control device 103, may be a storage device external to the control device 103, or may be a storage device removable from the control device 103. The secondary storage device 303 stores an OS (operating system) and computer programs and data for causing the CPU 301 to execute or control various processes described as being performed by the control device 103. The computer programs and data stored in the secondary storage device 303 are loaded into the primary storage device 302 as appropriate under the control of the CPU 301, and become targets for processing by the CPU 301.

[0027] The user input / output I / F 304 is a user interface such as a keyboard, a mouse, and a touch panel screen, and can input various instructions to the CPU 301 by operating the user. When the user input / output I / F 304 has a touch panel screen, the touch panel screen can display the processing result by the CPU 301 (such as a screen including a captured image received from the imaging device 102) and can accept operation input from the user. The user input / output I / F 304 may be a voice input device such as a microphone that can input voice from the user, and in this case, the instruction from the user input by voice is recognized by a well-known voice recognition technology. The user input / output I / F 304 may also include a joystick as an input device that the user operates to control the pan, tilt, and zoom of the imaging device 102.

[0028] Next, an example of computer programs and data stored in the primary storage device 202 and secondary storage device 203 of the imaging device 102 will be described with reference to Fig. 4. Fig. 4 shows an example of computer programs and data stored in the primary storage device 202 and secondary storage device 203 when the imaging device 102 executes processing. In the following, the computer programs stored in the primary storage device 202 may be described as the subject of processing. However, in reality, the functions of the corresponding computer programs are realized by the CPU 201 executing the computer programs.

[0029] First, the computer programs stored in the primary storage device 202 of the image capture device 102 will be described.

[0030] The OS 401 is a basic program for controlling the overall operation of the imaging device 102. The addresses and sizes of computer programs and data in the primary storage device 202 and the addresses and sizes of computer programs and data in the secondary storage device 203 are all managed by the OS 401.

[0031] The imaging program 402 is a computer program for acquiring an image captured by the imaging unit 205 via the image input I / F 204 in response to an image acquisition request from the control device 103 or instructions from other computer programs, and converting the acquired image into an encoded image such as JPEG or a moving image such as H.264.

[0032] The control program 403 is a computer program for controlling data communication with the control device 103 via the network I / F 207. Examples of the contents of the data communication include receiving a control command from the control device 103, transmitting a captured image to the control device 103, etc. Note that the control command (request) from the control device 103 may use a general communication protocol such as http (hypertext transfer protocol).

[0033] The management program 404 is a computer program for managing the control state of the imaging device 102. In this embodiment, the "control state of the imaging device 102" is assumed to be "whether the imaging device 102 is controlling panning". However, the state indicated by the "control state of the imaging device 102" is not limited to a specific state, and may be other states such as "whether the imaging device 102 is controlling tilt / zoom" or "whether the imaging device 102 is controlling focus / tally lamps". When the management program 404 receives a transmission request for the control state of the imaging device 102 from the control device 103, the management program 404 controls the control program 403 to transmit the latest control state managed for the imaging device 102 to the control device 103.

[0034] The PTZ control program 405 is a computer program for controlling the PTZ driving unit 206 based on control commands such as "a control command for controlling pan / tilt / zoom," "a control command for moving to a preset position," and "a control command for controlling trace playback" received from the control device 103. Furthermore, when the PTZ control program 405 receives a transmission request for the operating status of the image capture device 102, it controls the control program 403 to transmit the latest operating status of the image capture device 102 to the control device 103 in response to the transmission request.

[0035] Here, the preset is defined as a function for storing imaging parameters such as the orientation (PTZ value) and focus and white balance of the imaging device 102. Moving to a preset position means reading out the stored preset imaging parameters and controlling the imaging device 102.

[0036] Here, the trace is a function for storing the direction (PTZ value) of the imaging device 102 and imaging parameters together with time information when the imaging parameters were executed. When the stored trace is played back, the imaging device 102 controls the PTZ and various parameters at the stored timing.

[0037] Also, the imaging device 102 may automatically control the PTZ by itself through a preset tour in which the camera moves through a plurality of preset positions in sequence.

[0038] Next, the data (information) stored in the secondary storage device 203 of the image capture device 102 will be described.

[0039] The type information 406 includes controllability information indicating whether the imaging device 102 is a device capable of executing a specific function. The type information 406 includes controllability information regarding one or more functions. For example, the controllability information regarding pan, tilt, and zoom indicates a "PTZ machine" if the imaging device 102 is an imaging device capable of panning, tilting, and zooming, indicates a "zoom machine" if only zooming is possible, and indicates a "fixed machine" if none of panning, tilting, and zooming are possible. The controllability information may also be information that expresses whether a specific function is executable with a binary value of TRUE (executable) / FALSE (not executable).

[0040] In this embodiment, the pan function, tilt function, and zoom function are realized by changing the imaging direction of the imaging device 102 and driving the optical system of the imaging unit 205. However, similar functions may be realized by a so-called digital PTZ function that changes the range of an image area to be cut out from a captured image or the position from which the image area is cut out, or enlarges / reduces the cut-out image.

[0041] The operation status information 407 is information that indicates the operation status of the image capture device 102. The management program 404 collects the operation status of the image capture device 102, creates operation status information 407 that indicates the collected operation status, and stores the information in the secondary storage device 203.

[0042] 4 is an example, and is not intended to be limiting. For example, type information 406 and operation status information 407 may already be loaded from secondary storage device 203 to primary storage device 202 when processing is executed. Also, one or more of the computer programs described above as being stored in primary storage device 202 may be loaded from secondary storage device 203 to primary storage device 202 as needed.

[0043] Next, an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 of the control device 103 will be described with reference to Fig. 5. Fig. 5 shows an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 when the control device 103 executes processing. In the following, the computer programs stored in the primary storage device 302 may be described as the subject of processing. However, in reality, the functions of the corresponding computer programs are realized by the CPU 301 executing the computer programs.

[0044] First, the computer programs stored in the primary storage device 302 of the control device 103 will be described.

[0045] The OS 501 is a basic program for controlling the overall operation of the control device 103. The addresses and sizes of computer programs and data in the primary storage device 302 and the addresses and sizes of computer programs and data in the secondary storage device 303 are all managed by the OS 501.

[0046] The control program 502 is a computer program for controlling data communication with the imaging device 102 via the network I / F 305. Examples of the contents of the data communication include transmission of a control command to the imaging device 102, reception of a captured image from the imaging device 102, and the like.

[0047] The display program 503 is a computer program for displaying the captured image received from the imaging device 102, a GUI (Graphical User Interface) operated by the user to input a control command, and the like on the screen of the user input / output I / F 304. Note that the screen for displaying the captured image, GUI, and the like is not limited to the user input / output I / F 304. For example, the captured image, GUI, and the like may be displayed on a device external to the control device 103, in which case the control device 103 does not need to have the display program 503.

[0048] The control program 504 controls the control program 502 to transmit the various control commands input by the user through the user input / output I / F 304 to the image capture device 102 .

[0049] Next, a description will be given of the data (information) stored in the secondary storage device 303 of the control device 103. In type information 505, the type information 406 acquired from each image capture device 102 is registered.

[0050] The control target information 506 includes flag information indicating whether or not each imaging device 102 is a control target by the control device 103 (whether or not the control program 504 transmits a control command to the imaging device 102). When the user operates the user input / output I / F 304 to input a control command, the control program 504 refers to the control target information 506. Then, the control program 504 transmits a control command to the imaging device 102 whose flag information is set to "controlled by the control device 103 (the control program 504 transmits a control command)". In other words, the control program 504 does not transmit a control command to the imaging device 102 whose flag information is set to "not controlled by the control device 103 (the control program 504 does not transmit a control command)". The control target information 506 can be appropriately edited by the user operating the user input / output I / F 304.

[0051] Next, the transmission process of the control command by the control device 103 will be described with reference to the flowchart of FIG. 6. In step S2, when the user operates the user input / output I / F 304 to input a control command, the control program 504 initializes the value of the variable i to 0. In the following, a case will be described in which the control command input by the user operating the user input / output I / F 304 is a "control command for causing the imaging device 102 to start a panning operation" (a pan start command). The pan start command includes a panning direction and an operation speed. Note that the following description is similarly applied even if the control command is another type of control command. In addition, the input method of the control command is not limited to a specific input method, and for example, the user may input the control command by operating a keyboard, a mouse, a touch panel screen, a joystick, or the like included in the user input / output I / F 304. In addition, for example, the user may input the control command by voice into a microphone included in the user input / output I / F 304. This is also true when various information is input to the control device 103, not limited to a control command.

[0052] In step S3, the control program 504 determines whether the value of the variable i is less than the number of imaging devices 102 currently capable of communicating with (connected to) the control device 103. If the result of this determination is that the value of the variable i is less than the number of imaging devices 102 currently capable of communicating with the control device 103, the process proceeds to step S4. On the other hand, if the value of the variable i is not less than the number of imaging devices 102 currently capable of communicating with the control device 103, the process according to the flowchart in FIG. 6 ends.

[0053] In the following, a case will be described in which the imaging devices 102 currently capable of communicating with the control device 103 are four devices: imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d. Therefore, in this case, if the value of the variable i is less than 4, the process proceeds to step S4, and if the value of the variable i is not less than 4, the process according to the flowchart in FIG. 6 ends.

[0054] In step S4, the control program 504 sets the imaging device 102a as the 0th imaging device, the imaging device 102b as the 1st imaging device, the imaging device 102c as the 2nd imaging device, and the imaging device 102d as the 3rd imaging device. Then, the control program 504 determines whether the flag information of the i-th imaging device (imaging device[i]) in the control target information 506 stored in the secondary storage device 203 indicates "subject to control by the control device 103" or not.

[0055] If the result of this determination is that the flag information of the i-th imaging device indicates "subject to control by the control device 103", the process proceeds to step S5. On the other hand, if the flag information of the i-th imaging device indicates "not subject to control by the control device 103", the process proceeds to step S6.

[0056] In step S5, the control program 504 controls the control program 502 to transmit the above-mentioned pan start command to the i-th image capture device. Then, in step S6, the control program 504 increments the value of the variable i by 1. Then, the process proceeds to step S3 to perform the subsequent processes.

[0057] 6, the control program 504 refers to the control target information 506 when transmitting a pan start command to the image capture device 102. The control program 504 transmits the pan start command to the image capture device 102 that is set as a control target, and does not transmit the pan control command to the image capture device 102 that is not set as a control target.

[0058] Next, a process performed by the control device 103 for a user to edit flag information of a target imaging device among flag information included in the control target information 506 stored in the secondary storage device 303 will be described with reference to the flowchart of Fig. 7. In the following, the "target imaging device" will be referred to as "imaging device A".

[0059] In step S12, when the user operates the user input / output I / F 304 to set the imaging device A as a control target, the control program 504 updates the flag information for the imaging device A in the control target information 506 to "controlled by the control device 103."

[0060] Various operation methods can be applied to the "operation for setting the imaging device A as a control target." For example, the identification information (such as the name of the imaging device 102) of each imaging device 102 included in the control target information 506 is displayed together with a check box on a screen of the user input / output I / F 304. Then, when the user operates the user input / output I / F 304 to turn on (put a check mark) the check box corresponding to the imaging device A and then inputs a confirmation instruction, the flag information of the imaging device A is updated to "subject to control by the control device 103."

[0061] Next, a process performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the objects to be controlled will be described with reference to the flowchart of FIG.

[0062] In step S22, when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets, the control program 504 updates the flag information of the image capture device A to “not a target controlled by the control device 103” in the control target information 506. This updates the control target information 506.

[0063] Various operation methods can be applied to the "operation for removing imaging device A from the control target". For example, identification information of each imaging device 102 included in the control target information 506 is displayed together with a check box on a screen of the user input / output I / F 304. Then, when the user operates the user input / output I / F 304 to turn off (remove the check mark) the check box corresponding to imaging device A and then inputs a confirmation instruction, the flag information of the imaging device A is updated to "not a target to be controlled by the control device 103".

[0064] In step S23, the control program 504 determines whether or not a control command is being input to cause the image capture device A to perform a panning operation. There are various methods for determining whether or not a control command is being input to cause the image capture device A to perform a panning operation.

[0065] If a control command (pan stop command) for causing the imaging device A to stop (end) the pan operation is not transmitted to the imaging device A after a pan start command input in response to a user operation is transmitted to the imaging device A, the imaging device A continues the pan operation. In such a case, the control program 504 determines that "a control command for causing the imaging device A to execute a pan operation is being input."

[0066] Also, it is assumed that image capture device A continues the panning operation while the user is performing an operation to instruct a panning operation, such as by continuing to press a button in user input / output I / F 304 / a button displayed on the screen of user input / output I / F 304. In this case, when the user starts the operation to instruct a panning operation, a pan start command is transmitted to image capture device A, and when the user stops the operation, a pan stop command is transmitted to image capture device A. In such a case, control program 504 determines that "a control command to cause image capture device A to perform a panning operation is being input" while the user is performing the operation to instruct a panning operation.

[0067] In other words, determining "whether or not a control command for causing image capture device A to perform a panning operation is being input" is also determining "whether or not image capture device A is performing a panning operation."

[0068] If it is determined that a control command for causing image capture device A to perform a panning operation is being input, the process proceeds to step S24. On the other hand, if a control command for causing image capture device A to perform a panning operation is not being input, the process according to the flowchart in Fig. 8 ends. In step S24, the control program 504 controls the control program 502 to transmit the above-mentioned pan stop command to image capture device A.

[0069] By performing processing according to the flowchart of Figure 8, when a user operation is performed to remove imaging device A from the control targets, if a control command is being input to cause imaging device A to perform a pan operation, the control program 504 removes imaging device A from the control targets and sends a pan stop command to imaging device A, thereby causing imaging device A to stop the pan operation.

[0070] The processing according to the flowchart in FIG. 6 and the processing according to the flowchart in FIG. 8 can be performed in parallel, and even if the processing according to the flowchart in FIG. 6 is being executed, it is possible to interrupt and execute the processing according to the flowchart in FIG. 8.

[0071] In this manner, according to the present embodiment, when an imaging device is removed from the control targets and a user operation is being performed to cause the imaging device to execute a specific function, a command to stop the execution of the specific function is transmitted to the imaging device, so that even if an imaging device that is executing a specific function is removed from the control targets, it is possible to prevent the imaging device from continuing to execute the specific function.

[0072] In this embodiment, pan control is used as an example, but the same applies to start / stop control in general in which a control start command and a control stop command are used in combination.

[0073] In addition, in this embodiment, the fact that the image capture device A has been removed from the control targets or that the pan control currently in operation on the image capture device A has been stopped may be displayed on the screen of the user input / output I / F 304 using images or text to notify the user of this information.

[0074] [Second embodiment] In this embodiment, the difference from the first embodiment will be described, and unless otherwise specified below, it is assumed to be the same as the first embodiment. In the first embodiment, when a user operation is performed to remove the imaging device A from the control targets, it is determined whether or not a control command for causing the imaging device A to perform a pan operation is being input. In this embodiment, when a user operation is performed to remove the imaging device A from the control targets, it is determined whether or not the imaging device A is performing a pan operation (under pan control) by referring to the operating state of the imaging device A.

[0075] An example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 of the control device 103 will be described with reference to Fig. 9. Fig. 9 shows an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 when the control device 103 executes processing.

[0076] In FIG. 9, the same computer programs and data as those shown in FIG. 5 are denoted by the same reference numerals, and the description of these computer programs and data will be omitted.

[0077] First, the computer programs stored in the primary storage device 302 of the control device 103 will be described. The acquisition program 507 transmits an information acquisition command as a control command to the imaging device 102, receives the operation status information 407 transmitted by the control program 502 of the imaging device 102 in response to the information acquisition command, and registers it in the operation status information 508. The acquisition program 507 periodically performs this series of processes. Note that when the operation status information 407 is updated, the imaging device 102 may transmit the updated operation status information 407 to the control device 103. In this case, when the operation status information 407 is transmitted from the imaging device 102, the acquisition program 507 receives the operation status information 407 and registers it in the operation status information 508.

[0078] Next, a description will be given of data (information) registered in the secondary storage device 303 of the control device 103. In the operation status information 508, the operation status information 407 received by the control device 103 from each of the imaging devices 102 is registered.

[0079] Next, the process performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets will be described with reference to the flowchart in Fig. 10. In Fig. 10, the same process steps as those shown in Fig. 8 are assigned the same step numbers, and the description of those process steps will be omitted.

[0080] In step S33, the control program 504 determines whether the image capture device A is performing a panning operation (under panning control). There are various methods for determining whether the image capture device A is performing a panning operation (under panning control).

[0081] For example, the control program 504 refers to the "operation status information 407 of the imaging device A" registered in the operation status information 508 stored in the secondary storage device 303. Then, when the operation status information 407 of the imaging device A indicates that "the imaging device A is performing a panning operation", the control program 504 determines that the imaging device A is performing a panning operation (under pan control). On the other hand, when the operation status information 407 of the imaging device A indicates that "the imaging device A is not performing a panning operation", the control program 504 determines that the imaging device A is not performing a panning operation (under pan control).

[0082] If it is determined that the image capture device A is performing a panning operation (under panning control), the process proceeds to step S24. On the other hand, if the image capture device A is not performing a panning operation (under panning control), the process according to the flowchart in FIG. 10 ends.

[0083] By performing processing according to the flowchart of Figure 10, when a user operation is performed to remove imaging device A from the control targets, if the imaging device A is performing a pan operation, the control program 504 removes the imaging device A from the control targets and sends a pan stop command to the imaging device A, thereby causing the imaging device A to stop the pan operation.

[0084] It should be noted that the processing according to the flowchart in FIG. 6 and the processing according to the flowchart in FIG. 10 can be operated in parallel, and even if the processing according to the flowchart in FIG. 6 is being executed, it is possible to interrupt and execute the processing according to the flowchart in FIG. 10.

[0085] In this manner, according to the present embodiment, if an imaging device is executing a specific function when the imaging device is removed from the control targets, a command to stop the execution of the specific function is transmitted to the imaging device, and therefore, even if an imaging device executing a specific function is removed from the control targets, the imaging device can be prevented from continuing to execute the specific function.

[0086] In this embodiment, whether or not to send a stop command to stop the function being executed to an imaging device that has been removed from the control target is determined based on the operating state of the imaging device. However, the stop command (stop command for start-stop control) may be sent unconditionally to an imaging device that has been removed from the control target.

[0087] <Modification of the second embodiment> The following describes the difference from the second embodiment, and it is assumed that the second embodiment is the same as the second embodiment unless otherwise specified below. In the second embodiment, when an imaging device is removed from the control target, a specific function is stopped according to the operation state of the imaging device. In this modification, when an imaging device is removed from the control target, if a specific function is operating in the imaging device and an automatic control function of the imaging device is not operating, a command for stopping the operation of the specific function is transmitted to the imaging device. Note that the automatic control function of the imaging device includes preset, preset patrol, trace, etc.

[0088] The process performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets will be described with reference to the flowchart in Fig. 11. In Fig. 11, the same process steps as those shown in Fig. 10 are assigned the same step numbers, and the description of those process steps will be omitted.

[0089] If the result of the determination in step S33 is that the image capture device A is performing a panning operation (under panning control), the process proceeds to step S44. On the other hand, if the image capture device A is not performing a panning operation (under panning control), the process according to the flowchart in FIG. 11 ends.

[0090] In step S44, the control program 504 refers to information indicating whether or not the imaging device A is operating the automatic control function, which is registered in the operation state information 508 as the operation state of the imaging device A. If the information indicates that the imaging device A is not operating the automatic control function, the process proceeds to step S24. On the other hand, if the information indicates that the imaging device A is operating the automatic control function, the process according to the flowchart in Fig. 11 ends. In this embodiment, the automatic control function is at least one of preset, preset tour, and trace, but is not limited to these.

[0091] By performing processing according to the flowchart of FIG. 11, when a user operation is performed to remove the imaging device A from the control targets, if the imaging device A is performing a pan operation and the imaging device A is not operating the automatic control function, the control program 504 removes the imaging device A from the control targets and sends a pan stop command to the imaging device A, thereby causing the imaging device A to stop the pan operation.

[0092] In this way, according to the present embodiment, when an imaging device is removed from the control targets, if the imaging device is executing a specific function and is not operating an automatic control function, a command to stop the execution of the specific function is transmitted to the imaging device. Therefore, even if an imaging device that is executing a specific function is removed from the control targets, it is possible to prevent the imaging device from continuing to execute the specific function.

[0093] In the above embodiments and modifications, the CPU executes the above processes by executing a computer program stored in a primary storage device. However, instead of the computer program, the above processes may be executed by using hardware that realizes the functions of the computer program.

[0094] Furthermore, the numerical values, processing timing, processing order, destination / source of data (information), etc. used in the above embodiments and variant examples are given as examples to provide a concrete explanation, and are not intended to be limited to such examples.

[0095] In addition, some or all of the embodiments and modified examples described above may be used in appropriate combination. In addition, some or all of the embodiments and modified examples described above may be used selectively.

[0096] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0097] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0098] 301: CPU 302: Primary storage device 303: Secondary storage device 304: User input / output I / F 305: Network I / F 306: Internal bus

Claims

1. a determination means for determining whether an imaging device set as a control target is executing an automatic control function; When a user performs an operation to remove an imaging device set as a control target from the control targets, In the determination means, sending a command to the imaging device to stop control of a specific function of the imaging device when it is determined that the imaging device is not executing an automatic control function; a control means for continuing to control the specific function of the imaging device when it is determined that the imaging device is executing the automatic control function; A control device comprising:

2. The control device according to claim 1 , wherein the specific function is a function for controlling panning of the imaging device.

3. The control device according to claim 1 , wherein the specific function is a function for controlling a tilt of the imaging device.

4. The control device according to claim 1 , wherein the specific function is a function for controlling a zoom of the image pickup device.

5. 2. The control device according to claim 1, wherein the automatic control function is a function for controlling at least one of a preset, a preset tour, and a trace of the imaging device.

6. a determination means for determining whether an imaging device set as a control target is executing an automatic control function; When a specific operation is performed by a user, sending a command to the imaging device to stop control of pan or tilt of the imaging device when the determination means determines that the imaging device is not executing the automatic control function; a control means for continuing control of the pan or tilt of the imaging device when it is determined that the imaging device is executing the automatic control function; A control device comprising:

7. The control device according to claim 6 , wherein the specific operation is an operation for removing the imaging device, which has been set as a control target, from the control targets.

8. 7. The control device according to claim 6, wherein the automatic control function is a function for controlling at least one of a preset, a preset tour, and a trace of the imaging device.

9. When a user performs an operation to remove an imaging device set as a control target from the control targets, transmitting, to the imaging device, a command for stopping control of a specific function of the imaging device when it is determined in the determination step of determining whether the imaging device is executing an automatic control function that the imaging device is not executing the automatic control function; a control step of continuing control of the specific function of the imaging device when it is determined in the determination step that the imaging device is executing the automatic control function; A control method comprising:

10. a determination step of determining whether the imaging device set as the control target is executing an automatic control function; When a specific operation is performed by a user, If it is determined in the determination step that the imaging device is not executing an automatic control function, a command is sent to the imaging device to stop control of pan or tilt of the imaging device; a control step of continuing control of the pan or tilt of the imaging device when it is determined in the determination step that the imaging device is executing the automatic control function; A control method comprising:

11. A computer program for causing a computer to function as the control device according to any one of claims 1 to 8.

Images