Control device and control method

Abstract

To provide a technique to prevent an imaging apparatus that is not a control target from operating.SOLUTION: A control unit determines if an imaging apparatus set as a control target executes an automatic control function, in a case where a user operation to remove the imaging apparatus set as the control target from the control target is executed, when determining that the imaging apparatus does not execute the automatic control function, transmits, to the imaging apparatus, a command for stopping control of a specific function of the imaging apparatus, and when determining that the imaging apparatus executes the automatic control function, continues the control of the specific function of the imaging apparatus.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a control technique for an imaging device. [Background technology]

[0002] Currently, in the video production market, systems that remotely control multiple remote cameras (hereinafter simply referred to as "cameras") connected to a network are becoming more common, allowing fewer camera operators to control multiple cameras. Such systems use applications that display the images from the multiple cameras while allowing users to change the settings of each camera and control the PTZ (pan-tilt-zoom) of the camera. Controlling the PTZ and focus, for example, allows simultaneous control of multiple cameras. Because such applications can connect to multiple cameras, users can select whether or not to control each camera. Patent Document 1 discloses a camera control system that acquires the camera status from the camera to be controlled and, if it is determined that the camera is uncontrollable, displays a message indicating that the camera is uncontrollable. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3996960 Summary of the Invention [Problem to be solved by the invention]

[0004] Certain functions, such as PTZ control and focus control, are controlled using a control method called start / stop control, in which a start command and a stop command are used in combination. In the above-mentioned application, if a camera is removed from the controlled list after a start command for a specific function has been sent but a stop command for that function has not been sent, a command to stop the specific function is not sent to the camera, resulting in the camera reaching the limit of the range of motion for that function. To comply with the operator's intention, cameras that are not the controlled objects should be stopped. The present invention provides a technology for preventing imaging devices that are not the controlled objects from operating. [Means for solving the problem]

[0005] One aspect of the present invention is characterized by comprising a determination means for determining whether an imaging device set as a control target is executing an automatic control function, and a control means for, when a user operation is performed to remove an imaging device set as a control target from the control target, transmitting to the imaging device a command to stop control of a specific function of the imaging device if the determination means determines that the imaging device is not executing the automatic control function, and continuing control of the specific function of the imaging device if the determination means determines that the imaging device is executing the automatic control function. [Effects of the Invention]

[0006] According to the configuration of the present invention, it is possible to prevent operation of imaging devices that are not the object of control. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 shows an example of the configuration of a camera system 1000. [Figure 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the imaging device 102. [Figure 3] FIG. 2 is a block diagram showing an example of the hardware configuration of a control device 103. [Figure 4]FIG. 2 is a diagram showing an example of computer programs and data stored in a primary storage device 202 and a secondary storage device 203. [Figure 5] FIG. 3 is a diagram showing an example of computer programs and data stored in a primary storage device 302 and a secondary storage device 303. [Figure 6] 10 is a flowchart of a control command transmission process performed by the control device 103. [Figure 7] 10 is a flowchart of a process performed by the control device 103 to edit flag information of a desired image capture device 102. [Figure 8] 10 is a flowchart of processing performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. [Figure 9] FIG. 3 is a diagram showing an example of computer programs and data stored in a primary storage device 302 and a secondary storage device 303. [Figure 10] 10 is a flowchart of processing performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. [Figure 11] 10 is a flowchart of processing performed by the control device 103 when an operation is performed to remove the image capture device A from the control targets. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0009] [First embodiment] An example of the configuration of a camera system 1000 according to this embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the camera system 1000 has a plurality of image capturing devices (image capturing device 102a, image capturing device 102b, image capturing device 102c, and image capturing device 102d) and a control device 103, and the plurality of image capturing devices and the control device 103 are connected to a network 101.

[0010] First, the network 101 will be described. The network 101 is configured from, for example, a plurality of routers, switches, cables, etc. that comply with the Ethernet (registered trademark) communication standard. Note that the communication standard, scale, and configuration of the network 101 are not limited to a specific communication standard, a specific scale, or a specific configuration, as long as data communication is possible between a plurality of imaging devices and the control device 103. The network 101 may be configured from the Internet, a wired LAN (Local Area Network), a wireless LAN, a WAN (Wide Area Network), or a combination of these.

[0011] Next, the multiple imaging devices will be described. In this embodiment, the multiple imaging devices, imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d, all have the same configuration and similar functions, and therefore, hereinafter, these imaging devices will be referred to as imaging device 102. Therefore, the following description of imaging device 102 applies equally to imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d. Also, although the number of imaging devices 102 is four in FIG. 1, the number is not limited to this.

[0012] The imaging device 102 captures a moving image and transmits images of each frame in the moving image as captured images to the control device 103 via the network 101. The imaging device 102 also performs various controls in response to control commands transmitted from the control device 103. The imaging device 102 may be a device that captures still images periodically or irregularly and transmits the captured still images as captured images to the control device 103 via the network 101. The imaging device 102 may also compress and encode the captured images before transmitting them to the control device 103 via the network 101. The imaging device 102 may transmit the captured images to the control device 103 in response to a request from the control device 103, or may transmit the captured images to the control device 103 without receiving the request. The imaging device 102 may also transmit the captured images to other devices in addition to the control device 103.

[0013] Next, we will explain the control device 103. The control device 103 is a computer device such as a PC (personal computer), a tablet terminal device, a smartphone, etc. Note that the control device 103 may also be a device such as a dedicated controller device for operating the imaging device 102.

[0014] The control device 103 receives captured images transmitted from the imaging device 102 and stores, displays, or transfers the captured images to another device. The control device 103 also transmits control commands input in response to user operations to the imaging device 102. The control commands are "control commands for causing the imaging device 102 to execute specific functions." Examples of such control commands include control commands for controlling the pan, tilt, and zoom of the imaging device 102. Examples of such control commands include control commands for controlling the focus and white balance of the imaging device 102, and control commands (image acquisition requests) for requesting the imaging device 102 to transmit captured images. The control commands also include, for example, control commands for causing the imaging device 102 to perform various settings. In this way, the control device 103 is a device that manages the settings and control of the imaging device 102.

[0015] Next, an example of the hardware configuration of the image capture device 102 will be described using the block diagram of Fig. 2. Note that the configuration shown in Fig. 2 is an example of a hardware configuration applicable to the image capture device 102, and is not intended to be limiting.

[0016] The CPU 201 executes various processes using computer programs and data stored in the primary storage device 202 and the secondary storage device 203. As a result, the CPU 201 controls the overall operation of the image capture device 102 and executes or controls each process that will be described as being performed by the image capture device 102.

[0017] The primary storage device 202 is a "high-speed read / write storage device" such as RAM. The primary storage device 202 has an area for storing computer programs and data loaded from the secondary storage device 203, and an area for storing captured images input from the imaging unit 205 via the image input I / F 204. The primary storage device 202 also has an area for storing data such as control commands received from the control device 103 via the network I / F 207, and a work area used by the CPU 201 when executing various processes. In this way, the primary storage device 202 can provide various areas as needed.

[0018] The secondary storage device 203 is a non-volatile storage device such as an HDD, flash memory, or SD card, and may be a storage device within the imaging device 102, a storage device external to the imaging device 102, or a storage device detachable from the imaging device 102. The secondary storage device 203 stores an OS (operating system), as well as computer programs and data for causing the CPU 201 to execute or control various processes described as being performed by the imaging device 102. The computer programs and data stored in the secondary storage device 203 are loaded into the primary storage device 202 as appropriate under the control of the CPU 201, and become the subject of processing by the CPU 201.

[0019] The imaging unit 205 includes an optical system, a driving unit for driving the optical system, an imaging element for photoelectrically converting light incident through the optical system into a digital image signal, and circuits for constructing a captured image based on the digital image signal and performing various image processing on the captured image. The imaging element is a sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and converts an image formed on its light-receiving surface into an electrical signal. The captured image captured by the imaging unit 205 is transferred to the primary storage device 202 or the secondary storage device 203 via the image input I / F 204 and the internal bus 208.

[0020] The PTZ driving unit 206 drives a motor (not shown) and the like under the control of the CPU 201 to control the pan (P), tilt (T), and zoom (Z) of the imaging unit 205. This allows the imaging device 102 to function as a so-called PTZ camera.

[0021] The network I / F 207 is an interface for connecting the image capturing device 102 to the network 101 , and the image capturing device 102 performs data communication with the control device 103 via the network I / F 207 .

[0022] The CPU 201 , primary storage device 202 , secondary storage device 203 , image input I / F 204 , PTZ driving unit 206 , and network I / F 207 are all connected to an internal bus 208 .

[0023] Next, an example of the hardware configuration of the control device 103 will be described using the block diagram of Fig. 3. Note that the configuration shown in Fig. 3 is an example of a hardware configuration applicable to the control device 103, and is not intended to be limiting to this configuration.

[0024] The CPU 301 executes various processes using computer programs and data stored in the primary storage device 302 and the secondary storage device 303. As a result, the CPU 301 controls the overall operation of the control device 103, and executes or controls each process that will be described as being performed by the control device 103.

[0025] The primary storage device 302 is a "high-speed read / write storage device" such as RAM. The primary storage device 302 has an area for storing computer programs and data loaded from the secondary storage device 303, and an area for storing data such as captured images received from the imaging device 102 via the network I / F 305. The primary storage device 302 also has a work area used by the CPU 301 when executing various processes. In this way, the primary storage device 302 can provide various areas as needed.

[0026] The secondary storage device 303 is a non-volatile storage device such as a HDD, flash memory, or SD card, and may be a storage device within the control device 103, a storage device external to the control device 103, or a storage device detachable from the control device 103. The secondary storage device 303 stores an OS (operating system) and computer programs and data for causing the CPU 301 to execute or control various processes described as being performed by the control device 103. The computer programs and data stored in the secondary storage device 303 are loaded into the primary storage device 302 as appropriate under the control of the CPU 301, and become the subject of processing by the CPU 301.

[0027] The user input / output I / F 304 is a user interface such as a keyboard, mouse, or touch panel screen, and allows the user to input various instructions to the CPU 301 by operating it. If the user input / output I / F 304 has a touch panel screen, the touch panel screen can display the processing results of the CPU 301 (such as a screen including a captured image received from the imaging device 102) and can also accept operation inputs from the user. The user input / output I / F 304 may be a voice input device such as a microphone that can input voice from the user. In this case, the voice-input instructions from the user are recognized using well-known voice recognition technology. The user input / output I / F 304 may also include a joystick as an input device that the user operates to control the pan, tilt, and zoom of the imaging device 102.

[0028] Next, an example of computer programs and data stored in the primary storage device 202 and secondary storage device 203 of the imaging device 102 will be described with reference to Fig. 4. Fig. 4 shows an example of computer programs and data stored in the primary storage device 202 and secondary storage device 203 when the imaging device 102 executes processing. In the following, the computer programs stored in the primary storage device 202 may be described as the subject of processing. However, in reality, the functions of the corresponding computer programs are realized by the CPU 201 executing the computer programs.

[0029] First, the computer programs stored in the primary storage device 202 of the image capture device 102 will be described.

[0030] The OS 401 is a basic program for controlling the overall operation of the imaging device 102. The addresses and sizes of computer programs and data in the primary storage device 202 and the addresses and sizes of computer programs and data in the secondary storage device 203 are all managed by the OS 401.

[0031] The imaging program 402 is a computer program for acquiring an image captured by the imaging unit 205 via the image input I / F 204 in response to an image acquisition request from the control device 103 or instructions from other computer programs, and converting the acquired image into an encoded image such as JPEG or a moving image such as H.264.

[0032] The control program 403 is a computer program for controlling data communication with the control device 103 via the network I / F 207. Examples of the content of the data communication include receiving a control command from the control device 103 and sending a captured image to the control device 103. Note that the control command (request) from the control device 103 may use a general communication protocol such as http (hypertext transfer protocol).

[0033] The management program 404 is a computer program for managing the control status of the image capturing device 102. In this embodiment, the "control status of the image capturing device 102" is assumed to be "whether the image capturing device 102 is controlling panning." However, the state indicated by the "control status of the image capturing device 102" is not limited to a specific state, and may be other states such as "whether the image capturing device 102 is controlling tilt / zoom" or "whether the image capturing device 102 is controlling focus / tally lamps." When the management program 404 receives a request to transmit the control status of the image capturing device 102 from the control device 103, it controls the control program 403 to transmit the latest control status managed for the image capturing device 102 to the control device 103.

[0034] The PTZ control program 405 is a computer program for controlling the PTZ driving unit 206 based on control commands such as a "control command for controlling pan / tilt / zoom," a "control command for moving to a preset position," and a "control command for controlling trace playback" received from the control device 103. Furthermore, when the PTZ control program 405 receives a transmission request for the operating status of the image capturing device 102, it controls the control program 403 to transmit the latest operating status of the image capturing device 102 to the control device 103 in response to the transmission request.

[0035] Here, the preset is a function for storing imaging parameters such as the orientation (PTZ value) of the imaging device 102, focus, and white balance. Moving to a preset position means reading out the stored preset imaging parameters and controlling the imaging device 102.

[0036] Here, the trace is a function that stores the direction (PTZ value) of the imaging device 102 and the time information when the imaging parameters were executed. When the stored trace is played back, the imaging device 102 controls the PTZ and various parameters at the stored timing.

[0037] Furthermore, the imaging device 102 may automatically control the PTZ by itself through a preset tour that moves sequentially through a plurality of preset positions.

[0038] Next, the data (information) stored in the secondary storage device 203 of the image capture device 102 will be described.

[0039] The type information 406 includes controllability information indicating whether the imaging device 102 is a device capable of executing a specific function. The type information 406 includes controllability information regarding one or more functions. For example, the controllability information regarding pan, tilt, and zoom indicates a "PTZ device" if the imaging device 102 is an imaging device capable of panning, tilting, and zooming, indicates a "zoom device" if only zooming is possible, and indicates a "fixed device" if none of panning, tilting, and zooming are possible. The controllability information may also be information that expresses whether a specific function is executable using two values, TRUE (executable) / FALSE (unexecutable).

[0040] In this embodiment, the pan function, tilt function, and zoom function are realized by changing the imaging direction of the imaging device 102 and driving the optical system of the imaging unit 205. However, similar functions may be realized by a so-called digital PTZ function that changes the range of an image area to be cut out from a captured image, the position from which the image area is cut out, and enlarges / reduces the cut-out image.

[0041] The operating status information 407 is information that indicates the operating status of the image capture device 102. The management program 404 collects the operating status of the image capture device 102, creates operating status information 407 that indicates the collected operating status, and stores the information in the secondary storage device 203.

[0042] 4 is an example, and is not intended to be limiting. For example, type information 406 and operating status information 407 may already be loaded from secondary storage device 203 to primary storage device 202 when processing is executed. Furthermore, one or more of the computer programs described above as being stored in primary storage device 202 may be loaded from secondary storage device 203 to primary storage device 202 as needed.

[0043] Next, an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 of the control device 103 will be described with reference to Fig. 5. Fig. 5 shows an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 when the control device 103 executes processing. In the following, the computer programs stored in the primary storage device 302 may be described as the subject of processing. However, in reality, the functions of the corresponding computer programs are realized by the CPU 301 executing the computer programs.

[0044] First, the computer programs stored in the primary storage device 302 of the control device 103 will be described.

[0045] The OS 501 is a basic program for controlling the overall operation of the control device 103. The addresses and sizes of computer programs and data in the primary storage device 302 and the addresses and sizes of computer programs and data in the secondary storage device 303 are all managed by the OS 501.

[0046] The control program 502 is a computer program for controlling data communication with the image capturing device 102 via the network I / F 305. Examples of the content of the data communication include sending a control command to the image capturing device 102, receiving a captured image from the image capturing device 102, etc.

[0047] The display program 503 is a computer program for displaying, on the screen of the user input / output I / F 304, captured images received from the imaging device 102, a GUI (graphical user interface) operated by the user to input control commands, and the like. Note that the screen for displaying the captured images, GUI, and the like is not limited to the user input / output I / F 304. For example, the captured images, GUI, and the like may be displayed on a device external to the control device 103, in which case the control device 103 does not need to have the display program 503.

[0048] The control program 504 controls the control program 502 to transmit the above-mentioned various control commands input by the user through the user input / output I / F 304 to the image capture device 102 .

[0049] Next, a description will be given of the data (information) stored in the secondary storage device 303 of the control device 103. In the type information 505, the type information 406 acquired from each image capture device 102 is registered.

[0050] The control target information 506 includes flag information indicating, for each image capture device 102, whether the image capture device 102 is a control target by the control device 103 (whether the control program 504 will send a control command to the image capture device 102). When a user operates the user input / output I / F 304 to input a control command, the control program 504 refers to the control target information 506. The control program 504 then sends a control command to an image capture device 102 whose flag information is set to "subject to control by the control device 103 (the control program 504 will send a control command)." In other words, the control program 504 does not send a control command to an image capture device 102 whose flag information is set to "not subject to control by the control device 103 (the control program 504 will not send a control command)." The control target information 506 can be edited appropriately by the user operating the user input / output I / F 304.

[0051] Next, the control command transmission process by the control device 103 will be described with reference to the flowchart in FIG. 6. In step S2, when the user operates the user input / output I / F 304 to input a control command, the control program 504 initializes the value of the variable i to 0. The following describes a case where the control command input by the user operating the user input / output I / F 304 is a "control command for causing the image capture device 102 to start a panning operation" (a pan start command). The pan start command includes the pan direction and operation speed. Note that the following description also applies to other types of control commands. Furthermore, the method for inputting a control command is not limited to a specific input method. For example, the user may input the control command by operating a keyboard, mouse, touch panel screen, joystick, or the like included in the user input / output I / F 304. Furthermore, for example, the user may input the control command by voice into a microphone included in the user input / output I / F 304. This also applies to various types of information input to the control device 103, not just control commands.

[0052] In step S3, the control program 504 determines whether the value of the variable i is less than the number of imaging devices 102 that can currently communicate with (are connected to) the control device 103. If the result of this determination is that the value of the variable i is less than the number of imaging devices 102 that can currently communicate with the control device 103, the process proceeds to step S4. On the other hand, if the value of the variable i is not less than the number of imaging devices 102 that can currently communicate with the control device 103, the process according to the flowchart in FIG. 6 ends.

[0053] The following describes a case where there are four imaging devices 102 currently capable of communicating with the control device 103: imaging device 102a, imaging device 102b, imaging device 102c, and imaging device 102d. Therefore, in this case, if the value of variable i is less than 4, the process proceeds to step S4, and if the value of variable i is not less than 4, the process according to the flowchart in FIG. 6 ends.

[0054] In step S4, the control program 504 sets the imaging device 102a as the 0th imaging device, the imaging device 102b as the 1st imaging device, the imaging device 102c as the 2nd imaging device, and the imaging device 102d as the 3rd imaging device. Then, the control program 504 determines whether the flag information of the i-th imaging device (imaging device[i]) in the control target information 506 stored in the secondary storage device 203 indicates "subject to control by the control device 103."

[0055] If the result of this determination is that the flag information of the i-th imaging device indicates "subject to control by the control device 103," the process proceeds to step S5. On the other hand, if the flag information of the i-th imaging device indicates "not subject to control by the control device 103," the process proceeds to step S6.

[0056] In step S5, the control program 504 controls the control program 502 to send the above-mentioned pan start command to the i-th image capture device. Then, in step S6, the control program 504 increments the value of the variable i by 1. Then, the process proceeds to step S3, and the subsequent processes are performed.

[0057] 6, the control program 504 refers to the control target information 506 when transmitting a pan start command to an image capture device 102. The control program 504 then transmits the pan start command to an image capture device 102 that has been set as a control target, and does not transmit the pan control command to an image capture device 102 that has not been set as a control target.

[0058] Next, the process performed by the control device 103 to allow the user to edit the flag information of a target imaging device among the flag information included in the control target information 506 stored in the secondary storage device 303 will be described with reference to the flowchart in Fig. 7. Hereinafter, the "target imaging device" will be referred to as "imaging device A."

[0059] In step S12, when the user operates the user input / output I / F 304 to set the imaging device A as a control target, the control program 504 updates the flag information for the imaging device A in the control target information 506 to "controlled by the control device 103."

[0060] Various operation methods can be applied to the "operation for setting image capture device A as a control target." For example, the identification information (such as the name of the image capture device 102) of each image capture device 102 included in the control target information 506 is displayed together with a check box on a screen of the user input / output I / F 304. Then, when the user operates the user input / output I / F 304 to turn on (put a check mark in) the check box corresponding to image capture device A and then inputs a confirmation instruction, the flag information of the image capture device A is updated to "subject to control by the control device 103."

[0061] Next, a process performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets will be described with reference to the flowchart of FIG.

[0062] In step S22, when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets, the control program 504 updates the flag information for the image capture device A to "not a target to be controlled by the control device 103" in the control target information 506. This updates the control target information 506.

[0063] Various operation methods can be applied to the "operation to remove image capture device A from the control targets." For example, the identification information of each image capture device 102 included in the control target information 506 is displayed together with a check box on a screen of the user input / output I / F 304. Then, when the user operates the user input / output I / F 304 to turn off (remove the check mark) the check box corresponding to image capture device A and then inputs a confirmation instruction, the flag information of the image capture device A is updated to "not a target to be controlled by the control device 103."

[0064] In step S23, the control program 504 determines whether or not a control command is being input to cause the image capture device A to perform a panning operation. There are various methods for determining whether or not a control command is being input to cause the image capture device A to perform a panning operation.

[0065] If a pan start command input in response to a user operation is transmitted to image capture device A, and then a control command (pan stop command) for causing image capture device A to stop (end) the panning operation is not transmitted to image capture device A, image capture device A continues the panning operation. In such a case, control program 504 determines that "a control command for causing image capture device A to perform a panning operation is being input."

[0066] Also, it is assumed that image capture device A continues a panning operation while the user is performing an operation to instruct a panning operation, such as by continuing to press a button on user input / output I / F 304 / a button displayed on the screen of user input / output I / F 304. In this case, when the user starts the operation to instruct a panning operation, a start panning command is transmitted to image capture device A, and when the user stops the operation, a stop panning command is transmitted to image capture device A. In such a case, control program 504 determines that "a control command to cause image capture device A to perform a panning operation is being input" while the user is performing the operation to instruct a panning operation.

[0067] In other words, determining "whether or not a control command to cause image capture device A to perform a panning operation is being input" also amounts to determining "whether or not image capture device A is performing a panning operation."

[0068] If it is determined that a control command for causing image capture device A to perform a panning operation is being input, the process proceeds to step S24. On the other hand, if a control command for causing image capture device A to perform a panning operation is not being input, the process according to the flowchart in Fig. 8 ends. In step S24, the control program 504 controls the control program 502 to send the above-mentioned pan stop command to image capture device A.

[0069] By performing processing according to the flowchart of Figure 8, when a user operation is performed to remove image capture device A from the control targets, if a control command to cause image capture device A to perform a pan operation is being input, control program 504 removes image capture device A from the control targets and sends a pan stop command to image capture device A, thereby causing image capture device A to stop the pan operation.

[0070] The processing according to the flowchart in FIG. 6 and the processing according to the flowchart in FIG. 8 can be performed in parallel, and even if the processing according to the flowchart in FIG. 6 is being executed, it can be interrupted and the processing according to the flowchart in FIG. 8 can be executed.

[0071] Thus, according to this embodiment, if an imaging device is removed from the control targets and a user operation is being performed to cause the imaging device to execute a specific function, a command to stop the execution of the specific function is transmitted to the imaging device, thereby preventing the imaging device from continuing to execute the specific function even if the imaging device is removed from the control targets while it is executing the specific function.

[0072] In this embodiment, pan control is used as an example, but the same applies to start / stop control in general, in which a control start command and a control stop command are used in combination.

[0073] In addition, in this embodiment, the fact that the image capture device A has been removed from the control targets or that the pan control currently in operation on the image capture device A has been stopped may be displayed on the screen of the user input / output I / F 304 using images or text, thereby notifying the user of this information.

[0074] [Second embodiment] In this embodiment, differences from the first embodiment will be described, and unless otherwise specified below, it will be assumed that this embodiment is the same as the first embodiment. In the first embodiment, when a user operation to remove image capture device A from control targets is performed, it is determined whether a control command to cause image capture device A to perform a pan operation is being input. In this embodiment, when a user operation to remove image capture device A from control targets is performed, it is determined whether image capture device A is performing a pan operation (under pan control) by referring to the operating state of image capture device A.

[0075] An example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 of the control device 103 will be described with reference to Fig. 9. Fig. 9 shows an example of computer programs and data stored in the primary storage device 302 and secondary storage device 303 when the control device 103 executes processing.

[0076] In FIG. 9, the same computer programs and data as those shown in FIG. 5 are denoted by the same reference numerals, and a description of these computer programs and data will be omitted.

[0077] First, the computer programs stored in the primary storage device 302 of the control device 103 will be described. The acquisition program 507 transmits an information acquisition command as a control command to the image capture device 102, receives the operation status information 407 transmitted by the control program 502 of the image capture device 102 in response to the information acquisition command, and registers the information in the operation status information 508. The acquisition program 507 periodically performs this series of processes. Note that when the operation status information 407 is updated, the image capture device 102 may transmit the updated operation status information 407 to the control device 103. In this case, when the operation status information 407 is transmitted from the image capture device 102, the acquisition program 507 receives the operation status information 407 and registers it in the operation status information 508.

[0078] Next, a description will be given of the data (information) registered in the secondary storage device 303 of the control device 103. In the operation status information 508, the operation status information 407 received by the control device 103 from each of the imaging devices 102 is registered.

[0079] Next, the processing performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets will be described with reference to the flowchart in Fig. 10. In Fig. 10, the same processing steps as those shown in Fig. 8 are assigned the same step numbers, and descriptions of those processing steps will be omitted.

[0080] In step S33, the control program 504 determines whether or not the image capture device A is performing a panning operation (under panning control). There are various methods for determining whether or not the image capture device A is performing a panning operation (under panning control).

[0081] For example, the control program 504 refers to the "operation status information 407 of the image capture device A" registered in the operation status information 508 stored in the secondary storage device 303. Then, if the operation status information 407 of the image capture device A indicates that "the image capture device A is performing a panning operation," the control program 504 determines that the image capture device A is performing a panning operation (under pan control). On the other hand, if the operation status information 407 of the image capture device A indicates that "the image capture device A is not performing a panning operation," the control program 504 determines that the image capture device A is not performing a panning operation (under pan control).

[0082] If the result of this determination is that the image capture device A is performing a panning operation (under panning control), the process proceeds to step S24. On the other hand, if the image capture device A is not performing a panning operation (under panning control), the process according to the flowchart in FIG. 10 ends.

[0083] By performing processing according to the flowchart of Figure 10, when a user performs an operation to remove image capture device A from the control targets, if the image capture device A is performing a pan operation, the control program 504 removes the image capture device A from the control targets and sends a pan stop command to the image capture device A, thereby causing the image capture device A to stop the pan operation.

[0084] The processing according to the flowchart in FIG. 6 and the processing according to the flowchart in FIG. 10 can be performed in parallel, and even if the processing according to the flowchart in FIG. 6 is being executed, it can be interrupted and the processing according to the flowchart in FIG. 10 can be executed.

[0085] Thus, according to this embodiment, if an imaging device is executing a specific function when the imaging device is removed from the control targets, a command to stop the execution of the specific function is sent to the imaging device, so that even if the imaging device is removed from the control targets while executing the specific function, the imaging device can be prevented from continuing to execute the specific function.

[0086] In this embodiment, whether to send a stop command to stop the function currently being executed to an imaging device that has been removed from the control targets is determined based on the operating state of the imaging device. However, the stop command (stop command for start-stop control) may be sent unconditionally to an imaging device that has been removed from the control targets.

[0087] <Modification of the second embodiment> The following describes the differences from the second embodiment, and unless otherwise specified below, it is assumed that the present embodiment is the same as the second embodiment. In the second embodiment, a case was described in which, when an imaging device is removed from the control targets, a specific function is stopped in accordance with the operating state of the imaging device. In this modification, when an imaging device is removed from the control targets, if a specific function is operating in the imaging device and an automatic control function of the imaging device is not operating, a command to stop the operation of the specific function is sent to the imaging device. Note that automatic control functions of the imaging device include preset, preset circulating, and tracing.

[0088] The process performed by the control device 103 when the user operates the user input / output I / F 304 to remove the image capture device A from the control targets will be described with reference to the flowchart in Fig. 11. In Fig. 11, the same process steps as those shown in Fig. 10 are assigned the same step numbers, and the description of those process steps will be omitted.

[0089] If the result of the determination in step S33 is that the image capture device A is performing a panning operation (under panning control), the process proceeds to step S44. On the other hand, if the image capture device A is not performing a panning operation (under panning control), the process according to the flowchart in FIG. 11 ends.

[0090] In step S44, the control program 504 refers to information indicating whether or not the image capture device A is operating the automatic control function, which is registered as the operating state of the image capture device A in the operating state information 508. If the information indicates that the image capture device A is not operating the automatic control function, the process proceeds to step S24. On the other hand, if the information indicates that the image capture device A is operating the automatic control function, the process according to the flowchart in Fig. 11 ends. In this embodiment, the automatic control function is at least one of preset, preset patrol, and trace, but is not limited to these.

[0091] By performing processing according to the flowchart of Figure 11, when a user operation is performed to remove image capture device A from the control targets, if image capture device A is performing a panning operation and the image capture device A is not operating the automatic control function, the control program 504 removes image capture device A from the control targets and sends a pan stop command to image capture device A, causing image capture device A to stop the panning operation.

[0092] Thus, according to this embodiment, if an imaging device is removed from the control targets and the imaging device is executing a specific function and is not operating an automatic control function, a command to stop the execution of the specific function is sent to the imaging device. Therefore, even if an imaging device that is executing a specific function is removed from the control targets, it is possible to prevent the imaging device from continuing to execute the specific function.

[0093] In the above embodiments and modifications, the CPU executes the above processes by executing a computer program stored in a primary storage device. However, instead of the computer program, the above processes may be executed by hardware that realizes the functions of the computer program.

[0094] Furthermore, the numerical values, processing timing, processing order, destination / source of data (information), etc. used in the above-described embodiments and variant examples are given as examples to provide a concrete explanation, and are not intended to be limited to such examples.

[0095] Furthermore, some or all of the above-described embodiments and modified examples may be used in appropriate combination, and some or all of the above-described embodiments and modified examples may be selectively used.

[0096] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0097] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0098] 301: CPU 302: Primary storage device 303: Secondary storage device 304: User input / output I / F 305: Network I / F 306: Internal bus

Claims

1. a determination means for determining whether an imaging device set as a control target is executing an automatic control function; When a user performs an operation to remove an imaging device that has been set as a control target from the control target, In the determination means, If it is determined that the imaging device is not executing an automatic control function, sending a command to the imaging device to stop control of a specific function of the imaging device; a control means for continuing to control the specific function of the imaging device when it is determined that the imaging device is executing the automatic control function; A control device comprising:

2. 2. The control device according to claim 1, wherein the specific function is a function for controlling the pan of the imaging device.

3. The control device according to claim 1 , wherein the specific function is a function for controlling a tilt of the imaging device.

4. The control device according to claim 1 , wherein the specific function is a function for controlling the zoom of the imaging device.

5. 2. The control device according to claim 1, wherein the automatic control function is a function for controlling at least one of preset, preset patrol, and trace of the imaging device.

6. When a user performs an operation to remove an imaging device that has been set as a control target from the control targets, transmitting, to the imaging device, a command to stop control of a specific function of the imaging device, when it is determined that the imaging device is not executing an automatic control function in the determination step of determining whether the imaging device is executing an automatic control function; a control step of continuing to control the specific function of the imaging device when it is determined in the determination step that the imaging device is executing the automatic control function; A control method comprising:

7. A computer program for causing a computer to function as the control device according to any one of claims 1 to 5.

Images