Imaging apparatus and method for controlling the same, and program

Abstract

To provide an imaging apparatus that notifies a client of control information of the imaging apparatus, and to more appropriately control the notification.SOLUTION: An imaging apparatus performs imaging to create a picked-up image. The imaging apparatus notifies another device of control information of the imaging apparatus according to a change in the control information that affects the picked-up image. The imaging apparatus determines whether to perform control of restricting the notification of the control information according to whether the imaging apparatus operates in a specific mode.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an image capture device, a control method thereof, and a program, and more particularly to a method for notifying control information of an image capture device. [Background technology]

[0002] In recent years, image distribution systems via a network have been increasing. For example, such distribution systems are used in Internet sites that distribute the status of ski resorts or zoos. Such distribution systems are also used for monitoring stores or buildings. Furthermore, in the field of video production, video distribution and camera control via a network are used. As the network, an Internet Protocol (IP) network such as the Internet is used. As a specific example, mechanisms such as WebView or XC protocol are known.

[0003] In such a system, the imaging device can notify the client of information (control information) indicating the current state of the imaging device in response to a request from the client. For example, Patent Document 1 describes that when the imaging device receives a request for information indicating the imaging direction from a client, the imaging device transmits this information to the client. Patent Document 2 also discloses transmitting imaging information including the imaging direction to a client device at set intervals. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-127499 A [Patent Document 2] Patent Publication No. 2022-70601 Summary of the Invention [Problem to be solved by the invention]

[0005] The imaging device may notify the client of the control information at the timing when the control information is changed. For example, an imaging device that receives a control information request from a client may notify the client of the control information that has been changed since the response to the previous request at the timing when the control information is changed. With this function, when the control information is changed by another client and when the control information is automatically changed by the imaging device, the client can reflect the changed control information in the UI, etc. By notifying the client of the change in the control information early, the response of the information display in the UI, etc. in the client is improved.

[0006] However, depending on the operation mode of the imaging device, the control information may be changed frequently and continuously. For example, examples of the control information include information that affects a captured image, such as a focus value, an F value, or a gain. The imaging device can automatically (for example, autonomously) change such control information. In an auto mode in which the imaging device automatically changes the control information, the control information may be changed frequently and continuously depending on the subject. In this case, even in a configuration in which the control information is notified at the timing of the change, the control information is notified frequently and continuously. At this time, the processing load of the imaging device or the client may increase, or the communication bandwidth of the network used for communication may be compressed. On the other hand, when the control information of the imaging device is manually controlled, such a problem is unlikely to occur.

[0007] An object of the present invention is to perform more appropriate notification control in a configuration in which an image capture device notifies a client of control information for the image capture device. [Means for solving the problem]

[0008] An imaging device according to an embodiment of the present invention includes the following configuration. 1. An imaging device, comprising: An imaging means for capturing an image to generate a captured image; a notification means for notifying other devices of a change in control information of the imaging device that affects the captured image, in response to the change in the control information of the imaging device; a control unit that determines whether or not to perform control to limit notification of the control information by the notification unit depending on whether the imaging device is operating in a specific mode; Equipped with. Effect of the Invention

[0009] In a configuration in which the image capture device notifies a client of control information for the image capture device, more appropriate notification control can be performed. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an imaging system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing an example of the appearance of an imaging apparatus according to an embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of the functional configuration of an imaging apparatus and an information processing apparatus according to an embodiment. [Figure 4] FIG. 2 is a diagram showing the hardware configuration of each device according to an embodiment. [Figure 5A] FIG. 4 is a diagram showing an example of an operation sequence of the imaging apparatus. [Figure 5B] FIG. 4 is a diagram showing an example of an operation sequence of the imaging apparatus. [Figure 6] FIG. 13 is a diagram showing an example of a table showing threshold values ​​corresponding to control information. [Figure 7] 11 is a flowchart showing an example of a control method of the imaging apparatus. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0012] 1 shows an example of the configuration of an imaging system according to this embodiment. The imaging system according to this embodiment includes an imaging device 100 and an information processing device 200. The imaging device 100 and the information processing device 200 are connected to each other via a network 300. The configuration of the network 300 is not particularly limited. The network 300 may be composed of a plurality of routers, switches, and cables that comply with a communication standard such as ETHERNET (registered trademark). The network 300 may also be the Internet, a wired local area network (LAN), a wireless LAN, or a wide area network (WAN).

[0013] The imaging device 100 is a device that captures images to generate captured images. The imaging direction of the imaging device 100 may be controllable. The imaging device 100 can transmit data of the captured image to an external device such as the information processing device 200 via the network 300. The imaging device 100 may further transmit metadata of the captured image (e.g., information on the image capture date and time) or identification information for identifying the imaging device 100 to the external device in association with the captured image. In addition, in this embodiment, the imaging device 100 can transmit control information of the imaging device 100.

[0014] In this specification, the control information is control information that affects an image captured by the imaging device 100. The control information is, for example, information that indicates imaging settings used by the imaging device 100. Examples of the control information will be described later.

[0015] The information processing device 200 is, for example, a client device such as a personal computer. The imaging system according to this embodiment has one imaging device 100. However, the imaging system according to this embodiment may have multiple imaging devices 100. That is, the multiple imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 can determine which of the multiple imaging devices 100 has captured the captured image by using, for example, identification information associated with the transmitted captured image. A program for realizing the processing function described later can be installed in the information processing device 200.

[0016] A display 220 is connected to the information processing device 200. The display 220 can display captured images transmitted from the imaging device 100, etc. The display 220 is, for example, a Liquid Crystal Display (LCD). The display 220 may be connected to the information processing device 200 via a display cable that complies with a communication standard such as High Definition Multimedia Interface (HDMI (registered trademark)). The display 220 and the information processing device 200 may be provided in a single housing.

[0017] Next, an imaging device 100 according to this embodiment will be described with reference to Fig. 2 and Fig. 3. Fig. 2 shows an example of an external view of the imaging device 100 according to this embodiment. Fig. 3 shows an example of the functional configuration of the imaging device 100 and the information processing device 200 according to this embodiment.

[0018] The imaging direction of the imaging device 100 is the direction in which the optical axis of the lens 101 faces. A light beam that passes through the lens 101 forms an image on an imaging element of the imaging unit 111. The lens driving unit 102 is a driving system that drives the lens 101. The lens driving unit 102 can change the focal length of the lens 101. The lens driving unit 102 is controlled by a pan-tilt-zoom (PTZ) control unit 114.

[0019] The pan driving unit 103 rotates the imaging direction of the imaging device 100 in a pan direction 105. The pan driving unit 103 has a mechanical driving system for performing a pan operation and a driving source such as a motor. The pan driving unit 103 is controlled by a PTZ control unit 114.

[0020] The tilt driving unit 104 rotates and drives the imaging device 100 to change the imaging direction in a tilt direction 106. The tilt driving unit 104 has a mechanical driving system that performs a tilt operation, and a driving source such as a motor. The tilt driving unit 104 is controlled by a PTZ control unit 114.

[0021] The imaging unit 111 captures an image to generate a captured image. The imaging unit 111 has an imaging element (not shown). The imaging element is, for example, a Charge Coupled Device (CCD) sensor or a Complementary Metal Oxide Semiconductor (CMOS) sensor. The imaging unit 111 photoelectrically converts an object image formed through the lens 101 to generate an electrical signal.

[0022] The image processing unit 112 generates image data based on the electrical signal obtained from the imaging unit 111. The image processing unit 112 can convert the electrical signal obtained from the imaging unit 111 into a digital signal. The image processing unit 112 can also perform image processing such as compression encoding processing on the digital signal representing an image.

[0023] The PTZ control unit 114 controls the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 based on instructions from the system control unit 113. In this way, the PTZ control unit 114 can control the imaging conditions of the imaging device 100. For example, the PTZ control unit 114 can control the imaging direction, zoom value (angle of view), or focus of the imaging device 100. Images captured by the imaging device 100 are affected by such control by the PTZ control unit 114.

[0024] The storage unit 115 stores (holds) control information for the image capture device 100.

[0025] The communication unit 116 communicates with the information processing device 200. The communication unit 116 can communicate via an I / F 440, which will be described later with reference to FIG. 4. For example, the communication unit 116 can transmit data of an image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 can also transmit control information of the imaging device 100 to the information processing device 200. Furthermore, the communication unit 116 can receive a control request, which is a command for controlling the imaging device 100, from the information processing device 200. The communication unit 116 can transmit the received control request to the system control unit 113.

[0026] An example of a communication protocol used by the communication unit 116 to communicate with an external device such as the information processing device 200 via the network 300 is the Hypertext Transfer Protocol (HTTP). The version of HTTP is not particularly limited. For example, HTTP / 1.0, HTTP / 1.1, HTTP / 2, and HTTP / 3 can be used. In addition, communication may be performed via a Transport Layer Security (TLS) layer.

[0027] When the communication unit 116 receives an information acquisition request from the information processing device 200, the communication unit 116 may adjust the timing of returning a response in order to effectively use the network bandwidth. For example, if the information to be transmitted to the information processing device 200 has not been changed from the previously transmitted information, the communication unit 116 may withhold the response. In this case, the communication unit 116 may return a response when the information has been changed. For this purpose, multipart or Transfer-encoding:chunked in HTTP / 1.1 may be used. Also, DATAFRAME and PUSH_PROMISE in HTTP / 2 may be used.

[0028] In the present embodiment, the communication unit 116 can notify other devices such as the information processing device 200 of the control information of the imaging device 100. As will be described with reference to Figures 5A and 5B, the communication unit 116 can notify the control information in response to a change in the control information under the control of the system control unit 113.

[0029] The system control unit 113 can control the entire imaging device 100. For example, the system control unit 113 can perform the following processing. That is, the system control unit 113 analyzes a control request for controlling the imaging device 100 transmitted from the communication unit 116. Then, the system control unit 113 performs processing according to such a control request. Furthermore, the system control unit 113 instructs the PTZ control unit 114 to perform a pan-tilt-zoom operation. Furthermore, the system control unit 113 causes the communication unit 116 to transmit image data generated by the image processing unit 112 to the information processing device 200. At this time, the system control unit 113 can add metadata (for example, information on the imaging time) to the image data.

[0030] In this embodiment, the imaging direction of the imaging device 100 is determined by at least one of the pan value and tilt value of the imaging device 100. In this specification, the pan value indicates the angle of the imaging direction (optical axis) of the imaging device 100 in the pan direction 105. This angle is set so that the angle at one of the ends of the driving range of the pan driving unit 103 is 0°. In addition, the tilt value indicates the angle of the imaging direction (optical axis) of the imaging device 100 in the tilt direction 106. This angle is set so that the angle at one of the ends of the driving range of the tilt driving unit 104 is 0°. In addition, the zoom value of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.

[0031] Further, the information processing device 200 according to the present embodiment will be described with reference to FIG. 3. The display control unit 201 causes the display 220 to display an image. For example, the display control unit 201 can cause the display 220 to display an image captured by the imaging device 100. The operation reception unit 202 receives an input based on a user operation via an input device (not shown) such as a keyboard, a mouse, or a touch panel. The communication unit 204 can communicate with the imaging device 100 via an I / F 440, which will be described later with reference to FIG. 4. For example, the communication unit 204 can transmit a setting request or a control request of the imaging device 100 transmitted from the system control unit 203 to the imaging device 100. In addition, the communication unit 204 can receive image data transmitted from the imaging device 100, or a response from the imaging device 100 to a request transmitted from the information processing device 200 to the imaging device 100. The communication unit 204 can transmit the data or response received from the imaging device 100 to the system control unit 203.

[0032] The system control unit 203 can control the entire information processing device 200. For example, the system control unit 203 can perform the following processes. The system control unit 203 can generate a setting request or a control request for the imaging device 100. The system control unit 203 can generate such a request based on an input from a user received by the operation receiving unit 202. The system control unit 203 can also transmit the generated request to the imaging device 100 via the communication unit 204. Furthermore, the system control unit 203 acquires a response from the imaging device 100 to the transmitted setting request or control request via the communication unit 204. In this way, the information processing device 200 can control the imaging device 100 via the network 300.

[0033] FIG. 4 shows an example of a hardware configuration that can be used to realize the functions of the imaging device 100 and the information processing device 200. For example, the imaging device 100 can have the configuration shown in FIG. 4 in addition to the configuration shown in FIG. 2. At least a part of the functions of the imaging device 100 shown in FIG. 3 can be realized by a processor such as a CPU 400 executing a program stored in a memory such as a RAM 410, a ROM 420, or a HDD 430. For example, the functions of the image processing unit 112, the system control unit 113, and the PTZ control unit 114 can be realized by processing executed by the CPU 400. The storage unit 115 can be realized by, for example, the RAM 410. Also, the communication unit 116 can be realized by, for example, the I / F 440.

[0034] The information processing device 200 may also have the configuration shown in Fig. 4. At least a part of the functions of the information processing device 200 shown in Fig. 2 may be realized by a processor such as a CPU 400 executing a program stored in a memory such as a RAM 410, a ROM 420, or a HDD 430.

[0035] The central processing unit (CPU) 400 is a central processing unit that controls the imaging device 100. The random access memory (RAM) 410 can temporarily store computer programs executed by the CPU 400. The RAM 410 also provides a work area used by the CPU 400 when executing processes. The RAM 410 can also function as a frame memory or a buffer memory. The read only memory (ROM) 420 stores programs used by the CPU 400 to control the imaging device 100. The HDD 430 is a storage device that records image data and the like. The I / F 440 communicates with external devices via the network 300. The I / F 440 can perform communication according to TCP / IP, HTTP, and the like.

[0036] At least some of the functions of the imaging device 100 and the information processing device 200 may be realized by dedicated hardware. For example, a process of displaying a graphic user interface (GUI) or image data on the display 220 may be performed by a graphics processing unit (GPU). A process of reading program code from the ROM 420 and loading the program code in the RAM 410 may be performed by a direct memory access (DMA) functioning as a transfer device.

[0037] The operation of the imaging device can be selected from a number of modes, including a mode (manual mode) in which the control information is changed according to instructions from another device, and a mode (auto mode) in which the imaging device controls the control information.

[0038] Next, with reference to Figures 5A and 5B, a communication operation between the imaging device 100 and the information processing device 200 when the imaging device 100 is operating in manual mode will be described. In manual mode, the imaging device 100 operates under the control of another device (e.g., the information processing device 200). In the following example, a case where the focus mode is manual will be described. That is, in the manual mode described below, the focus of the imaging device 100 is controlled by the other device.

[0039] 5A and 5B are sequence diagrams showing a control information request and a control information response transmitted between the imaging device 100 and the information processing device 200. Fig. 5A is a sequence diagram in a method in which, when a control information request is transmitted from the information processing device 200 to the imaging device 100, the imaging device 100 repeatedly notifies the information processing device 200 of control information.

[0040] In S500, the system control unit 203 of the information processing device 200 transmits a control information request to the imaging device 100 via the communication unit 204. This request requests that control information of the imaging device 100 be sent to the information processing device 200. In the following example, the control information requested to be transmitted is a focus value.

[0041] The system control unit 113 of the imaging device 100 receives the control information request via the network 300 and the communication unit 116. Then, the system control unit 113 acquires the current control information of the imaging device 100. For example, the system control unit 113 can acquire the control information from the image processing unit 112 or the PTZ control unit 114. In this example, it is assumed that the focus value indicated by the control information is 2031.

[0042] Next, in S501, the system control unit 113 notifies the information processing device 200 of the acquired current control information via the communication unit 116. The system control unit 203 that has received the control information can instruct the display control unit 201 to display the received control information on the display 220.

[0043] Next, the system control unit 113 monitors changes in the control information of the imaging device 100. To this end, the system control unit 113 can acquire the control information from the image processing unit 112 or the PTZ control unit 114. In this example, since the focus mode is manual, the value of the control information (focus value) is not automatically changed.

[0044] In S502, the system control unit 113 receives a control request to change the focus. Then, the system control unit 113 performs control to change the focus. For example, a user of the information processing device 200 can instruct a focus change process via the operation reception unit 202. At this time, the system control unit 203 transmits the focus change request to the imaging device 100 through the communication unit 204. Note that a device other than the information processing device 200 may transmit the focus change request to the imaging device 100. When the system control unit 113 receives the focus change request via the communication unit 116, it instructs the PTZ control unit 114 to change the focus.

[0045] Here, the system control unit 113 can detect a change in the control information of the imaging device 100. For example, the PTZ control unit 114 can notify the system control unit 113 of a change in focus value in response to a change in focus. The system control unit 113 notifies other devices of the control information in response to the change in the control information. For example, the system control unit 113 can notify the information processing device 200 of the control information via the communication unit 116 in response to the control information request received in S500. In this example, it is assumed that the focus value indicated by the control information is 1922. The system control unit 203 that has received the control information can instruct the display control unit 201 to display the received control information on the display 220.

[0046] Also in S503, the system control unit 113 can notify the control information (for example, focus value=1803) in response to a change in the control information (for example, focus value) based on a user instruction.

[0047] 5B is a sequence diagram of a method in which the imaging device 100 notifies the information processing device 200 of control information once in response to a control information request from the information processing device 200 to the imaging device 100. In this example, when the information processing device 200 acquires a control information response from the imaging device 100, the information processing device 200 immediately transmits a control information request to the imaging device 100.

[0048] S510 and S511 are the same as S500 and S501. In S512, the system control unit 203 of the information processing device 200 transmits a control information request to the imaging device 100 via the communication unit 204 in response to receiving the control information response in S511. When the control information request is received from the communication unit 116 via the network 300, the system control unit 113 of the imaging device 100 monitors whether the control information has been changed. For this purpose, the system control unit 113 can acquire the control information from the image processing unit 112 or the PTZ control unit 114. In this example, since the focus mode is manual, the value of the control information (focus value) is not automatically changed.

[0049] S513 is the same as S502. In S514, the system control unit 203 transmits a control information request to the imaging device 100, similar to S512.

[0050] In the next step S515, the system control unit 203 can notify the control information (for example, focus value) in response to a change in the control information (for example, focus value) based on a user instruction, similar to step S513. S516 is also performed in the same manner as step S514.

[0051] As described above, when the imaging device 100 operates in the manual mode, the frequency of notification of control information from the imaging device 100 to the information processing device 200 is not high in either the method shown in FIG. 5A or 5B.

[0052] Next, with reference to Figs. 5A and 5B, a communication operation between the imaging device 100 and the information processing device 200 when the imaging device 100 is operating in auto mode will be described. In the auto mode, the imaging device 100 automatically changes control information. In the following example, a case where the focus mode is auto will be described. That is, in the auto mode described below, the focus of the imaging device 100 is autonomously controlled by the imaging device 100.

[0053] First, a method in which, when a control information request is transmitted from the information processing device 200 to the imaging device 100, the imaging device 100 repeatedly notifies the information processing device 200 of the control information will be described with reference to FIG. 5A.

[0054] S500 and S501 are performed as described above. Next, the system control unit 113 of the imaging device 100 monitors changes in the control information of the imaging device 100. For this purpose, the system control unit 113 can acquire the control information from the image processing unit 112 or the PTZ control unit 114. Since the focus mode is automatic in this example, the value of the control information (focus value) is automatically and continuously changed depending on the state of the subject. For this reason, even without a user operation, the PTZ control unit 114 can notify the system control unit 113 of a change in the focus value. In this way, the system control unit 113 may continuously detect changes in the control information of the imaging device 100.

[0055] Here, the system control unit 113 detects a change in the control information of the imaging device 100. Furthermore, the system control unit 113 determines whether or not to perform control to limit notification of the control information depending on whether or not the imaging device 100 is operating in a specific mode. In this example, since the imaging device 100 is operating in the auto mode, the system control unit 113 performs control to limit notification of the control information. For example, the system control unit 113 can determine to notify the control information when a predetermined time has elapsed since the system control unit 113 previously transmitted a control information response. Then, when the system control unit 113 determines to notify the control information, it notifies the other device of the control information as in S502. For example, the system control unit 113 can notify the information processing device 200 of the control information via the communication unit 116 in response to the control information request received in S500. The system control unit 203 of the information processing device 200 that has received the control information can instruct the display control unit 201 to display the received control information on the display 220.

[0056] Also in S503, system control unit 113 can notify the control information based on detection of a change in the control information and determination of whether or not to notify the control information.

[0057] Next, a method in which the imaging device 100 notifies the information processing device 200 of control information once in response to a control information request from the information processing device 200 to the imaging device 100 will be described with reference to FIG. 5B.

[0058] S510 to S512 are performed as described above. Next, the system control unit 113 of the imaging device 100 monitors changes in the control information of the imaging device 100. In this case, too, since the focus mode is auto, the system control unit 113 may continuously detect changes in the control information of the imaging device 100.

[0059] S513 is the same as S502. That is, system control unit 113 can notify the control information based on detection of a change in the control information and determination of whether or not to notify the control information.

[0060] In S514, the system control unit 203 transmits a control information request to the imaging device 100, similar to S512. In S515, the system control unit 203 can notify the control information based on detection of a change in the control information and determination of whether to notify the control information, similar to S513. S516 is also performed in the same manner as S514.

[0061] As described above, in this embodiment, when the system control unit 113 detects a change in the control information of the imaging device 100, the system control unit 113 determines whether or not to further notify the control information. With this configuration, even when the imaging device 100 is operating in the auto mode, the frequency of notification of the control information from the imaging device 100 to the information processing device 200 can be suppressed. In the auto mode, as described above, the control information of the imaging device 100 may be continuously changed. Therefore, in S502, when the system control unit 113 transmits the control information in response to the detection of a change in the control information, similar to the case where the imaging device 100 is operating in the manual mode, the control information may be repeatedly transmitted continuously within a short period of time. With the configuration of this embodiment, the frequency of notification of the control information can be suppressed compared to such a case. Therefore, the processing load of the imaging device 100 and the information processing device 200 can be reduced.

[0062] On the other hand, according to the above embodiment, when the imaging device 100 operates in manual mode, the system control unit 113 can immediately notify the control information when detecting a change in the control information of the imaging device 100. In particular, in manual mode, even if the control information of the imaging device 100 is changed by a device other than the information processing device 200, the information processing device 200 can quickly receive a notification of the control information. This improves the response of information updates in the client. On the other hand, in manual mode, even in such a configuration, it is unlikely that the control information will be repeatedly performed continuously within a short period of time, so it is expected that the processing load of the imaging device 100 and the information processing device 200 will not be large.

[0063] A control method performed by the system control unit 113 in this embodiment will be described in more detail below with reference to the flowchart of Fig. 7. The method shown in Fig. 7 can be used in a scheme in which the imaging device 100 notifies the information processing device 200 of control information once in response to a control information request from the information processing device 200 to the imaging device 100, as shown in Fig. 5B. When a control information request is transmitted from the information processing device 200 to the imaging device 100 as shown in Fig. 5A, if the imaging device 100 repeatedly notifies the information processing device 200 of the control information, the system control unit 113 can repeatedly perform the method shown in Fig. 7.

[0064] 7 starts when the imaging device 100 receives a control information request from the information processing device 200. This control information request includes information specifying the control information to be requested to be transmitted.

[0065] First, in S700, the system control unit 113 determines whether or not the control information of the imaging device has been changed. To this end, the system control unit 113 can obtain current control information from the image processing unit 112 or the PTZ control unit 114, and monitor whether or not the control information has been changed. The system control unit 113 can obtain control information requested by a control information request, and determine whether or not this control information has been changed. If it is determined that the control information has been changed, the process proceeds to S701.

[0066] In S701, the system control unit 113 determines whether the requested control information is specific control information. In this embodiment, the system control unit 113 determines whether to perform control to limit notification of control information according to the type of control information to be notified. In one embodiment, the specific control information indicates a parameter that changes continuously. In one embodiment, the specific control information is information that is autonomously controlled by the imaging device 100. For example, the specific control information is information that is changed by the imaging device 100 in auto mode. This specific control information may be controlled by the PTZ control unit 114 according to a distance measurement result or a photometry result by the imaging device 100. For example, the PTZ control unit 114 can control a focus value, an F value, or a gain (or ISO sensitivity), etc., based on a distance measurement result or a photometry result. In addition, this specific control information may be controlled by the PTZ control unit 114 based on an object detection result from an image captured by the imaging device 100. For example, the PTZ control unit 114 can control a focus value so that a specific object is focused on. The PTZ control unit 114 can also control the pan value or tilt value so that a specific object appears at the center of the captured image, and can also control the zoom value so that the size of a specific object on the captured image is maintained.

[0067] In one embodiment, the specific control information is information whose value changes continuously. For example, the specific control information may be a parameter selected from three or more values, a parameter represented by eight or more bits, or a parameter represented by sixteen or more bits.

[0068] Specific examples of the specific control information include focus distance (e.g., focus value), exposure control information (e.g., F-number or shutter speed), gain (or ISO sensitivity), and color control information (e.g., white balance value). Other specific examples of the specific control information include imaging direction information (e.g., pan value or tilt value) and imaging magnification information (e.g., zoom value).

[0069] If the requested control information is not the specific control information, the process proceeds to S702. In this case, the system control unit 113 can immediately transmit the control information acquired in S700 to the information processing device 200 via the communication unit 116. If the requested control information is the specific control information, the process proceeds to S703.

[0070] There is a high possibility that the specific control information described above will be changed continuously. Therefore, by controlling to limit the notification of the specific control information, the notification frequency of the control information can be effectively suppressed. On the other hand, in this embodiment, for other types of control information, the system control unit 113 can immediately notify the control information when a change is detected. This improves the response of the client to updating information.

[0071] In S703, the system control unit 113 determines whether the imaging device 100 is operating in a specific mode. In this embodiment, the specific mode is an auto mode. In one embodiment, the specific mode is a mode in which the imaging device 100 automatically changes the requested control information. For this purpose, the system control unit 113 can obtain information indicating the control state of the requested control information from the image processing unit 112 or the PTZ control unit 114. If the imaging device 100 is not operating in the specific mode, the process proceeds to S702. In this case, too, the system control unit 113 can immediately transmit the control information obtained in S700 to the information processing device 200 via the communication unit 116. If the imaging device 100 is operating in the specific mode, the process proceeds to S704.

[0072] In S704, the system control unit 113 performs control to limit the notification of the control information. In this embodiment, the system control unit 113 limits the notification of the control information so that the interval at which the control information is notified to other devices is equal to or greater than a threshold. For this purpose, the system control unit 113 can acquire time information indicating the time at which the information processing device 200 was notified of the same type of control information as the requested control information most recently from the storage unit 115. Then, the system control unit 113 compares the acquired time information with the current time information to calculate the elapsed time from the most recent transmission of the control information. Then, the system control unit 113 can determine whether the calculated elapsed time is equal to or greater than a threshold held in the storage unit 115. Note that this threshold may be a fixed value determined in advance. Also, this threshold may be a value designated by a user via the information processing device 200.

[0073] If the elapsed time calculated in this way is less than the threshold, the transmission of the control information is suspended, and the process returns to S700. In this way, the transmission of the control information is postponed to a later time. On the other hand, if the calculated elapsed time is equal to or greater than the threshold, the system control unit 113 stores the current time information in the storage unit 115. Then, the process proceeds to S702, where the system control unit 113 transmits the control information acquired in S700 to the information processing device 200 via the communication unit 116.

[0074] The control method in S704 is not limited to the method of restricting the notification of the control information according to the interval at which the control information is notified as described above. For example, the notification of the control information may be restricted according to the frequency at which the control information is notified. The system control unit 113 can restrict the notification of the control information so that the frequency at which the control information is notified to other devices is equal to or lower than a threshold. Specifically, the system control unit 113 can determine the number of times that the same type of control information as the requested control information has been notified within a predetermined period in the past (for example, one second). Then, if this number of times exceeds a threshold, the system control unit 113 can refrain from or postpone the transmission of the control information.

[0075] As another example, the notification of the control information may be limited according to the amount of change in the control information. For example, the system control unit 113 can limit the notification of the control information so as to prevent the difference between the control information to be subsequently notified from becoming less than a threshold. Specifically, the system control unit 113 can acquire, from the storage unit 115, control information of the same type as the requested control information that was most recently notified to the information processing device 200. Then, the system control unit 113 calculates the difference between the control information by comparing the control information acquired from the storage unit 115 with the control information acquired in S700. Then, the system control unit 113 can determine whether the calculated difference is equal to or greater than a predetermined threshold. Then, if this difference is less than the threshold, the system control unit 113 can suspend or postpone the transmission of the control information.

[0076] This threshold may be predefined according to the type of control information. FIG. 6 is a table showing an example of the relationship between the type of control information and the corresponding threshold. Table 600 shows thresholds 602 for each of control information 601 such as focus value 603, F value 604, gain 605, and white balance value (WB) 606. The system control unit 113 can acquire such table 600 from the storage unit 115. Then, the system control unit 113 can acquire a threshold corresponding to the requested control information from the table 600. For example, when the requested control information is an F value, the threshold is 5. Note that such a threshold may be a fixed value predefined. Also, the threshold may be a value designated by a user via the information processing device 200.

[0077] As yet another example, notification of the control information may be restricted according to the processing load of the imaging device 100 or another device (e.g., the information processing device 200) to which the control information is to be notified. For example, notification of the control information can be restricted according to the CPU usage rate of the imaging device 100 or the information processing device 200. Specifically, the system control unit 113 can determine whether the current usage rate of the CPU 400 of the imaging device 100 or the information processing device 200 exceeds a threshold value. The system control unit 113 can obtain a notification indicating the usage rate of the CPU 400 of the information processing device 200 from the information processing device 200 via the communication unit 116. Then, when the usage rate exceeds the threshold value, the system control unit 113 can refrain from or postpone the transmission of the control information.

[0078] As yet another example, notification of control information may be restricted depending on the load on or the state of a communication path used when the imaging device 100 notifies information control. For example, notification of control information may be restricted based on information (e.g., bit rate or packet drop) related to the communication band of the network 300 acquired via the communication unit 116. Specifically, the system control unit 113 may determine whether the bit rate of the network 300 is equal to or higher than a threshold. Then, when the usage rate is below the threshold, the system control unit 113 may refrain from or postpone transmission of the control information.

[0079] The above control methods can be used in combination. For example, the system control unit 113 can limit the notification of the control information so that the interval for notifying the control information is equal to or greater than a threshold value and the difference between the control information to be subsequently notified is equal to or greater than a threshold value. Specifically, the system control unit 113 can calculate the elapsed time from the last time the control information was transmitted by comparing the time information acquired from the storage unit 115 with the current time information as described above. Also, the system control unit 113 can calculate the difference between the control information by comparing the control information acquired from the storage unit 115 with the control information acquired in S700 as described above. In this case, if the calculated elapsed time is equal to or greater than a threshold value and the calculated difference is equal to or greater than a threshold value, the process proceeds to S702. If not, the system control unit 113 can suspend or postpone the transmission of the control information.

[0080] In addition, in S704, the system control unit 113 can limit the notification of control information based on the transmission interval or transmission frequency of the same type of control information. For example, the system control unit 113 can calculate the elapsed time from the most recent transmission of control information that is the same as the control information requested by the control information request. On the other hand, the system control unit 113 may limit the notification of control information based on the transmission interval or transmission frequency of any control information.

[0081] Furthermore, the system control unit 113 can limit notification of control information based on the transmission interval, transmission frequency, or amount of change of the control information transmitted to the same device. For example, the system control unit 113 can calculate the elapsed time since the control information was last transmitted to the same device (e.g., the information processing device 200) as the device that transmitted the control information request. On the other hand, the system control unit 113 may limit notification of control information based on the transmission interval, transmission frequency, or amount of change of the control information transmitted to any device.

[0082] 7, when the requested control information is specific control information and the imaging device 100 is operating in a specific mode, control is performed to limit notification of the control information. However, in another embodiment, control may be performed to limit notification of the control information when the imaging device 100 is operating in a specific mode, regardless of the type of requested control information. Furthermore, in yet another embodiment, control may be performed to limit notification of the control information when the requested control information is specific control information, regardless of the operation mode of the imaging device 100.

[0083] According to the above embodiment, notification of control information is controlled in accordance with the operation mode of the imaging device 100. This makes it possible to perform more appropriate notification control in accordance with the necessity of notification control.

[0084] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0085] The disclosure of this specification includes the following imaging device, control method, and program. (Item 1) 1. An imaging device, comprising: An imaging means for capturing an image to generate a captured image; a notification means for notifying other devices of a change in control information of the imaging device that affects the captured image, in response to the change in the control information of the imaging device; a control unit that determines whether or not to perform control to limit notification of the control information by the notification unit depending on whether the imaging device is operating in a specific mode; An imaging device comprising: (Item 2) 2. The imaging device according to item 1, wherein the control means further determines whether or not to perform control to limit notification of the control information by the notification means, depending on the type of the control information to be notified. (Item 3) 3. The imaging device according to claim 1, wherein the control information is a continuously changing parameter. (Item 4) 4. The imaging device according to claim 1, wherein the control information is autonomously controlled by the imaging device. (Item 5) 5. The imaging device according to any one of items 1 to 4, wherein the control information is focus distance, exposure control information, gain, color control information, imaging direction information, or imaging magnification information. (Item 6) 6. The imaging device according to any one of items 1 to 5, wherein the specific mode is a mode in which the imaging device controls the control information. (Item 7) The imaging device described in any one of items 1 to 6, characterized in that the operation of the imaging device is selected from a plurality of modes, the plurality of modes including a mode in which the control information is changed according to instructions from another device, and a mode in which the imaging device controls the control information. (Item 8) The imaging device described in any one of items 1 to 7, characterized in that the control means limits the notification of the control information by the notification means so that the interval at which the notification means notifies the other device of the control information is equal to or greater than a threshold. (Item 9) The imaging device described in any one of items 1 to 8, characterized in that the control means limits the notification of the control information by the notification means so that the frequency at which the notification means notifies the other device of the control information is equal to or less than a threshold value. (Item 10) The imaging device described in any one of items 1 to 9, characterized in that the control means limits the notification of the control information by the notification means so as to prevent a difference in the control information that the notification means subsequently notifies the other device from becoming less than a threshold value. (Item 11) 11. The imaging device according to any one of items 1 to 10, wherein the control means limits the notification of the control information by the notification means in accordance with a processing load of the imaging device or the other device. (Item 12) The imaging device described in any one of items 1 to 11, characterized in that the control means limits the notification of the control information by the notification means depending on the load on a communication path used when the notification means notifies information about the imaging device or the status of the communication path. (Item 13) A control method performed by an imaging device that captures images to generate a captured image, comprising: notifying another device of a change in control information of the imaging device that affects the captured image; determining whether to perform control to limit notification of the control information depending on whether the imaging device is operating in a specific mode; A control method comprising: (Item 14) 13. A program for causing an imaging device to function as the imaging device according to any one of items 1 to 12.

[0086] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0087] 100: imaging device, 113: system control unit, 114: PTZ control unit, 116: communication unit, 200: information processing device, 203: system control unit

Claims

1. A notification means for notifying an external device of the control information in response to a change in the control information of an imaging device having a plurality of modes, including a first mode in which the control information is changed in response to an instruction from an external device and a second mode in which the imaging device autonomously changes the control information, When the imaging device is operating in the second mode, control means for performing control to restrict the notification of the control information, An imaging device characterized by comprising:

2. The imaging device according to claim 1, wherein the control means determines whether or not to perform control to restrict the notification of the control information according to the type of control information to be notified.

3. The imaging apparatus according to claim 1, characterized in that the control information is a continuously changing parameter.

4. The imaging apparatus according to claim 1, characterized in that the control information is at least one of the following: focus distance, exposure control information, gain, color control information, imaging direction information, and imaging magnification information.

5. The imaging apparatus according to claim 1, characterized in that the control means restricts the notification of the control information by the notification means such that the interval at which the notification means notifies the external device of the control information is equal to or greater than a threshold.

6. The imaging apparatus according to claim 1, characterized in that the control means restricts the notification of the control information by the notification means so that the frequency at which the notification means notifies the external device of the control information is below a threshold.

7. The imaging apparatus according to claim 1, wherein the control means is characterized in that it restricts the notification of the control information by the notification means so as to prevent the difference of the control information that the notification means successively notifies the external device from falling below a threshold.

8. The imaging apparatus according to claim 1, characterized in that the control means restricts the notification of the control information by the notification means according to the processing load of the imaging apparatus or the external device.

9. The imaging device according to claim 1, wherein the control means restricts the notification of the control information by the notification means according to the load on the communication channel used by the notification means when notifying information of the imaging device or the status of the communication channel.

10. A control method performed by an imaging device having a plurality of modes, including a first mode in which control information is changed in response to instructions from an external device, and a second mode in which the imaging device autonomously changes the control information, The process of notifying the external device of the control information in response to a change in the control information of the imaging device, When the imaging device is operating in the second mode, the process includes performing control to restrict the notification of the control information, A control method characterized by including

11. A program for causing a computer to function as an imaging device according to any one of claims 1 to 9.

Images