Control device and control method thereof

Abstract

To identify a slave device included in a captured image.SOLUTION: A control apparatus configured to operate as a master device that controls a slave device comprises: image capturing means; registration means configured to register slave device information of a slave device to be controlled by the control apparatus; and identification means configured to, based on the slave device information registered by the registration means, identify a slave device that exists in a range of image capturing by the image capturing means. The registration means registers, as the slave device information, information on a relative direction of existence of a slave device with respect to a position of the image capturing means.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique for identifying a device included in a captured image. [Background technology]

[0002] There are systems that acquire various sensor data by combining a slave unit, which is a wireless communication device that transmits data acquired by a sensor, with a master unit that collects the data. In such systems, the slave unit is first registered with the master unit. Then, the user configures various settings for the slave unit via the master unit. These settings include, for example, the sensor's detection accuracy and unit, the sleep interval, and a name for identifying the slave unit. The slave unit transmits sensor data to the master unit and transitions to a sleep state according to the settings.

[0003] Furthermore, when the parent device is an imaging device, there is a demand for identifying the child device included in the captured image. For example, Patent Document 1 discloses a technology for receiving and identifying information about a monitored object from an external server in order to display additional information superimposed on the monitored object in the captured image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-119971 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, since information on the monitored object is received from an external server, the image capturing device alone cannot identify the monitored object within the captured image. Generally, the slave unit information held by the master unit does not include information indicating the physical positional relationship between the slave unit and the master unit. Therefore, when the master unit is an image capturing device, even if a slave unit is present within the capture range of the master unit, the master unit cannot identify which of the registered slave units the slave unit is.

[0006] The present invention has been made in view of the above-mentioned problems, and aims to provide a technique that makes it possible to identify a slave unit included in a captured image. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, the control device according to the present invention has the following configuration: That is, the control device that operates as a master device that controls a slave device includes: An imaging means; a registration means for registering information about a slave device to be controlled by the control device; an identification unit that identifies a slave unit present within a photographing range of the imaging unit based on the slave unit information registered by the registration unit; a slave control means for controlling the slave; and The registration means registers, as the child device information, information on the relative direction of the child device based on the position of the imaging means. death, When the identification means identifies the child device within the photographing range, the child device control means transmits to the child device a return request which is a request for returning the child device from a sleep state. . [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a technique that makes it possible to identify a slave unit included in a captured image. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing the overall configuration of a system in a first embodiment. [Figure 2]FIG. 2 is a diagram illustrating a mechanical configuration of a network camera. [Figure 3] FIG. 10 is a diagram illustrating an example of registration information of a wireless communication slave device. [Figure 4] 10 is a diagram showing an example of the positional relationship between PT coordinates and wireless communication slave devices. FIG. [Figure 5] 4 is an operation flowchart of the network camera according to the first embodiment. [Figure 6] FIG. 10 is a diagram showing an example of a captured image. [Figure 7] 10 is a detailed flowchart of a slave unit identification process (S802). [Figure 8] FIG. 10 is a diagram showing an example of displaying child device information within a camera image. [Figure 9] FIG. 10 is a diagram showing the overall configuration of a system according to a second embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of registration information of a wireless communication slave device. [Figure 11] 10 is a flowchart illustrating the operation of the network camera according to the second embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a captured image. [Figure 13] 13 is a detailed flowchart of a slave unit identification process (S1302). DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (First embodiment) As a first embodiment of a control device according to the present invention, an imaging device that operates as a parent device that controls a child device will be described below as an example.

[0012] <Functional configuration of the system and each device> 1 is a diagram showing the overall configuration of a system in the first embodiment. The system includes a network camera 100 and a client device 200 that are communicatively connected via a network 300. The system also includes a wireless communication slave device 400 that is connectable to the network camera 100 via wireless communication.

[0013] The network camera 100 is a device that receives control from a client device 200 via a network 300 and transmits images captured by an imaging unit 101 to the client device 200. The network camera 100 is also configured to be able to control a wireless communication slave device 400 via wireless communication.

[0014] The imaging unit 101 receives light that has been focused through a lens at an imaging element, converts the received light into electric charges, and generates an imaging signal. The imaging element may be, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Alternatively, the imaging element may be a CCD (Charge Coupled Device) image sensor.

[0015] The image processing unit 102 digitizes the image signal converted by the imaging unit 101 to generate image data. At this time, the image processing unit 102 also performs various image processing to correct the image quality. The image processing unit 102 may further compress and encode the image data to generate compressed and encoded image data.

[0016] The lens control unit 105 controls the lens driving unit 104 based on instructions from the system control unit 103. The lens driving unit 104 is composed of a drive system for the focus lens and zoom lens and a motor as a drive source thereof, and the operation thereof is controlled by the lens control unit 105.

[0017] The pan driving unit 106 is composed of a mechanical driving system that performs panning operations, a motor that serves as the driving source, and an angle sensor that detects the angle of the driving unit. The tilt driving unit 107 is composed of a mechanical driving system that performs tilting operations, a motor that serves as the driving source, and an angle sensor that detects the angle of the driving unit. The operations of the pan driving unit 106 and the tilt driving unit 107 are controlled by a pan / tilt control unit 108. The pan / tilt control unit 108 controls the driving of the pan driving unit 106 and the tilt driving unit 107 based on instructions from the system control unit 103.

[0018] The communication unit 109 is a functional unit that communicates with the client device 200. For example, the communication unit 109 transmits to the client device 200 a video stream based on image data generated by the image processing unit 102. Note that the image data here is, for example, frame image data that constitutes a moving image. The communication unit 109 also receives commands transmitted from the client device 200 and transmits them to the system control unit 103. It also transmits responses to the commands to the client device 200 under the control of the system control unit 103. In this way, the system control unit 103 also functions as a communication control unit.

[0019] The wireless communication control unit 110 transmits and receives data, control commands, etc. in accordance with a wireless communication standard. Specifically, it transmits and receives radio waves that modulate and demodulate data, control commands, etc. via an antenna 111. Wireless communication standards that can be used include wireless LAN (Wi-Fi (registered trademark)), Bluetooth (registered trademark), ZigBee, and Z-Wave.

[0020] The system control unit 103 is a functional unit that controls all the units of the network camera 100. For example, the system control unit 103 analyzes commands received by the communication unit 109 from the client device 200 via the network 300 and performs processing according to the commands. For example, the system control unit 103 instructs the image processing unit 102 to adjust image quality and the lens control unit 105 to control zoom and focus. Furthermore, as will be described in detail later, the system control unit 103 exchanges data, control commands, and the like with the wireless communication slave device 400 via the wireless communication control unit 110, and performs processes such as obtaining information and setting the wireless communication slave device 400 (slave device control).

[0021] The system control unit 103 may be provided inside the network camera 100, or may be configured independently of the network camera 100. When the system control unit 103 is an external device to the network camera 100, the system control unit 103 and the network camera 100 may be configured to be able to communicate with each other.

[0022] The client device 200 is a device that accepts operations from a user and controls the network camera 100. The client device 200 can be realized using a computer such as a personal computer.

[0023] The display unit 201 displays a graphic user interface (GUI) for controlling the network camera 100. The display unit 201 also displays video based on image data received from the network camera 100. The display unit 201 can be realized by a display device using a liquid crystal panel, an organic EL panel, or the like.

[0024] The input unit 202 is any device that accepts operations from a user, such as a keyboard or a mouse. The user performs operations on the GUI via the input unit 202. Note that the input unit 202 may also be realized using other devices such as a touch panel or a joystick.

[0025] The communication unit 204 communicates with the network camera 100 via the network 300. For example, it can transmit commands to the network camera 100 in response to user operations and obtain image data from the network camera 100.

[0026] The system control unit 203 is a functional unit that controls all the units of the client device 200. For example, the system control unit 203 generates a command in response to a user operation and causes the communication unit 204 to transmit the command to the network camera 100. The system control unit 203 also causes the display unit 201 to display image data received from the network camera 100 via the communication unit 204. In this way, the system control unit 203 also functions as a communication control unit and a display control unit.

[0027] The wireless communication slave device 400 is, for example, a slave device having a sensor function, and transmits data acquired by the sensor to the network camera 100 operating as a master device. The wireless communication slave device 400 is, for example, battery-powered, and when the battery is attached and started up, it performs a registration process with the master device, and enters a sleep state with limited functionality if no communication is made from the master device for a predefined communication timeout period.

[0028] The registration process of the wireless communication slave device 400 to the master device may be configured to be performed at a time other than when the device is started up by installing a battery. For example, a button may be added to the wireless communication slave device 400, and the registration process may be started when the button is pressed. Furthermore, although the slave device has been described here as a wireless communication slave device 400 that performs wireless communication, it may also be a slave device connected by wire.

[0029] <Network camera mechanical configuration> Fig. 2 is a diagram showing the mechanical configuration of the network camera 100. The network camera 100 is composed of a bottom case 121, a turntable 122, a camera head support 123, and a camera head 124. Fig. 2(a) is a diagram showing the network camera 100 attached to a table as seen from above, and Fig. 2(b) is a diagram showing the network camera 100 as seen from the side.

[0030] With reference to Figure 2, the operation of the pan / tilt movable unit will be explained by defining the vertical axis as the vertical axis and the axis perpendicular to this as the horizontal axis. In Figure 2(a), the clockwise direction around the vertical axis perpendicular to the paper surface is the positive direction of the pan angle. In Figure 2(b), the clockwise direction around the axis perpendicular to the paper surface is the positive direction of the tilt angle.

[0031] 2, the pan drive unit 106 is made up of a bottom case 121 and a turntable 122, and the turntable 122 is rotatable around a vertical axis. An electric circuit made up of a fixed part of the bottom case 121 and a rotating part of the turntable 122 is connected by a slip ring or the like. Therefore, the pan movable unit can rotate freely (endlessly within an angular range of 360°) around the vertical axis as the rotation axis.

[0032] Tilt drive unit 107 is composed of camera head support 123 and camera head 124, and camera head 124 is rotatable around a horizontal axis. Here, the tilt movable unit can rotate within an angular range of 180° around the horizontal axis as the rotation axis.

[0033] As described above, the network camera of this embodiment can capture a wide range of images by changing the capture direction by rotating the camera head in the pan and tilt directions. Note that the network camera 100 is not limited to the configuration shown in Fig. 2. For example, the pan direction may not be drivable 360° but the driveable range may be limited (for example, +170° to -170°). Similarly, the tilt direction may not be drivable 180° but the drive range may be limited (for example, 0° to 90°).

[0034] <System Operation> The operation of the system roughly includes an operation in which the network camera registers information about the wireless communication slave devices, and an operation in which the network camera controls the wireless communication slave devices based on the registered information. These operations are explained in order below.

[0035] <Registering wireless communication devices using network cameras> 3 is a diagram showing an example of registration information of a wireless communication slave device, which shows information registered in the network camera 100 in the above-mentioned registration process of the wireless communication slave device 400 to the master device (network camera 100).

[0036] The information table 500 shows a state in which information on N wireless communication slave devices is registered and held as a table. The information table 500 is managed by the system control unit 103 of the network camera 100, for example.

[0037] The information table 500 includes, for each wireless communication slave device, an ID 501, a device name 502, a device type 503, and pan tilt (PT) coordinates 504. The PT coordinates 504 indicate coordinates that define the direction of the wireless communication slave device based on the coordinate system shown in Fig. 2, which is based on the installation position of the network camera 100.

[0038] Specifically, when registering a wireless communication slave device to be controlled in the network camera 100, the network camera 100 is first pointed in the direction of the wireless communication slave device to be registered. In other words, the wireless communication slave device to be registered is placed in approximately the center of the imaging range of the imaging unit 101. Then, the registration process is started, and the coordinates of the pan driving unit 106 and tilt driving unit 107 of the network camera 100 are registered as PT coordinates 504. In other words, information on the relative direction of the slave device based on the position of the network camera 100 (or imaging unit 101) is registered.

[0039] 4 is a diagram showing an example of the positional relationship between PT coordinates and wireless communication terminals. Here, a thermometer, which is a wireless communication terminal, is located in the direction (position) where the PT coordinates of the network camera 100 are (45, 45).

[0040] First, before the registration process by the wireless communication slave device (thermometer) is performed (for example, before a battery is attached to the thermometer), the network camera 100 is pointed toward the wireless communication slave device. After that, by attaching a battery to the thermometer, the registration process by the wireless communication slave device (thermometer) is performed, and the PT coordinates of the network camera 100 at that time, (45, 45), are registered. As a result, the wireless communication slave device (thermometer) with ID=9 is registered in the information table 500, as shown in FIG. 3.

[0041] <Control of wireless communication devices by network cameras> Fig. 5 is an operational flowchart of the network camera according to the first embodiment. The operational flow shown in Fig. 5 is executed when a pan, tilt, zoom (PTZ) operation is performed on the network camera 100. Note that the operation flow may be executed each time a series of PTZ operations is stopped during the series of PTZ operations. Alternatively, the operation flow may be executed after a certain time has elapsed since the PTZ operations were stopped (i.e., after the series of PTZ operations is completed).

[0042] In step S801, the system control unit 103 checks the pan-tilt (PT) coordinates of the four vertices of the shooting range (shooting angle of view), which are calculated, for example, from the PT coordinates and zoom (Z) value of the network camera 100 at that time.

[0043] 6 is a diagram showing an example of an image 900 captured by a network camera. The captured image 900 includes a wireless communication adapter 901. However, at the time of S801, the network camera 100 has not yet recognized that the captured image 900 includes the wireless communication adapter 901. In S801, the system control unit 103 checks the PT coordinates of the four vertices of the captured image 900: (P2, T2), (P1, T2), (P2, T1), and (P1, T1).

[0044] In S802, the system control unit 103 performs processing to identify a child device within the shooting range. In S803, the system control unit 103 determines whether the processing of S802 has been performed for all child devices registered in the information table 500. If the processing of S802 has been performed for all registered child devices, the process proceeds to S804; if there are any child devices that have not been subjected to the processing of S802, the process proceeds to S802. In other words, the processing of S802 is repeated until it has been performed for all child devices registered in the information table 500.

[0045] 7 is a detailed flowchart of the slave unit identification process (S802). In the following description, it is assumed that the process is performed on a slave unit x (x is 1 to N).

[0046] In S1001, the system control unit 103 acquires the PT coordinates (Px, Tx) of the slave x from the information table 500. That is, the system control unit 103 reads out the PT coordinates 504 corresponding to the slave x from the information table 500.

[0047] In S1002, the system control unit 103 checks whether Px is included in the pan range checked in S801 (i.e., between P1 and P2). If Px is included between P1 and P2, the process proceeds to S1003; if not, the process proceeds to S1005. In general, whether Px is included between P1 and P2 is determined by comparing the values ​​of P1 and P2 with Px. However, if the shooting range crosses 0°, such as an angle, the determination is made taking this into consideration.

[0048] In S1003, the system control unit 103 checks whether Tx is included in the tilt range checked in S801 (i.e., between T1 and T2). If Tx is included between T1 and T2, the process proceeds to S1004; if not, the process proceeds to S1005. In general, whether Tx is included between T1 and T2 is determined by comparing the values ​​of T1 and T2 with Tx. However, if the shooting range crosses 0°, such as an angle, the determination is made taking this into consideration.

[0049] In S1004, the system control unit 103 determines that the child device x is within the image capturing range. On the other hand, in S1005, the system control unit 103 determines that the child device x is outside the image capturing range.

[0050] In this way, by comparing the PT coordinates of the child device registered in advance in the information table 500 with the PT coordinates of the four vertices of the shooting range, it is possible to determine whether or not the child device is present within the current shooting range.

[0051] In S804, the system control unit 103 transmits a return request to the slave unit determined to be within the image capturing range in S802. For example, the system control unit 103 generates a return request and transmits it via the wireless communication control unit 110 and the antenna 111. As an additional process of S804, a request to transition to sleep may be transmitted to the slave unit that is not in a sleep state among the slave units determined to be outside the image capturing range in S802.

[0052] In S805, the system control unit 103 determines whether the slave device that sent the return request in S804 requires acquisition of value information. For example, if the slave device is a thermometer, the main function of the device is to acquire temperature information, so it is determined that value acquisition is required. On the other hand, if the main function of the device is to perform an action such as locking the door, it is determined that value acquisition is not required. If value information acquisition is required, the process proceeds to S806, and if value information acquisition is not required, the process proceeds to S807.

[0053] In S806, the system control unit 103 transmits a value information acquisition request to the slave device. For example, the system control unit 103 generates a value information acquisition request and transmits it via the wireless communication control unit 110 and the antenna 111.

[0054] In S807, the system control unit 103 performs control so that the slave unit information is displayed within the camera image. For example, the system control unit 103 generates an image in which the information stored in the information table 500 is displayed superimposed on the position of the slave unit within the camera image, and outputs the image to the client device 200. In addition, information (for example, a temperature value) obtained from the slave unit in response to the value information acquisition request transmitted in S806 may be displayed superimposed on the position of the slave unit within the camera image.

[0055] 8 is a diagram showing an example of displaying child device information within a camera image. The camera image is generated by the network camera 100, output to the client device 200, and displayed on the display unit 201.

[0056] In the camera image shown in FIG. 8, an information display 1101 is displayed superimposed on the captured image 900 shown in FIG. 6. In this case, since the slave unit 901 is a thermometer, the information display 1101 is a temperature value. In the above description, it was assumed that the network camera 100 generates a camera image in which the slave unit information is superimposed. However, the slave unit information may be distributed as metadata of the camera image, and the client device 200 may generate an image in which the slave unit information is superimposed. In addition, other information about the slave unit (for example, the remaining battery level) may be displayed as the information display 1101. Furthermore, for a device whose main purpose is to initiate actions such as door locking, the door lock status may be displayed as the information display 1101.

[0057] As described above, according to the first embodiment, the network camera 100 can identify a slave unit included in a captured image by using the pan / tilt (PT) coordinates of the slave unit that have been registered in advance. This makes it possible to display information about the slave unit superimposed on the captured image. Furthermore, it is possible to selectively wake up (wake up) a slave unit included in a captured image, and to display information acquired from the slave unit together with the information about the slave unit.

[0058] Although the above description has been given using a network camera as an example, the present invention can also be applied to cameras for other purposes, such as imaging devices that capture images for broadcasting, movies, or personal use.

[0059] (Second embodiment) In the second embodiment, a form will be described in which a slave unit present in a captured image is identified using directional information of an imaging unit (lens) of an imaging device. That is, directional information of the imaging unit is used instead of the pan / tilt (PT) coordinates in the first embodiment. This makes it possible to identify a slave unit present in a captured image, for example, even if the imaging device does not have a pan / tilt control configuration or if pan / tilt coordinates cannot be acquired.

[0060] <Functional configuration of the system and each device> 9 is a diagram showing the overall configuration of a system in the second embodiment. As in the first embodiment, the system includes a network camera 100 and a client device 200 that are communicatively connected via a network 300. The system also includes a wireless communication slave device 400 that can be connected to the network camera 100 via wireless communication.

[0061] In the second embodiment, the network camera 100 differs from the first embodiment in that it further includes a sensor input unit 112. The sensor input unit 112 acquires the position and orientation of the network camera 100 from a sensor device such as an electronic compass that detects magnetism to acquire the position and orientation, or an encoder that detects changes in mechanical position. The sensor device may be built into the camera, or may be an external device that can be connected to an external interface such as a USB. The rest of the configuration is the same as in the first embodiment, so a description thereof will be omitted.

[0062] <System Operation> The operation of the system roughly includes an operation in which the network camera registers information about the wireless communication slave devices, and an operation in which the network camera controls the wireless communication slave devices based on the registered information. These operations are explained in order below. Note that only the parts that differ from the first embodiment will be explained, and explanations of the same parts will be omitted.

[0063] <Registering wireless communication devices using network cameras> 10 is a diagram showing an example of registered information for wireless communication slave devices. Information table 1200 shows a state in which information for N wireless communication slave devices is registered and stored as a table. Information table 1200 is managed by, for example, system control unit 103 of network camera 100.

[0064] The information table 1200 includes, for each wireless communication slave device, an ID 1201, a device name 1202, a device type 1203, a direction value, and a tilt value 1204. The direction value and tilt value 1204 indicate values ​​that define the direction of the slave device based on the position of the network camera 100. The direction value and tilt value 1204 are values ​​that correspond to the "direction in which the imaging unit (lens) is facing" that are calculated based on the position and orientation of the network camera 100 obtained from the sensor input unit 112.

[0065] Specifically, before registering the wireless communication slave device to the network camera 100, the network camera 100 is first pointed in the direction of the wireless communication slave device. In other words, the wireless communication slave device is placed in the center of the image capturing range of the image capturing unit 101. Then, the registration process is started, and the "direction in which the image capturing unit (lens)" of the network camera 100 is registered as the direction value and tilt value 1204. Note that here, the direction value and tilt value 1204 are the "direction in which the image capturing unit (lens)" calculated based on the position and orientation of the network camera 100 obtained from the sensor input unit 112. However, a method of directly saving the value obtained from the sensor input unit 112 may also be used. In this case, the "direction in which the image capturing unit (lens)" is calculated in S1301, which will be described later.

[0066] <Control of wireless communication devices by network cameras> Fig. 11 is an operational flowchart of the network camera according to the second embodiment. The operational flow shown in Fig. 11 is executed when the position, orientation, or zoom of the network camera 100 is changed (when a PTZ operation is performed). Note that this may be executed every time a PTZ operation stops during a series of PTZ operations. It may also be executed after a certain time has elapsed since the PTZ operation stopped (i.e., after a series of PTZ operations is completed). Note that S1301 and S1302 are different from those in the first embodiment (Fig. 5). S803 to S807 are the same as those in the first embodiment, so a description thereof will be omitted.

[0067] In S1301, the system control unit 103 calculates the direction and tilt of the four vertices of the shooting range (shooting angle of view). This is done by, for example, calculating the direction and tilt value of the "direction in which the imaging unit (lens) is facing" from the value of the sensor input unit 112 at that time, and taking into consideration information on the horizontal angle of view and vertical angle of view calculated from the zoom setting value.

[0068] 12 is a diagram showing an example of an image 1500 captured by a network camera. The captured image 1500 includes a wireless communication slave unit 1501. However, at the time of S1301, the network camera 100 has not yet recognized that the captured image 1500 includes the wireless communication slave unit 1501. In S1501, the system control unit 103 checks the direction values ​​and tilt values ​​of the four vertices of the captured image 1500: (D2, S2), (D1, S2), (D2, S1), and (D1, S1).

[0069] For example, D1, D2, S1, and S2 are calculated by the following formula using the direction value Dc and tilt value Sc of the lens corresponding to approximately the center 1502 of the shooting range. D1 = Dc - horizontal angle of view / 2 D2 = Dc + horizontal angle of view / 2 S1 = Sc - vertical angle of view / 2 S2 = Sc + vertical angle of view / 2

[0070] In S1302, the system control unit 103 performs processing to identify a child device within the shooting range. In S803, the system control unit 103 determines whether the processing of S1302 has been performed for all child devices registered in the information table 1200. If the processing of S1302 has been performed for all registered child devices, the process proceeds to S804; if there are any child devices that have not been subjected to the processing of S1302, the process proceeds to S1302. In other words, the processing of S1302 is repeated until it has been performed for all child devices registered in the information table 1200.

[0071] 13 is a detailed flowchart of the slave unit identification process (S1302). In the following description, it is assumed that the process is performed on a slave unit x (x is 1 to N).

[0072] In S1401, the system control unit 103 acquires the direction value and tilt value (Dx, Sx) of the slave x from the information table 1200. That is, the system control unit 103 reads out the direction value and tilt value 1204 corresponding to the slave x from the information table 1200.

[0073] In S1402, the system control unit 103 checks whether Dx is included in the direction value range (i.e., between D1 and D2) checked in S1301. If Dx is included between D1 and D2, the process proceeds to S1403; if not, the process proceeds to S1405.

[0074] In S1403, the system control unit 103 checks whether Sx is included in the slope value range (i.e., between S1 and S2) checked in S1301. If Sx is included between S1 and S2, the process proceeds to S1404; if not, the process proceeds to S1405.

[0075] In S1404, the system control unit 103 determines that the child device x is within the image capturing range. On the other hand, in S1405, the system control unit 103 determines that the child device x is outside the image capturing range.

[0076] In this way, by comparing the direction and tilt values ​​of the child device registered in advance in the information table 1200 with the direction and tilt values ​​of the four vertices of the shooting range, it is possible to determine whether the child device is present within the current shooting range.

[0077] As described above, according to the second embodiment, the network camera 100 can identify a slave unit included in a captured image by using the direction and tilt values ​​of the slave unit that have been registered in advance. This makes it possible to display information about the slave unit superimposed on the captured image. Furthermore, it is possible to selectively wake up a slave unit included in a captured image, and to display information acquired from the slave unit together with the information about the slave unit.

[0078] (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0079] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0080] 100 network cameras; 200 client devices; 300 networks; 400 wireless communication adapters

Claims

1. A control device that operates as a parent device that controls a child device, An imaging means; a registration means for registering information about a slave device to be controlled by the control device; an identification unit that identifies a slave unit present within a photographing range of the imaging unit based on the slave unit information registered by the registration unit; a slave control means for controlling the slave; and the registration means registers, as the child device information, information on a relative direction of the child device based on the position of the imaging means; When the identification means identifies the child device within the photographing range, the child device control means transmits to the child device a return request which is a request for returning the child device from a sleep state. A control device characterized by:

2. further comprising an output means for outputting the image captured by the imaging means to an external device; The output means outputs an image in which information about the slave unit identified by the identification means is superimposed on the image captured by the imaging means.

2. The control device according to claim 1.

3. further comprising an output means for outputting the image captured by the imaging means to an external device; the slave control means acquires information about the status of the slave identified by the identification means; The output means outputs an image in which information obtained by information acquisition by the slave unit control means is superimposed on an image captured by the imaging means.

2. The control device according to claim 1.

4. further comprising an output means for outputting the image captured by the imaging means to an external device; The output means outputs information about the slave unit identified by the identification means as metadata together with the image captured by the imaging means.

2. The control device according to claim 1.

5. further comprising an output means for outputting the image captured by the imaging means to an external device; the slave control means acquires information about the status of the slave identified by the identification means; The output means outputs, as metadata, the information obtained by the information acquisition by the slave unit control means together with the image captured by the imaging means.

2. The control device according to claim 1.

6. The registration means executes a registration process when the slave unit to be registered is located approximately in the center of the imaging range of the imaging means, and registers information on the relative direction of the slave unit based on the position of the imaging means at the time the registration process is executed.

6. The control device according to claim 1, wherein the control device comprises: a first electrode;

7. Further, the camera has a drive control means for driving and controlling the photographing direction of the imaging means in a pan direction and a tilt direction, The registration means registers values ​​of the pan direction and tilt direction in the drive control means as the child device information.

7. The control device according to claim 1, wherein the control device comprises: a first electrode;

8. a position and orientation acquisition unit for acquiring the position and orientation of the imaging unit; The registration means registers the position and orientation values ​​obtained by the position and orientation acquisition means as the child device information.

7. The control device according to claim 1, wherein the control device comprises: a first electrode;

9. The position and attitude acquisition means includes an electronic compass and an encoder built into the control device and / or an external electronic compass and an encoder.

9. The control device according to claim 8.

10. The specifying means executes the specifying when a change in the position and orientation of the imaging means occurs and the imaging range changes.

10. The control device according to claim 1, wherein the control device comprises:

11. A control method for a control device that has an imaging unit and operates as a parent device that controls a child device, comprising: a registration step of registering information about a slave device to be controlled by the control device; an identification step of identifying a slave unit present within a photographing range of the imaging unit based on the slave unit information registered in the registration step; a slave unit control step of controlling the slave unit; Including, In the registration step, information on a relative direction of the slave unit based on a position of the imaging unit is registered as the slave unit information, In the slave device control step, when the slave device is identified within the photographing range in the identification step, a recovery request is transmitted to the slave device, which is a request for waking up the slave device from a sleep state. A control method comprising:

12. A program for causing a computer to execute the control method according to claim 11.

Images