Overseeing system and control device

Abstract

This overseeing system comprises an acquisition unit that acquires data relating to the state of a subject, an imaging unit that starts capturing an image including the subject when the state of the subject is a prescribed state, and a control unit that keeps the imaging unit in a state in which imaging of the subject is impossible until the state of the subject is the prescribed state.

Description

Monitoring system and control device

[0001] This invention relates to a monitoring system and a control device.

[0002] A monitoring system has been proposed that can remotely monitor people who live alone, elderly people who spend the day alone, sick people, etc. (for example, Patent Document 1).

[0003] There is a demand for a monitoring system that takes into consideration the privacy of the subjects.

[0004] Japanese Patent Application Laid-Open No. 2022-84002

[0005] According to a first aspect of the disclosure, the monitoring system includes an acquisition unit that acquires data regarding the condition of a subject, an imaging unit that starts capturing an image including the subject when the condition of the subject is in a predetermined state, and a control unit that causes the imaging unit to be unable to capture an image of the subject until the condition of the subject reaches the predetermined state.

[0006] According to a second aspect of the disclosure, the monitoring system includes an imaging unit that starts capturing an image including the subject when the subject's condition estimated from data acquired by an acquisition unit that acquires data regarding the subject's condition is a predetermined condition, and a control unit that causes the imaging unit to be unable to capture an image of the subject until the estimated condition of the subject reaches the predetermined condition.

[0007] According to a third aspect of the disclosure, the control device includes a control unit that causes an imaging unit that captures an image including the subject to be unable to capture an image of the subject until the subject's condition estimated from the data acquired by an acquisition unit that acquires data regarding the subject's condition reaches a predetermined state.

[0008] The configurations of the embodiments described below may be modified as appropriate, and at least a portion of the configuration may be replaced with other components. Furthermore, components that are not particularly limited in terms of their placement may be placed in any position that allows them to achieve their function, not limited to the placement disclosed in the embodiments.

[0009] FIG. 1 is a diagram illustrating the configuration of a monitoring system according to a first embodiment. FIG. 2 is a diagram illustrating an example of the installation of a sensor, a slave camera, and a master camera. FIG. 3(A) is a block diagram illustrating the configuration of a master camera, and FIG. 3(B) is a block diagram illustrating the configuration of a slave camera. FIGS. 4(A) and 4(B) are diagrams illustrating a master camera according to this embodiment, and FIGS. 4(C) and 4(D) are diagrams illustrating another example of a master camera according to this embodiment. FIG. 5 is a flowchart illustrating an example of processing executed by the control unit of the master camera. FIG. 6 is a flowchart illustrating details of the first processing. FIG. 7 is a flowchart illustrating details of the second processing. FIG. 8 is a flowchart illustrating an example of processing executed by the control unit of the slave camera. FIGS. 9(A) to 9(D) are time charts illustrating an example of processing executed in the monitoring system according to the first embodiment. FIG. 10 is a flowchart illustrating an example of processing executed by the control unit of the master camera in the monitoring system according to the second embodiment. FIG. 11 is a flowchart (part 1) illustrating details of the third processing. FIG. 12 is a flowchart (part 2) showing details of the third process. FIG. 13 is a flowchart showing details of the fourth process. FIG. 14 is a flowchart showing an example of a process executed by the control unit of the slave camera in the monitoring system according to the second embodiment. FIGS. 15(A) and 15(B) are time charts showing an example of a process executed by the control unit of the parent camera in the monitoring system according to the second embodiment. FIG. 16 is a diagram showing an example of a broadcaster list. FIG. 17 is a flowchart showing an example of a process executed by the control unit of the parent camera in the monitoring system according to the third embodiment. FIG. 18 is a flowchart showing details of the fifth process. FIG. 19 is a flowchart showing details of the sixth process. FIG. 20 is a flowchart showing an example of a process executed by the control unit of the slave camera in the monitoring system according to the third embodiment. FIG. 21 is a time chart showing an example of a process executed by the monitoring system according to the third embodiment. FIG. 22(A) is a diagram showing an example of the hardware configuration of the control unit of the parent camera, and FIG. 22(B) is a diagram showing an example of the hardware configuration of the control unit of the slave camera. FIG. 23 is a diagram showing the configuration of a monitoring system according to a modified example.FIG. 24 is a functional block diagram showing the configuration of a control device in a modified example.

[0010] First Embodiment A monitoring system 100 according to a first embodiment will be described in detail below with reference to Fig. 1 to Fig. 9(D). Fig. 1 shows the configuration of the monitoring system 100 in a block diagram.

[0011] The monitoring system 100 is a system for a person (family member, relative, helper, care manager, etc.) related to a person to be watched over TR1 (hereinafter referred to as the person TR1) to watch over the person TR1. In the following description, a person related to the person TR1 will be referred to as a person watching over OB1. As shown in FIG. 1 , the monitoring system 100 according to this embodiment includes a home system 150, a service server SS, and a mobile terminal MT1.

[0012] The home system 150 (more specifically, the parent camera 40), the service server SS of the monitoring system 100, and the mobile terminal MT1 are connected via a network NW that includes a public wireless LAN, the Internet, a mobile phone network, etc. Communication between the home system 150, the service server SS, and the mobile terminal MT1 can be based on, for example, the NICE (Network of Intelligent Camera Ecosystem) specification.

[0013] The mobile terminal MT1 is a mobile terminal carried by the person OB1 who is watching over the subject TR1, and may be, for example, a smartphone, tablet terminal, or laptop personal computer (PC). Note that the mobile terminal MT1 may be replaced with a terminal such as a desktop PC owned by the person OB1. An application for using the watching system is installed on the mobile terminal MT1. The application allows the person OB1 to give instructions to the home system 150, receive notifications from the home system 150, and view images captured by the slave camera 20 and master camera 40 included in the home system 150.

[0014] The service server SS is a server that provides a monitoring service. Based on a request from the home system 150, the service server SS pushes a message to the mobile terminal MT1 and transmits instructions to the home system 150 in response to operations of an application installed on the mobile terminal MT1.

[0015] The home system 150 is installed in, for example, a residence H1 where the subject TR1 resides. The home system 150 includes, for example, a sensor 10, a slave camera 20, a master camera 40, and a remote controller 30.

[0016] The sensor 10, the slave camera 20, and the master camera 40 are installed in the residence H1 where the subject TR1 resides, etc. The sensor 10, the slave camera 20, and the master camera 40 are installed in places where the subject TR1 stays and uses, such as a living room, a hallway, a bathroom, a washroom, and a toilet.

[0017] FIG. 2 is a diagram illustrating an example of the installation of the sensor 10, the slave camera 20, and the master camera 40. In the example of FIG. 2, a residence H1 has three rooms R1 to R3. A sensor 10 is installed in each of the rooms R1 to R3. In FIG. 2, the sensors 10 installed in each of the rooms R1 to R3 are referred to as sensors 10-1 to 10-3. Note that, although one sensor 10 is installed in each room in FIG. 2, multiple sensors may be installed in each room.

[0018] At least one camera is installed in each room in which a sensor 10 is installed. In the example of FIG. 2 , a master camera 40 is installed in room R1 in which sensor 10-1 is installed, and slave cameras 20 are installed in rooms R2 and R3 in which sensors 10-2 and 10-3 are installed, respectively. In FIG. 2 , the slave cameras 20 installed in rooms R2 and R3 are designated slave cameras 20-1 and 20-2, respectively. The slave cameras 20 and master camera 40 may be installed on the ceiling, on the wall, or at any location within the room. Note that while FIG. 2 shows one camera installed in each room, multiple cameras may be installed in each room. For example, a master camera 40 and a slave camera 20 may be installed in room R1, and multiple slave cameras 20 may be installed in room R2.

[0019] The sensors 10 (sensors 10-1 to 10-3 in the example of FIG. 2) and the parent camera 40 are connected by, for example, DECT (Digital Enhanced Cordless Telecommunications). The sensors 10 and the parent camera 40 may also be connected by short-range communication such as a wired local area network (LAN), a wireless LAN, Wi-Fi, or Bluetooth (registered trademark).

[0020] The slave cameras 20 (slave cameras 20-1 and 20-2 in the example of FIG. 2) and the master camera 40 are connected by, for example, Wi-Fi. The slave cameras 20 and the master camera 40 may also be connected by wired LAN, wireless LAN, or proximity communication such as Bluetooth (registered trademark).

[0021] The remote controller 30 and the parent camera 40 are connected by, for example, DECT. The remote controller 30 and the parent camera 40 may also be connected by short-range communication such as wireless LAN, Wi-Fi, or Bluetooth (registered trademark).

[0022] (Sensor 10) The sensor 10 acquires data related to the state of the subject TR1. In this embodiment, the sensor 10 acquires data related to the state of the subject TR1 other than visible light images. Examples of the sensor 10 include an infrared array sensor, an infrared camera, a depth sensor, a radio wave sensor (millimeter wave radar), a vibration sensor, a sound sensor, a wearable sensor, a thermometer, and a hygrometer. In this embodiment, the sensor 10 will be described as an infrared array sensor. Note that a camera equipped with a filter that cuts visible light may also be used as the sensor 10.

[0023] In this embodiment, the sensor 10 is attached to a ceiling, for example. If the sensor 10 is an infrared array sensor, the sensor 10 acquires, for example, temperature distribution data below the sensor 10. Unlike visible light images, the temperature distribution data does not allow the subject's face, clothing, etc. to be visually recognized, thereby protecting the privacy of the subject TR1. Furthermore, because the infrared array sensor does not have a lens, it is possible to prevent the subject TR1 from feeling that they are being "surveilled" or "their privacy is being violated," thereby reducing the psychological burden on the subject TR1. The sensor 10 may also be attached to a wall, for example.

[0024] The data acquired by the sensor 10 is transmitted to the parent camera 40 .

[0025] (Remote Controller 30) The remote controller 30 communicates with the parent camera 40 and transmits instructions to the parent camera 40 in response to operations on the remote controller 30. The remote controller 30 includes, for example, buttons or a touch panel for inputting various instructions. The remote controller 30 may include at least one of a microphone for inputting instructions by voice and a speaker for notifying the target person TR1 by voice. The remote controller 30 may also be a terminal such as a smartphone on which an application for the monitoring system 100 is installed.

[0026] (Master Camera 40) The master camera 40 captures visible light images (hereinafter referred to as images). In this embodiment, the home system 150 includes one master camera 40, but may include multiple master cameras 40.

[0027] 3A is a block diagram illustrating the configuration of parent camera 40. Parent camera 40 includes an imaging unit 41, a microphone 42, a speaker 43, a storage unit 44, a first communication module 45, a second communication module 46, a third communication module 47, a control unit 48, and a drive unit 49.

[0028] The imaging unit 41 includes a lens, an imaging element, and the like, and captures an image within an imaging range.

[0029] The microphone 42 acquires sounds and the like emitted by the subject TR1 and transmits them to the control unit 48. The microphone 42 may also be used as the sensor 10.

[0030] The speaker 43 outputs a predetermined sound under the control of the control unit 48 .

[0031] The storage unit 44 is a storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores images captured by the imaging unit 41 .

[0032] The first communication module 45 is, for example, a DECT module, and enables communication with the sensor 10 and the remote controller 30 .

[0033] The second communication module 46 is, for example, a Wi-Fi module, and enables communication with the child camera 20 .

[0034] The third communication module 47 is, for example, an LTE (Long Term Evolution) module, and enables communication with the service server SS and the mobile terminal MT1.

[0035] The control unit 48 controls the overall operation of the parent camera 40. The processing executed by the control unit 48 will be described in detail later.

[0036] The driving device 49 is, for example, an actuator such as a motor, and is driven based on instructions from the control unit 48 to move a cover 422 (details of which will be described later) provided on the parent camera 40 .

[0037] (Slave camera 20) Like the parent camera 40, the child camera 20 captures visible light images. In this embodiment, the home system 150 includes one or more child cameras 20. Note that if the subject TR1 can be monitored using only the parent camera 40, the child camera 20 may be omitted.

[0038] 3B is a block diagram illustrating the configuration of slave camera 20. Slave camera 20 includes imaging unit 21, microphone 22, speaker 23, storage unit 24, second communication module 26, control unit 28, and drive device 29.

[0039] The slave camera 20 differs from the parent camera 40 in that it omits the first communication module 45 and the third communication module 47. In the slave camera 20, the second communication module 26 is, for example, a Wi-Fi module, which enables communication with the parent camera 40. The rest of the configuration is the same as that of the parent camera 40, so detailed description will be omitted.

[0040] Next, a description will be given of the structural features of the slave camera 20 and the master camera 40 according to this embodiment. Since the slave camera 20 and the master camera 40 have almost the same structure, only the master camera 40 will be described here.

[0041] 4A and 4B are diagrams illustrating the parent camera 40 according to this embodiment. As shown in FIGS. 4A and 4B, the parent camera 40 includes a lens 421 and a cover 422 that covers the lens 421.

[0042] The cover 422 moves up and down by being driven by the drive device 49 under the control of the control unit 48. The control unit 48 places the imaging unit 41 (lens 421) of the parent camera 40 in a state where it cannot capture images (the state shown in FIG. 4(B) ) until it is determined that an abnormality has occurred in the subject TR1 based on data from the sensor 10. Specifically, the control unit 48 controls the drive device 49 so that the cover 422 covers the lens 421. In other words, the control unit 48 places the lens 421 of the parent camera 40 in a state where it cannot be seen by the subject TR1 until it is determined that an abnormality has occurred in the subject TR1. This places the imaging unit 41 (lens 421) of the parent camera 40 in a state where it cannot physically capture images.

[0043] Because the lens 421 is covered by the cover 422, the subject TR1 cannot see the lens 421. This makes it possible to prevent the subject TR1 from feeling that he or she is being "surveilled" or "his privacy is being violated" under normal circumstances (when no abnormality occurs in the subject TR1).

[0044] If it is determined that an abnormality has occurred with the subject TR1, the control unit 48 moves the cover 422, for example, downward, so that the lens 421 can capture an image (the state shown in FIG. 4A ). Thus, the parent camera 40 has a different appearance when it is capable of capturing an image and when it is not capable of capturing an image. In other words, the parent camera 40 has a first appearance (an appearance in which the lens 421 is visible) when an abnormality has occurred with the subject TR1, and a second appearance (an appearance in which the lens 421 is not visible) otherwise. Thus, the subject TR1 can know from the appearance of the parent camera 40 that no images including him or her have been captured, allowing him or her to easily confirm whether his or her privacy is protected and feel a sense of security. The color of the cover 422 may be different from the color of the parent camera 40 housing, or an “X” mark or the like may be provided on the cover 422, so that it is easily visible that the lens 421 is covered by the cover 422.

[0045] In addition, in Figures 4(A) and 4(B), an example is described in which the parent camera 40 is equipped with a cover 422 that covers the lens 421 under normal conditions, but the configuration of the parent camera 40 is not limited to this.

[0046] 4(C) and 4(D) are diagrams showing other examples of the parent camera 40. The parent camera 40 shown in Fig. 4(C) and Fig. 4(D) includes a lens 421 and an LED light 423.

[0047] 4(C) and 4(D), the control unit 48 causes the LED light 423 to light up in a first color (e.g., red) when the imaging unit 41 of the parent camera 40 is unable to capture an image, and causes the LED light 423 to light up in a second color (e.g., green) different from the first color when the imaging unit 41 is able to capture an image. This allows the subject TR1 to know from the color of the LED light 423 whether the parent camera 40 is able to capture an image.

[0048] Note that until it is determined that an abnormality has occurred in the subject TR1, the control unit 48 may change the imaging direction of the parent camera 40 (the orientation of the lens 421) to a direction different from the direction in which the preset imaging range exists, or may cause the parent camera 40 to wait in a location (e.g., under a bed) where the subject TR1 cannot see the parent camera 40 (or the lens 421). Even with this method, the subject TR1 cannot see the parent camera 40 or the lens 421, which prevents the subject TR1 from feeling that they are being “surveilled” or “their privacy is being violated.” Note that when the orientation of the lens 421 is changed to a direction different from the direction in which the preset imaging range exists, an image that does not include the subject TR1 may be captured.

[0049] Next, a description will be given of the processing executed in the monitoring system 100. First, a description will be given of the processing executed by the control unit 48 of the parent camera 40. Fig. 5 is a flowchart showing an example of the processing executed by the control unit 48 of the parent camera 40.

[0050] 5, first, the control unit 48 acquires data on the condition of the subject TR1 from the sensor 10 (step S11). In this embodiment, the sensor 10 is an infrared array sensor, so the control unit 48 acquires temperature distribution data detected by the sensor 10.

[0051] Next, the control unit 48 estimates the state of the subject TR1 based on the acquired data (in this embodiment, temperature distribution data) (step S12). For example, the control unit 48 estimates that the subject TR1 is standing if the highest temperature included in the temperature distribution data is equal to or higher than a first temperature, and determines that the subject TR1 is sitting if the lowest temperature is equal to or higher than a second temperature, the highest temperature is equal to or lower than a third temperature, and the area of ​​the region equal to or higher than the second temperature and equal to or lower than the third temperature is within a predetermined range. Furthermore, the control unit 48 estimates that the subject TR1 is lying down if the lowest temperature is equal to or higher than the second temperature, the highest temperature is equal to or lower than the third temperature, and the area of ​​the region equal to or higher than the second temperature and equal to or lower than the third temperature is larger than a predetermined area. The method of estimating the state of the subject TR1 using an infrared array sensor can be, for example, the method described in IEICE Technical Report, vol. 114, no. 166, ASN2014-81, pp. 219-224, July 2014.

[0052] Next, the control unit 48 determines whether the estimated state of the subject TR1 is a state in which an abnormality has occurred in the subject TR1 (a predetermined state) (step S13). If an abnormality has not occurred in the subject TR1 (step S13 / NO), the process returns to step S11. An abnormality in the subject TR1 is, for example, a state in which the subject TR1 has fallen or remains motionless in the same position for a long time.

[0053] If an abnormality has occurred in the subject TR1 (step S13 / YES), the control unit 48 identifies a camera installed in the same location (room, etc.) as the sensor 10 that detected the abnormality in the subject TR1 (step S14). For example, a table in which the sensors and cameras installed in each room are associated is stored in the storage unit 44, and the control unit 48 can identify a camera installed in the same location (room, etc.) as the sensor 10 that detected the abnormality in the subject TR1 by referring to the table.

[0054] Next, the control unit 48 determines whether the camera identified in step S14 is the parent camera 40 (step S15). For example, in the example of Fig. 2, if the sensor 10 that detected the abnormality of the subject TR1 is the sensor 10-1 installed in room R1, the camera identified in step S14 is the parent camera 40. If the camera identified in step S14 is the parent camera 40 (step S15 / YES), the control unit 48 executes a first process (step S20).

[0055] Fig. 6 is a flowchart showing the details of the first process. In the process of Fig. 6, first, the control unit 48 transmits a predetermined message to the mobile terminal MT1 (step S201). For example, the control unit 48 transmits a message indicating that there is a possibility that an abnormality has occurred in the subject TR1. The message may be transmitted to the mobile terminal MT1 via the service server SS or may be transmitted directly from the control unit 48.

[0056] Next, the control unit 48 starts timing the image capture standby time (step S203). The image capture standby time is a predetermined time until the slave camera 20 or the master camera 40 starts capturing an image including the subject TR1. The slave camera 20 and the master camera 40 may capture an image not including the subject TR1 before or after capturing an image including the subject TR1. This allows the slave camera 20 and the master camera 40 to be used, for example, as a security camera or a camera for monitoring a pet. The image capture standby time can be set to any length. During the image capture standby time, the slave camera 20 and the master camera 40 do not capture an image including the subject TR1. Note that the slave cameras 20 (slave cameras 20-1 and 20-2 in the example of FIG. 2 ) that are not located in the same location as the sensor 10 that detected the abnormality in the subject TR1 may capture an image because the image does not include the subject TR1. This allows the slave camera 20 and the master camera 40 to be used, for example, as security cameras or cameras for keeping an eye on pets.

[0057] Next, the control unit 48 notifies the subject TR1 of the start of image capture (step S205). Specifically, the control unit 48 notifies the subject TR1 of the start of image capture using the speaker 43. For example, the control unit 48 causes the speaker 43 to output a sound such as "Image capture will start in 5 seconds," thereby notifying the subject TR1 of the timing when image capture by the parent camera 40 will start. Note that instead of the timing when image capture will start, the control unit 48 may notify the subject TR1 via the speaker 43 of the time until image capture will start, that the current time is an image capture standby time, that the current time is within a period in which image capture can be prohibited (cancelled), etc. This allows the subject TR1 to know the timing when image capture will start, the time until image capture will start, that image capture has not yet started, or that image capture can be prohibited.

[0058] The order of the processes in steps S201 to S205 can be changed arbitrarily.

[0059] Next, the control unit 48 determines whether or not an input to prohibit image capture has been received (step S207). Specifically, the control unit 48 performs a voice recognition process on the sound input from the microphone 42, and determines whether or not the input sound includes a predetermined sound for prohibiting image capture (e.g., "No image capture," "Don't take a picture," "Stop," "False detection," "No abnormality," "Stop," etc.). If a sound for prohibiting image capture is included, the control unit 48 determines that an input to prohibit image capture has been received.

[0060] If an input prohibiting image capture is received (step S207 / YES), the subject TR1 is in a state where an input prohibiting image capture is possible (a state where no abnormality is occurring), so it is considered that the judgment in step S13 of FIG. 5 was incorrect (misjudgment / misdetection). In this case, the control unit 48 transmits a predetermined message to the portable terminal MT1 (step S225). For example, when the control unit 48 receives an input prohibiting image capture, it transmits a message notifying the portable terminal MT1 that the abnormality was a misdetection or that no abnormality is occurring with the subject TR1. This allows the person carrying the portable terminal MT1 (the person watching over the subject TR1) OB1 to know that the subject TR1 is safe.

[0061] Next, the control unit 48 stops counting the image capture standby time (step S227) and returns to step S11 in Fig. 5. This prevents image capture by the parent camera 40. This prevents the subject TR1 from being captured even when no abnormality has occurred, thereby protecting the privacy of the subject TR1.

[0062] If the control unit 48 has not received an input prohibiting image capture (step S207 / NO), the control unit 48 determines whether or not an image capture request for an image including the subject TR1 has been received from the portable terminal MT1 (step S209). For example, when an "image capture request" button is pressed (tapped) on an application installed on the portable terminal MT1, an image capture request is transmitted from the portable terminal MT1. The image capture request may be transmitted directly from the portable terminal MT1 to the parent camera 40 or may be transmitted via the service server SS.

[0063] If an image capture request has not been received (step S209 / NO), the control unit 48 determines whether or not the image capture standby time has elapsed (step S211). Specifically, it determines whether or not the image capture standby time has elapsed since the image capture standby time counting started in step S203. If the image capture standby time has not elapsed (step S211 / NO), the process returns to step S207.

[0064] When an image capturing request is received (step S209 / YES) or when the image capturing standby time has elapsed (step S211 / YES), the control unit 48 moves the cover 422 covering the lens 421 to expose the lens 421, and causes the image capturing unit 41 to start capturing an image including the subject TR1 (step S213). At this time, the control unit 48 may record the image captured by the image capturing unit 41 in the storage unit 44.

[0065] When capturing of an image including the subject TR1 begins, the control unit 48 starts timing the delivery standby time (step S215). The delivery standby time is a predetermined time from the start of image capture until the start of image delivery. During the delivery standby time, images including the subject TR1 are not delivered. Note that, for example, if the slave camera 20 captures an image that does not include the subject TR1, the image that does not include the subject TR1 may be delivered. This allows the slave camera 20 and the master camera 40 to be used, for example, as a security camera or a camera for monitoring a pet.

[0066] Next, the control unit 48 notifies the subject TR1 about the distribution (step S217). For example, the control unit 48 causes the speaker 43 to output a sound such as "Distribution will start in 5 seconds" to notify the timing when the image distribution will start. Note that instead of the timing when the image distribution will start, the control unit 48 may notify the subject TR1 of the time until the image distribution will start, that the current time is within the distribution waiting time, that the current time is a period during which distribution can be prohibited, etc. This allows the subject TR1 to know the time when the image distribution will start, the time until the image distribution will start, that the image distribution has not yet started, or that distribution can be prohibited.

[0067] Next, the control unit 48 determines whether or not an input to prohibit image distribution has been received (step S219). For example, the control unit 48 performs a voice recognition process on the sound input from the microphone 42, and determines whether or not the input sound includes a predetermined sound for prohibiting image distribution (e.g., "Prohibit distribution," "Do not distribute," "Stop distribution," "False detection," "No abnormality," "Stop," etc.). If the predetermined sound is included, the control unit 48 determines that an input to prohibit image distribution has been received.

[0068] If an input prohibiting image distribution is received (step S219 / YES), it is considered that the judgment in step S13 of FIG. 5 was incorrect (misjudgment / misdetection). In this case, the control unit 48 transmits a predetermined message to the portable terminal MT1 (step S231). For example, the control unit 48 transmits a message informing the portable terminal MT1 that the abnormality was a misdetection or that there is no abnormality in the subject TR1. This allows the person OB1 carrying the portable terminal MT1 (the person watching over the subject TR1) to know that the subject TR1 is safe.

[0069] Next, the control unit 48 stops timing the delivery standby time and stops capturing images by the imaging unit 41 (step S233). This prevents image distribution, making it possible to prevent images of the subject TR1 from being distributed even when there is no abnormality in the subject TR1, thereby protecting the privacy of the subject TR1. Note that if an image has been recorded in the storage unit 44, the recorded image may be deleted. This further protects the privacy of the subject TR1.

[0070] Next, the control unit 48 drives the drive device 49 to cover the lens 421 with the cover 422 (step S235). This allows the subject TR1 to visually confirm that no image is being captured, thereby providing the subject TR1 with a sense of security that his or her privacy is protected. Thereafter, the process returns to step S11 in FIG. 5.

[0071] If the control unit 48 has not received an input prohibiting image distribution (step S219 / NO), the control unit 48 determines whether the distribution waiting time has elapsed (step S221). Specifically, the control unit 48 determines whether the distribution waiting time has elapsed since the start of counting the distribution waiting time in step S215. If the distribution waiting time has not elapsed (step S221 / NO), the process returns to step S219.

[0072] If the delivery wait time has elapsed (step S221 / YES), the control unit 48 starts delivering images (step S223) and ends the first process (step S20). Note that the image delivery may be live view delivery, or an image from a predetermined time before the current time (e.g., several seconds) may be delivered. Also, past images may be viewable.

[0073] On the other hand, if the camera identified in step S14 of Figure 5 is the slave camera 20 (step S15 / NO), that is, if the camera installed in the same location as the sensor 10 that detected the abnormality in the subject TR1 is the slave camera 20, the control unit 48 performs the second processing (step S30).

[0074] Fig. 7 is a flowchart showing the details of the second process. Fig. 8 is a flowchart showing an example of the process executed by the control unit 28 of the slave camera 20. The second process will be described together with the process executed by the control unit 28 of the slave camera 20.

[0075] The processes of steps S301 and S303 in FIG. 7 are similar to steps S201 and S203 of the first process shown in FIG. 6, and therefore description thereof will be omitted.

[0076] When the timing of the image capture waiting time starts (step S303), the control unit 48 instructs the slave camera 20 to notify the start of image capture (step S305).

[0077] Meanwhile, control unit 28 of slave camera 20 waits until it receives a notification instruction from master camera 40 to start capturing images (FIG. 8: step S401 / NO). When control unit 28 receives a notification instruction from master camera 40 to start capturing images (step S401 / YES), it uses speaker 23 to notify the slave camera 20 of the start of capturing images (step S403), similar to step S205 in FIG. 6.

[0078] Next, the control unit 28 determines whether or not an image capture instruction has been received from the parent camera 40 (step S405). If an image capture instruction has not been received (step S405 / NO), the control unit 28 determines whether or not an input prohibiting image capture has been received from the subject TR1 (step S421). For example, the control unit 28 performs a voice recognition process on the sound input from the microphone 22 and determines whether or not the input sound includes a predetermined sound for prohibiting image capture. If the predetermined sound is included, the control unit 28 determines that an input prohibiting image capture has been received.

[0079] If the input prohibiting image capture has not been received (step S421 / NO), the process returns to step S405. If the input prohibiting image capture has been received (step S421 / YES), the control unit 28 transmits information indicating that the input prohibiting image capture has been received (image capture prohibition instruction) to the parent camera 40 (step S423), and the process in FIG. 8 ends.

[0080] Meanwhile, the control unit 48 of the parent camera 40 determines whether or not a capture prohibition instruction has been received from the child camera 20 (step S307 in FIG. 7). If a capture prohibition instruction has been received from the child camera 20 (step S307 / YES), the control unit 48 executes the processes of steps S325 and S327, similar to steps S225 and S227 in FIG. 6, and then returns to step S11 in FIG. 5.

[0081] If the image capture prohibition instruction has not been received from the slave camera 20 (step S307 / NO), the control unit 48 executes the processes of steps S309 and S311, similarly to steps S209 and S211 in FIG.

[0082] When the control unit 48 receives an image capture request from the mobile terminal MT1 (step S309 / YES), or when the image capture waiting time has elapsed (step S311 / YES), the control unit 48 transmits an image capture instruction to the slave camera 20 (step S313).

[0083] When the control unit 28 of the slave camera 20 receives an image capture instruction from the parent camera 40 (Figure 8: step S405 / YES), it drives the drive device 29 to move the cover, thereby exposing the lens of the slave camera 20 and causing the image capture unit 21 to start capturing images (step S407).

[0084] Thereafter, the control unit 28 waits until it receives an instruction from the parent camera 40 to send a notification regarding distribution (step S409 / NO).

[0085] On the other hand, after transmitting the image capture instruction, the control unit 48 of the parent camera 40 starts counting the distribution standby time (FIG. 7: step S315).The control unit 48 then instructs the child camera 20 to send a notification regarding the distribution (step S317).

[0086] When the control unit 28 of the slave camera 20 receives an instruction from the master camera 40 to notify the target person TR1 of the distribution (FIG. 8: step S409 / YES), the control unit 28 notifies the target person TR1 of the distribution (step S411). For example, the control unit 28 causes the speaker 23 to output a sound such as "Distribution will start in 5 seconds" to notify the target person TR1 of the timing at which the image distribution will start. Note that instead of the timing at which the image distribution will start, the target person TR1 may be notified of the time until the image distribution will start, that the current time is within the distribution waiting time, that the current time is a period during which distribution can be prohibited, etc. This allows the target person TR1 to know the timing at which the image distribution will start, the time until the image distribution will start, that the image distribution has not yet started, or that distribution can be prohibited.

[0087] Next, the control unit 28 determines whether or not an input to prohibit image distribution has been received (step S413). For example, the control unit 28 performs a voice recognition process on the sound input from the microphone 22 and determines whether or not the input sound includes a predetermined voice for prohibiting image distribution. If the predetermined voice is included, the control unit 28 determines that an input to prohibit image distribution has been received.

[0088] If an input prohibiting image distribution is received (step S413 / YES), the control unit 28 transmits information indicating that an input prohibiting distribution has been received (distribution prohibition instruction) to the parent camera 40 (step S425).

[0089] The control unit 28 stops the imaging unit 21 from capturing the image of the subject TR1 (step S417), drives the driving device 29 to cover the lens of the slave camera 20 (step S419), and ends the processing of FIG. 8. If an image has been recorded in the storage unit 24, the recorded image may be deleted. This makes it possible to further protect the privacy of the subject TR1.

[0090] Meanwhile, the control unit 48 of the parent camera 40 determines whether or not a distribution prohibition instruction has been received from the child camera 20 ( FIG. 7 : step S319). If a distribution prohibition instruction has been received from the child camera 20 (step S319 / YES), the control unit 48 transmits a predetermined message to the portable terminal MT1 (step S329). For example, the control unit 48 transmits a message informing the user that the abnormality was a false detection or that there is nothing abnormal with the subject TR1. This allows the person carrying the portable terminal MT1 (the person watching over the subject TR1) OB1 to know that the subject TR1 is safe.

[0091] Next, the control unit 48 stops counting the distribution waiting time (step S331). This prevents image distribution, so that it is possible to prevent images of the subject TR1 from being distributed even when there is no abnormality in the subject TR1, thereby protecting the privacy of the subject TR1. Then, the process returns to step S11 in FIG. 5.

[0092] If the distribution prohibition instruction has not been received from the slave camera 20 (step S319 / NO), the control unit 48 determines whether the distribution waiting time has elapsed (step S321). If the distribution waiting time has not elapsed (step S321 / NO), the process returns to step S319.

[0093] If the distribution waiting time has elapsed (step S321 / YES), the control unit 48 instructs the slave camera 20 to continue capturing images including the subject TR1 (step S323) and starts distributing images including the subject TR1 (step S324).

[0094] 8, if the control unit 28 of the slave camera 20 has not received an input prohibiting distribution (step S413 / NO), it determines whether or not an instruction to continue shooting has been received from the master camera 40 (step S415). If the instruction to continue shooting has not been received (step S415 / NO), the process returns to step S413.

[0095] If an instruction to continue photographing is received (step S415 / YES), the control unit 28 causes the imaging unit 21 to continue photographing an image including the subject TR1 (step S416), and ends the processing of FIG.

[0096] Next, an example of the processing executed in the monitoring system 100 will be described with reference to the time charts of Figures 9(A) to 9(D). In Figures 9(A) to 9(D), the vertical axis represents time.

[0097] First, the example of Fig. 9A will be described. In Fig. 9A, it is assumed that the control unit 48 determines that an abnormality has occurred in the subject TR1 at time t1. In this case, the control unit 48 starts counting the image capture standby time at time t1.

[0098] Here, if an input to prohibit image capture is received at time t3, which is before time t2 at which the image capture standby time T1 has elapsed, the control unit 48 stops timing the image capture standby time. Therefore, in the example of Fig. 9A, an image including the subject TR1 is not captured, and it is possible to prevent an image from being captured even when there is no abnormality in the subject TR1.

[0099] Next, an example of Fig. 9(B) will be described. In Fig. 9(B), it is assumed that the control unit 48 determines that an abnormality has occurred in the subject TR1 at time t1. In this case, the control unit 48 starts counting the image capture standby time at time t1.

[0100] When an imaging request is received at time t3, which is before time t2 when the imaging waiting time T1 has elapsed, the imaging unit 21 or 41 starts capturing an image including the subject TR1, and the control unit 48 starts timing the delivery waiting time.

[0101] When the delivery waiting time T2 has elapsed at time t4, the control unit 48 starts delivering the image. In the example of Fig. 9B, an image including the target person TR1 is delivered to the mobile terminal MT1 after time t4.

[0102] Next, an example shown in Fig. 9C will be described. In Fig. 9C, it is assumed that the control unit 48 determines that an abnormality has occurred in the subject TR1 at time t1. In this case, the control unit 48 starts counting the image capture standby time at time t1.

[0103] When the image capture standby time T1 has elapsed at time t2, the image capture unit 21 or 41 starts capturing an image including the target person TR1, and the control unit 48 starts measuring the delivery standby time.

[0104] When an input to prohibit distribution is received at time t4, which is before time t3 at which the distribution standby time T2 has elapsed, the control unit 48 stops timing the distribution standby time. Therefore, in the example of Fig. 9C, an image including the subject TR1 is not distributed to the mobile terminal MT1, and it is possible to prevent the image from being distributed even when there is no abnormality in the subject TR1.

[0105] Next, an example shown in Fig. 9(D) will be described. In Fig. 9(D), it is assumed that the control unit 48 determines that an abnormality has occurred in the subject TR1 at time t1. In this case, the control unit 48 starts counting the image capture standby time at time t1.

[0106] When the image capture standby time T1 has elapsed at time t2, the image capture unit 21 or 41 starts capturing an image including the target person TR1, and the control unit 48 starts measuring the delivery standby time.

[0107] When the delivery waiting time T2 has elapsed at time t3, the control unit 48 starts delivering the image. In the example of Fig. 9D, after time t3, an image including the target person TR1 is delivered to the mobile terminal MT1.

[0108] As described above in detail, according to the first embodiment, the monitoring system 100 includes a sensor 10 that acquires data regarding the state of the subject TR1, a parent camera 40 and a child camera 20 that start capturing an image including the subject TR1 when the state of the subject TR1 is a predetermined state (a state in which an abnormality has occurred in the subject TR1), and a control unit 48 and a control unit 28 that make the parent camera 40 and the child camera 20 unable to capture an image of the subject TR1 until the state of the subject TR1 reaches the predetermined state. As a result, the subject TR1 is not captured under normal circumstances, and the privacy of the subject TR1 can be protected.

[0109] In the first embodiment, the parent camera 40 and the child camera 20 have different appearances when they are unable to capture an image of the subject TR1 and when they are able to capture an image of the subject TR1 (see FIGS. 4A to 4D). This allows the subject TR1 to determine whether the parent camera 40 and the child camera 20 are capturing an image by checking the appearance of the parent camera 40 and the child camera 20.

[0110] Furthermore, in the first embodiment, when parent camera 40 and child camera 20 are unable to capture an image of subject TR1, the lenses of parent camera 40 and child camera 20 are in a state where they are not visible to subject TR1. For example, control unit 48 keeps lens 421 of parent camera 40 covered with cover 422 until subject TR1 reaches a predetermined state (until an abnormality occurs in subject TR1). This prevents subject TR1 from feeling like he or she is being "surveilled."

[0111] As described above, until the state of the subject TR1 reaches a predetermined state, the control units 48 and 28 may change the imaging directions of the parent camera 40 and the child camera 20 to a direction different from the direction in which the preset imaging range exists. This also prevents the subject TR1 from feeling that he or she is being "surveilled."

[0112] In the first embodiment, the sensor 10 acquires data other than the visible light image as data relating to the condition of the subject TR1, thereby making it possible to determine whether or not an abnormality has occurred in the subject TR1 while protecting the privacy of the subject TR1.

[0113] Furthermore, in the first embodiment, the control unit 48 causes the image capture unit 21 or 41 to start capturing an image including the subject TR1 when an image capture standby time (first predetermined time) has elapsed since the state of the subject TR1 estimated from data acquired by the sensor 10, which acquires data regarding the state of the subject TR1, becomes a predetermined state (a state in which an abnormality occurs in the subject TR1). Because there is a time lag between when it is determined that an abnormality occurs in the subject TR1 and when image capture begins, measures can be taken to protect the privacy of the subject TR1 even if no abnormality actually occurs in the subject TR1. Therefore, the privacy of the subject TR1 can be better protected compared to when image capture begins immediately after it is determined that an abnormality occurs in the subject TR1.

[0114] Furthermore, in the first embodiment, when the control unit 48 receives an input to prohibit (cancel) image capture during the image capture standby time, the control unit 48 does not perform processing to cause the image capture unit 21 or 41 to capture an image. This makes it possible to prohibit the image capture unit 21 or 41 from capturing an image including the subject TR1 when, for example, no abnormality is actually occurring in the subject TR1, thereby protecting the privacy of the subject TR1.

[0115] Furthermore, in the first embodiment, when the control unit 48 receives an input prohibiting image capture, it transmits a predetermined message (for example, a message informing the mobile terminal (external device) MT1 that the abnormality was a false detection or that no abnormality has occurred) to the mobile terminal MT1, thereby enabling the person OB1 carrying the mobile terminal MT1 (the person watching over the subject TR1) to know that the subject TR1 is safe.

[0116] Furthermore, in the first embodiment, if it is determined that an abnormality has occurred in the subject TR1, the control unit 48 notifies the subject TR1 of the start of imaging. Specifically, in the first embodiment, the control unit 48 notifies the subject TR1 of the timing at which imaging will begin. This allows the subject TR1 to know the timing at which imaging will begin, and if no abnormality has occurred in the subject TR1, the subject TR1 can take necessary measures to protect his or her privacy (e.g., prohibiting imaging or moving out of the imaging range). This protects the subject TR1's privacy better than when no notification of imaging commences. Note that in the above embodiment, notification is provided via the speaker 43 of the parent camera 40 or the speaker 23 of the child camera 20, but this is not limited thereto. For example, the remote controller 30 may be provided with a speaker, and the notification may be provided via the speaker of the remote controller 30. Furthermore, the remote controller 30 may be provided with a display, and the notification may be displayed on the display.

[0117] Furthermore, in the first embodiment, when the estimated state of the subject TR1 becomes a predetermined state (a state in which an abnormality has occurred in the subject TR1), the control unit 48 transmits a notification regarding the subject TR1 to the mobile terminal MT1. Specifically, a message notifying the mobile terminal MT1 that an abnormality may have occurred in the subject TR1 is transmitted to the mobile terminal MT1. This allows the person OB1 carrying the mobile terminal MT1 to know that an abnormality has occurred in the subject TR1, and can take action such as calling the subject TR1 or visiting the subject TR1.

[0118] Furthermore, in the first embodiment, when an image capturing request is received from the portable terminal MT1 within the image capturing standby time, the control unit 48 causes the image capturing unit 21 or the image capturing unit 41 to start capturing images before the image capturing standby time elapses. This allows an image of the subject TR1 to be stored in response to a request from the watcher OB1 carrying the portable terminal MT1. Note that when the image capturing unit 21 or the image capturing unit 41 is caused to start capturing images, the subject TR1 may be notified that image capturing will begin.

[0119] Furthermore, in the first embodiment, the control unit 48 distributes the image captured by the imaging unit 21 or 41 when the distribution standby time (second predetermined time) has elapsed since the imaging unit 21 or 41 started capturing images. Because there is a time lag between the start of capturing images and the distribution of the images, if no abnormality occurs with the subject TR1, the subject TR1 can take necessary action during the distribution standby time. This protects the privacy of the subject TR1 compared to when image distribution begins immediately after the imaging unit 21 or 41 starts capturing images. Furthermore, if an abnormality occurs with the subject TR1, the image captured by the imaging unit 21 or 41 is distributed after the distribution time has elapsed, allowing the person OB1 carrying the mobile terminal MT1 to check the condition of the subject TR1 through the image.

[0120] Furthermore, in the first embodiment, if an input to prohibit (cancel) distribution is received within the distribution standby time (second predetermined time), the control unit 48 stops timing the distribution standby time. This prevents the distribution of images captured by the imaging unit 21 or 41, thereby preventing a situation in which the privacy of the subject TR1 is violated by the distribution of images when there is no abnormality in the subject TR1.

[0121] Furthermore, in the first embodiment, the control unit 48 notifies the subject TR1 of the image distribution before the image distribution process, so that the subject TR1 can know that the image will be distributed and can take necessary action to protect his or her privacy.

[0122] Furthermore, in the first embodiment, the control unit 48 notifies the subject TR1 of the start of imaging of an image including the subject TR1 when the state of the subject TR1 estimated from the data acquired by the sensor 10 that acquires data on the state of the subject TR1 becomes a predetermined state (a state in which an abnormality has occurred in the subject TR1). This allows the subject TR1 to know that imaging will begin, and therefore, if no abnormality has occurred in the subject TR1, it is possible to take action necessary to protect the privacy of the subject TR1.

[0123] Furthermore, in the first embodiment, when an image capture standby time (first predetermined time) has elapsed since the state of the subject TR1 has become a predetermined state, the control unit 48 causes the image capture unit 41 or the image capture unit 21 to start capturing an image, and notifies the control unit 48 of the timing to start capturing an image during the image capture standby time. As a result, for example, if no abnormality has occurred in the subject TR1, the subject TR1 can take any action necessary to protect the privacy of the subject TR1 by the time the image capture starts.

[0124] As described above, the control unit 48 may notify that the current time is within the image capture standby time or that image capture has not yet been started by the image capture unit 21 or 41. Even with such a notification, if, for example, no abnormality has occurred in the subject TR1, the subject TR1 can take the action required to protect the privacy of the subject TR1.

[0125] Furthermore, the control unit 48 may notify the subject TR1 of the time until imaging starts. Even with such notification, if, for example, no abnormality occurs in the subject TR1, the subject TR1 can take necessary action to protect the privacy of the subject TR1.

[0126] Furthermore, the control unit 48 may notify the subject TR1 that the current time is a period during which imaging can be prohibited. This allows the subject TR1 to take the action required to prohibit imaging, for example, if no abnormality occurs in the subject TR1.

[0127] Furthermore, in the first embodiment, the control unit 48 starts distributing the images captured by the imaging unit 21 or 41 after the imaging unit 21 or 41 starts capturing images, and notifies the subject TR1 about the image distribution before starting the image distribution. This allows the subject TR1 to know that image distribution will start, and therefore, if no abnormality has occurred in the subject TR1, the subject TR1 can take any action necessary to protect the privacy of the subject TR1.

[0128] Furthermore, in the first embodiment, when the delivery standby time has elapsed since the imaging unit 21 or 41 started capturing an image including the subject TR1, the control unit 48 starts delivering the captured image, and notifies the control unit 48 of the timing to start the delivery during the delivery standby time. As a result, for example, if no abnormality has occurred in the subject TR1, the subject TR1 can take any action necessary to protect the privacy of the subject TR1 by the time the delivery of the image starts.

[0129] The control unit 48 may notify the user of the time remaining until the start of distribution. Even with such notification, if no abnormality is found in the subject TR1, the subject TR1 can take necessary action to protect the privacy of the subject TR1.

[0130] Furthermore, the control unit 48 may notify the subject TR1 that the current time is a period during which distribution can be prohibited (cancelled). This allows the subject TR1 to know that distribution can be prohibited and to take necessary action to protect the privacy of the subject TR1.

[0131] Furthermore, in the first embodiment, if the control unit 48 receives an input to prohibit image capture within the image capture standby time, the control unit 48 does not perform processing to start image capture. Receiving an input to prohibit image capture means that the subject TR1 is in a state where an input to prohibit image capture can be made, that is, a state in which no abnormality is occurring. Therefore, by not performing processing to start image capture when an input to prohibit image capture is received within the image capture standby time, the privacy of the subject TR1, who is likely not experiencing any abnormality, can be protected.

[0132] Furthermore, in the first embodiment, if the control unit 48 receives an input to prohibit distribution within the distribution waiting time, the control unit 48 does not perform the process to start image distribution. Receiving the input to prohibit distribution is considered to mean that the subject TR1 is in a state where the input to prohibit distribution can be made, that is, a state where no abnormality is occurring. Therefore, by not performing the process to start image distribution when the input to prohibit distribution is received, the privacy of the subject TR1, who is likely to be free of any abnormality, can be protected.

[0133] Second Embodiment In the first embodiment, it was determined whether or not the state of the subject TR1 estimated based on the data acquired from the sensor 10 was a predetermined state (a state in which an abnormality occurred in the subject TR1). In the first embodiment, if the determination was incorrect and the subject TR1 did not notice the notification regarding imaging or the notification regarding distribution and did not make any input to prohibit imaging or distribution, the image would be captured and distributed, and the privacy of the subject TR1 might not be protected.

[0134] Therefore, in the second embodiment, whether or not the determination that "an abnormality has occurred in the subject" based on the data acquired from the sensor 10 is correct is determined based on the image captured by the imaging unit 21 or 41. Specifically, the state of the subject TR1 is estimated based on the image captured by the imaging unit 21 or 41, and if the estimated state of the subject TR1 is a predetermined state (a state in which an abnormality has occurred in the subject TR1), the determination of the abnormality based on the data acquired from the sensor 10 is determined to be correct, and timing of the delivery standby time is started. This is because, in general, the amount of information obtained from the image captured by the imaging unit 21 or 41 is greater than the amount of information obtained from the data acquired by the sensor 10, and therefore, the state of the subject TR1 estimated from the image captured by the imaging unit 21 or 41 is considered to be more accurately estimated than the state of the subject TR1 estimated from the data acquired by the sensor 10.

[0135] In the second embodiment, the processes executed by the control units 28 and 48 are different from those in the first embodiment. The configurations of the monitoring system 100, the parent camera 40, and the child camera 20 are the same as those in the first embodiment, and therefore detailed description thereof will be omitted.

[0136] Fig. 10 is a flowchart showing an example of processing executed by the control unit 48 of the parent camera 40 in the monitoring system 100 according to the second embodiment. The processing in Fig. 10 differs from the processing in Fig. 5 in the processing (step S50: third processing) executed when the camera identified in step S14 is the parent camera 40 (step S15 / YES), and the processing (step S60: fourth processing) executed when the camera identified in step S14 is the child camera 20 (step S15 / NO).

[0137] 11 and 12 are flowcharts showing the details of the third process. In Fig. 11, the processes of steps S201 to S213 and steps S225 and S227 are the same as those of the first process shown in Fig. 6, so the same reference numerals are used and detailed description will be omitted.

[0138] In the third process, when the imaging unit 41 starts capturing images (step S213), the control unit 48 estimates the state of the subject TR1 based on the image (visible light image) captured by the imaging unit 41 (step S501). Next, the control unit 48 determines whether the estimated state of the subject TR1 is a predetermined state (a state in which an abnormality has occurred in the subject TR1) (step S503). For example, the control unit 48 performs pattern matching between the image captured by the imaging unit 41 and a pre-registered image used for determining an abnormality, and determines whether an abnormality has occurred in the subject TR1.

[0139] If no abnormality has occurred in the subject TR1 (step S503 / NO), the control unit 48 transmits a predetermined message to the mobile terminal MT1 (step S507). For example, the control unit 48 transmits a message notifying that the determination in step S13 of Fig. 10 was incorrect (misjudgment / misdetection) or that there is no abnormality in the subject TR1.

[0140] Next, the control unit 48 stops the imaging unit 41 from capturing an image (step S509), and drives the drive device 49 to move the cover 422 so that the cover 422 covers the lens 421 (step S511). Note that the order of the processes of steps S507 to S511 may be reversed. After step S511, the process returns to step S11 in FIG. 10.

[0141] If it is determined that an abnormality has occurred in the subject TR1 (step S503 / YES), the control unit 48 stores the image used to estimate the condition of the subject TR1 in the storage unit 44 (step S505). This allows the person OB1 watching over the subject TR1 to later check and verify the image used to determine whether or not an abnormality has occurred in the subject TR1. Note that the image used to determine whether or not an abnormality has occurred in the subject TR1 may be distributed to the mobile terminal MT1 after the distribution time has elapsed.

[0142] The processing from step S215 onward in FIG. 12 is similar to the processing from step S215 onward in the first processing shown in FIG. 6, so the same reference numerals are used and detailed description thereof will be omitted.

[0143] Next, details of the fourth process will be described. Fig. 13 is a flowchart showing details of the fourth process. Fig. 14 is a flowchart showing an example of processing executed by the control unit 28 of the slave camera 20 in the monitoring system 100 according to the second embodiment. The fourth process will be described together with the processing executed by the control unit 28 of the slave camera 20.

[0144] In the fourth process shown in FIG. 13, steps S301 to S313 and steps S325 and S327 are similar to those in the second process shown in FIG. 7, and therefore are given the same reference numerals and will not be described in detail.

[0145] Furthermore, in the processing executed by the control unit 28 of the slave camera 20 shown in Figure 14, the processing of steps S401 to S407 and steps S421 and S423 is the same as the processing shown in Figure 8, so the same symbols are used and detailed explanations are omitted.

[0146] 14 , when control unit 28 of slave camera 20 causes image capture unit 21 to start capturing an image including subject TR1 (step S407), control unit 28 estimates the state of subject TR1 (step S451) based on the image (visible light image) captured by image capture unit 21. Next, control unit 28 determines whether the estimated state of subject TR1 is a predetermined state (a state in which an abnormality has occurred in subject TR1) (step S453).

[0147] If no abnormality has occurred in the subject TR1 (step S453 / NO), the control unit 28 stops capturing images by the imaging unit 21 (step S461) and covers the lens of the slave camera 20 (step S463). Next, the control unit 28 transmits the estimated result of the condition of the subject TR1 to the master camera 40 (step S465), and ends the processing of Fig. 14. In step S465, the estimated result that no abnormality has occurred in the subject TR1 is transmitted to the master camera 40.

[0148] On the other hand, if an abnormality has occurred in the subject TR1 (step S453 / YES), the control unit 28 stores the image used to estimate the condition of the subject TR1 in the storage unit 24 (step S455). This allows the person OB1 watching over the subject TR1 to later check and verify the image used to determine whether or not an abnormality has occurred in the subject TR1. Note that the image used to determine whether or not an abnormality has occurred in the subject TR1 may be distributed to the mobile terminal MT1 after the distribution time has elapsed.

[0149] Next, the control unit 28 transmits the estimated result of the state of the subject TR1 to the parent camera 40 (step S457), and waits until a notification instruction regarding distribution is received (step S409). In step S457, the estimated result that an abnormality has occurred in the subject TR1 is transmitted to the parent camera 40.

[0150] The processes from step S409 onwards are the same as those shown in FIG. 8, so the same reference numerals are used and detailed description will be omitted.

[0151] Meanwhile, after transmitting an image capturing instruction to the slave camera 20 (FIG. 13: step S313), the control unit 48 of the master camera 40 waits until it receives an estimated result of the state of the subject TR1 based on the visible light image from the slave camera 20 (step S601 / NO).

[0152] When the estimation result is received (step S601 / YES), the control unit 48 determines whether the estimation result indicates that an abnormality has occurred in the subject TR1 (step S602).

[0153] If no abnormality has occurred in the subject TR1 (step S602 / NO), the control unit 48 transmits a predetermined message to the mobile terminal MT1 (step S603). For example, the control unit 48 transmits a message notifying that the determination in step S13 of Fig. 10 was incorrect (misjudgment / misdetection) or that there is no abnormality in the subject TR1.

[0154] If an abnormality occurs in the target person TR1 (step S602 / YES), the control unit 48 starts timing the delivery waiting time (step S315). Since the processing from step S315 onwards is the same as the second processing shown in Fig. 7, the same reference numerals are used and detailed description will be omitted.

[0155] 15(A) and 15(B) are time charts showing an example of processing executed in the monitoring system 100 according to the second embodiment.

[0156] First, the example of Fig. 15A will be described. In Fig. 15A, it is assumed that at time t1, the control unit 48 determines that an abnormality has occurred in the subject TR1 based on data acquired from the sensor 10.

[0157] In this case, the control unit 48 starts measuring the image capture standby time from time t1. When the image capture standby time T1 has elapsed at time t2, the image capture unit 21 or 41 starts capturing an image including the subject TR1.

[0158] At time t3, when the control unit 28 or 48 determines based on the captured image that no abnormality has occurred in the subject TR1, it stops capturing images by the imaging unit 21 or 41. This makes it possible to prevent images from being captured and distributed even when no abnormality has occurred in the subject TR1.

[0159] Next, an example of Fig. 15(B) will be described. In Fig. 15(B), it is assumed that at time t1, the control unit 48 determines that an abnormality has occurred in the subject TR1 based on data acquired from the sensor 10.

[0160] In this case, the control unit 48 starts measuring the image capture standby time from time t1. When the image capture standby time T1 has elapsed at time t2, the image capture unit 21 or 41 starts capturing an image including the subject TR1.

[0161] At time t3, when the control unit 28 or 48 determines that an abnormality has occurred in the subject TR1 based on the captured image, the control unit 48 starts counting the delivery waiting time.

[0162] When the delivery waiting time T2 has elapsed at time t4, the control unit 48 starts delivering the image. This allows delivery of the image when there is a high possibility that an abnormality has occurred in the subject TR1.

[0163] As described above in detail, according to the second embodiment, when the state of subject TR1 estimated from data acquired by sensor 10, which acquires data related to the state of the subject, is a predetermined state (a state in which an abnormality has occurred in subject TR1), control unit 48 causes image capture unit 21 or 41 to start capturing an image including subject TR1, and estimates (detects) the state of subject TR1 based on the image captured by image capture unit 21 or 41. This makes it possible to confirm whether the state of subject TR1 estimated from the data acquired by sensor 10 is correct.

[0164] Furthermore, in the second embodiment, the control unit 48 continues capturing images when the state of the subject TR1 estimated (detected) based on the image captured by the imaging unit 21 or 41 is a predetermined state (a state in which an abnormality has occurred in the subject TR1). This makes it possible to record an image of the subject TR1 in which an abnormality has occurred.

[0165] When image capture is continued, the control unit 28 or 48 may notify the subject TR1 of information related to image capture. For example, the control unit 28 or 48 may notify the subject TR1 of the timing at which recording of the captured images in the storage unit 24 or 44 will begin. This allows the subject TR1 to know that the captured images will be recorded.

[0166] Furthermore, the control unit 28 or 48 may notify the subject TR1 that an image is being captured, thereby allowing the subject TR1 to know that an image including the subject TR1 is being captured.

[0167] Furthermore, in the second embodiment, when the state of the subject TR1 estimated (detected) based on the image is a predetermined state (a state in which an abnormality has occurred in the subject TR1), the control unit 48 starts distribution of the image captured by the imaging unit 21 or 41. This allows the distribution of the image to be started when it is considered that there is a high possibility that an abnormality has occurred in the subject TR1.

[0168] Furthermore, in the second embodiment, when the state of the subject TR1 estimated based on the image is a predetermined state (a state in which an abnormality has occurred in the subject TR1), the control unit 28 or 48 stores the image used to estimate the state of the subject TR1. This allows the image in which it has been determined that an abnormality has occurred in the subject TR1 to be later confirmed and verified.

[0169] Furthermore, in the second embodiment, the control unit 48 starts distributing an image including the subject TR1 when a distribution standby time has elapsed since it was detected based on the image that the state of the subject TR1 is a predetermined state (a state in which an abnormality has occurred in the subject TR1). Because there is a time lag between when it is determined based on the image that an abnormality has occurred in the subject TR1 and when the image is distributed, if no abnormality has occurred in the subject TR1, the subject TR1 can take necessary action to protect the privacy of the subject TR1 during the distribution standby time.

[0170] Furthermore, in the second embodiment, the control unit 48 notifies the subject TR1 of information regarding image distribution before the image distribution process starts, thereby enabling the subject TR1 to take necessary actions to protect the privacy of the subject TR1 before the image distribution process starts.

[0171] Furthermore, in the second embodiment, the control unit 28 or 48 stops capturing images when the state of the subject TR1 detected based on the image is not a predetermined state (a state in which an abnormality has occurred in the subject TR1). That is, when it is determined based on the image that no abnormality has occurred in the subject TR1, the control unit 28 or 48 stops capturing images. This makes it possible to prevent a situation in which capturing images including the subject TR1 continues even though no abnormality has occurred in the subject TR1, thereby violating the privacy of the subject TR1.

[0172] Furthermore, in the second embodiment, if the state of the subject TR1 detected based on the image is not a predetermined state (if no abnormality has occurred in the subject TR1), the control unit 48 transmits a predetermined message (for example, a message informing the mobile terminal MT1 that the abnormality was a false detection) to the mobile terminal MT1, thereby allowing the person carrying the mobile terminal MT1 (the person watching over the subject TR1) to know that the subject TR1 is safe.

[0173] In the second embodiment, when the imaging unit 21 or 41 starts imaging, the image captured by the imaging unit 21 or 41 may be stored in the storage unit 24 or 44. In this case, when the state of the subject TR1 detected based on the image is not a predetermined state (a state in which an abnormality has occurred in the subject TR1), the control unit 28 or 48 may delete the image (including the image used to detect the state of the subject TR1) stored in the storage unit 24 or 44. This makes it possible to protect the privacy of the subject TR1.

[0174] In the first and second embodiments, either the image capture waiting time or the distribution waiting time may be omitted. In this case, the subject TR1 may be allowed to input either an input to prohibit image capture or an input to prohibit distribution.

[0175] In the first and second embodiments, there may be a plurality of mobile terminals that deliver messages and images.

[0176] Third Embodiment In the first and second embodiments, an example of delivering an image to one mobile terminal MT1 has been described. However, if there are multiple people watching over the target person TR1, the timing of delivering the image may be changed depending on the type (attributes) of the people watching over the target person TR1.

[0177] The monitoring system 100 according to the third embodiment differs from the first and second embodiments in the processing executed by the control unit 48 and the control unit 28. Also, the monitoring system 100 according to the third embodiment differs from the first and second embodiments in that a broadcaster list is stored in the memory unit 44 of the parent camera 40.

[0178] FIG. 16 is a diagram showing an example of a distributor list. The distributor list includes fields for ID, name, communication information, and group. The ID field stores an identifier for uniquely identifying the person watching over the subject TR1. The name field stores the name of the person watching over the subject TR1. The communication information stores information necessary for directly transmitting images from the parent camera 40 to the mobile terminal (e.g., IP information of the mobile terminal). The group is used to classify people identified by the ID, and in this embodiment, one of groups 1 to 3 is stored. Here, group 1 indicates, for example, the family of the subject TR1, group 2 indicates, for example, the relatives of the subject TR1, and group 3 indicates, for example, the caregivers or care managers of the subject TR1.

[0179] In the third embodiment, the control unit 48 changes the timing and content of image distribution depending on the group. In this embodiment, images are distributed to groups 1 and 2, but images are not distributed to group 3.

[0180] Fig. 17 is a flowchart showing an example of processing executed by the control unit 48 of the parent camera 40 in the monitoring system 100 according to the third embodiment. The processing in Fig. 17 differs from the processing in Figs. 5 and 10 in processing (step S70: fifth processing) executed when the camera identified in step S14 is the parent camera 40 (step S15 / YES), and processing (step S80: sixth processing) executed when the camera identified in step S14 is the child camera 20 (step S15 / NO).

[0181] Fig. 18 is a flowchart showing the details of the fifth process. In Fig. 18, the processes of steps S201 to S213 and steps S225 and S227 are the same as those of the first process shown in Fig. 6, so the same reference numerals are used and detailed description will be omitted.

[0182] 18 , when capturing of an image including the subject TR1 starts (step S213), the control unit 48 starts distributing the image captured by the imaging unit 41 to the mobile terminal of a person belonging to group 1 (first group) (for example, the person with ID "OB1" in FIG. 16 ) (step S701). This allows the person belonging to group 1 to quickly check the condition of the subject TR1 through the image.

[0183] Next, the control unit 48 starts measuring the delivery waiting time (step S703).

[0184] The control unit 48 notifies the subject TR1 of the timing when the image captured by the imaging unit 41 will be distributed to a person (the person with ID "OB2" in FIG. 16 ) who belongs to a group other than group 1 and to which the image will be distributed (step S705). For example, the control unit 48 causes the speaker 43 to output a sound such as "Distribution of images to people belonging to group 2 will begin in 5 seconds." This allows the subject TR1 to know that distribution of images captured by the imaging unit 41 will begin to people belonging to group 2.

[0185] Next, the control unit 48 determines whether or not an input to prohibit (cancel) the distribution of the image has been accepted (step S707).

[0186] When an input prohibiting image distribution is received (step S707 / YES), the control unit 48 stops timing the distribution standby time and stops image capture by the image capture unit 41 (step S713). This prevents images captured by the image capture unit 41 from being distributed to people belonging to groups other than group 1. Note that, since image capture by the image capture unit 41 is stopped, image distribution to people belonging to group 1 is also stopped. Note that at this time, the control unit 48 may send a message to people belonging to each group informing them that the determination in step S13 was incorrect or that no abnormality has occurred in the target person TR1.

[0187] Thereafter, the control unit 48 covers the lens 421 of the parent camera 40 with the cover 422 (step S715), and returns to step S11 in FIG.

[0188] If the control unit 48 has not received an input prohibiting image distribution (step S707 / NO), the control unit 48 determines whether the distribution waiting time has elapsed (step S709). Specifically, the control unit 48 determines whether the distribution waiting time has elapsed since the start of counting the distribution waiting time in step S703. If the distribution waiting time has not elapsed (step S709 / NO), the process returns to step S707.

[0189] If the delivery wait time has elapsed (step S709 / YES), the control unit 48 starts delivering images to the mobile devices of the people belonging to group 2 (second group) and notifies the mobile devices of the people belonging to group 3 that, for example, delivery of images to group 2 has started (step S711). This allows the people belonging to group 2 to check the condition of the subject TR1 through the images. Furthermore, the fact that delivery of images to group 2 has started means that there is a high possibility that something is wrong with the subject TR1. The people belonging to group 3 can be informed by the notification that there is a high possibility that something is wrong with the subject TR1, and can take action, for example, by visiting the subject TR1.

[0190] Next, the sixth process will be described in detail. Fig. 19 is a flowchart showing the sixth process in detail. Fig. 20 is a flowchart showing an example of the process executed by the control unit 28 of the slave camera 20 in the monitoring system 100 according to the third embodiment. The sixth process will be described together with the process executed by the control unit 28 of the slave camera 20.

[0191] In FIG. 19, the processes of steps S301 to S313 and steps S325 and S327 are the same as those of the second process in FIG. 7, so they are denoted by the same reference numerals and detailed description thereof will be omitted.

[0192] In addition, in FIG. 20, the processes other than steps S471 and S473 are the same as the processes shown in FIG. 8, so they are denoted by the same reference numerals and detailed description thereof will be omitted.

[0193] 19, when control unit 48 of parent camera 40 transmits an image capture instruction to child camera 20 (step S313), control unit 48 starts distributing the image captured by imaging unit 21 of child camera 20 to the mobile terminal of a person belonging to group 1 (first group) (for example, the person with ID "OB1" in FIG. 16) (step S801). This allows the person belonging to group 1 to quickly check the condition of target person TR1 through the image.

[0194] Next, the control unit 48 starts measuring the delivery waiting time (step S803).

[0195] The control unit 48 instructs the slave camera 20 to notify the timing when the image captured by the imaging unit 21 will be distributed to a person (in Figure 16, the person with ID "OB2") who belongs to a group other than group 1 and to which the image will be distributed (step S805).

[0196] Meanwhile, the control unit 28 of the slave camera 20 causes the imaging unit 21 to start capturing an image including the subject TR1 (Figure 20: step S407), and then waits until it receives an instruction from the master camera 40 notifying it of the timing to start distributing the image (step S471 / NO).

[0197] Then, upon receiving an instruction from parent camera 40 to notify the timing of image distribution start (step S471 / YES), control unit 28 notifies the timing of distribution of the image captured by imaging unit 21 to a person (the person with ID "OB2" in FIG. 16 ) who belongs to a group other than group 1 and to which the image will be distributed (step S473). For example, control unit 28 causes speaker 23 to output a sound such as "Image distribution to people belonging to group 2 will begin in 5 seconds." This allows target person TR1 to know that distribution of the image captured by imaging unit 21 to people belonging to group 2 will begin.

[0198] The subsequent processing is the same as the processing shown in FIG. 8, and therefore a detailed description thereof will be omitted.

[0199] Meanwhile, the control unit 48 of the parent camera 40 determines whether or not a distribution prohibition instruction has been received from the child camera 20 (FIG. 19: step S807).

[0200] If a distribution prohibition instruction is received (step S807 / YES), the control unit 48 stops timing the distribution standby time (step S813). This prevents images captured by the imaging unit 21 from being distributed to people belonging to groups other than group 1. Since imaging by the imaging unit 21 is stopped, distribution of images to people belonging to group 1 is also stopped. At this time, the control unit 48 may send a message to people belonging to each group notifying them that the determination made in step S13 of FIG. 17 was incorrect or that no abnormality has occurred in the target person TR1. After processing step S813, the process returns to step S11 of FIG. 17.

[0201] If the distribution prohibition instruction has not been received (step S807 / NO), the control unit 48 determines whether the distribution waiting time has elapsed (step S809). Specifically, it determines whether the distribution waiting time has elapsed since the start of timing the distribution waiting time in step S803. If the distribution waiting time has not elapsed (step S809 / NO), the process returns to step S807.

[0202] If the delivery wait time has elapsed (step S809 / YES), the control unit 48 sends an instruction to the slave camera 20 to continue shooting (step S815), starts image delivery to the portable devices of the people belonging to group 2 (second group), and notifies the portable devices of the people belonging to group 3, for example, that image delivery to group 2 has started (step S817). This allows the people belonging to group 2 to check the condition of the subject TR1 through the images. Furthermore, the fact that image delivery to group 2 has started means that there is a high possibility that something is wrong with the subject TR1. The people belonging to group 3 can be notified by the notification that there is a high possibility that something is wrong with the subject TR1, and can take action, for example, by visiting the subject TR1.

[0203] 21 is a time chart showing an example of processing in the monitoring system 100 according to the third embodiment. In FIG. 21, it is assumed that at time t1, the control unit 48 determines that an abnormality has occurred in the subject TR1 based on data acquired from the sensor 10.

[0204] In this case, the control unit 48 starts timing the image capture standby time from time t1. When the image capture standby time T1 has elapsed at time t2, the image capture unit 21 or 41 starts capturing an image including the subject TR1. The control unit 48 also starts delivering the image to the mobile terminals of the people belonging to group 1, and starts timing the delivery standby time.

[0205] When the delivery waiting time T2 has elapsed at time t3, the control unit 48 starts delivering images to the portable devices of the people belonging to group 2, and sends a predetermined message to the portable devices of the people belonging to group 3. In this way, when there are multiple people watching over the target person TR1, by changing the timing of image delivery and the content of the notification according to the attributes of the target person TR1, it is possible to both watch over the target person TR1 and ensure the privacy of the target person TR1.

[0206] As described above in detail, according to the third embodiment, when the imaging unit 21 or 41 starts imaging, the control unit 48 starts distributing the images captured by the imaging unit 21 or 41 to people belonging to group 1, and when the distribution standby time has elapsed since the imaging unit 21 or 41 started imaging, the control unit 48 starts distributing the images captured by the imaging unit 21 or 41 to people belonging to group 2. This allows, for example, close relatives of the subject TR1 to know the condition of the subject TR1 from the images, and the privacy of the subject TR1 can be protected because the images are distributed to people other than close relatives after the distribution standby time has elapsed.

[0207] (Hardware Configuration) Fig. 22(A) is a diagram showing the hardware configuration of the control unit 48. As shown in Fig. 22(A), the control unit 48 includes a CPU 431, a ROM 432, a RAM 434, a storage unit 436, a network interface 437, etc. These components of the control unit 48 are connected to a bus 438. The functions of the control unit 48 are realized by the CPU 431 executing a program stored in the ROM 432 or the storage unit 436.

[0208] 22B is a diagram showing the hardware configuration of the control unit 28. The control unit 28 includes a CPU 231, a ROM 232, a RAM 234, a storage unit 236, a network interface 237, etc. These components of the control unit 28 are connected to a bus 238. The functions of the control unit 28 are realized by the CPU 231 executing a program stored in the ROM 232 or the storage unit 236.

[0209] In the first to third embodiments, the home system 150 includes one parent camera 40 and one or more child cameras 20, but the present invention is not limited to this. FIG. 23 is a diagram showing the configuration of a monitoring system 100A according to a modified example. As shown in FIG. 23, the home system 150A does not include the parent camera 40, and instead includes a sensor 10, a camera 80, a remote controller 30, and a control device 70 that controls the entire home system 150A. The camera 80 may have a configuration similar to that of the child camera 20 described above.

[0210] 24 is a functional block diagram showing the configuration of a control device 70 in a modified example. The control device 70 includes a storage unit 74, a first communication module 75, a second communication module 76, a third communication module 77, and a control unit 78. The first communication module 75, the second communication module 76, and the third communication module 77 are similar to the first communication module 45, the second communication module 46, and the third communication module 47, respectively, and therefore detailed description thereof will be omitted.

[0211] The storage unit 74 stores address information of a server required for communication with an external device (e.g., a service server SS) of the home system 150A, identification information of the camera 80, the past (e.g., the past month, etc.) operational status of the home system 150A, and past (e.g., the past month, etc.) detection results of the state of the subject TR1 by the sensor 10 and the camera 80 of the home system 150A. The operational status of the home system 150A includes events that have occurred in the home system 150A, such as system startup, system shutdown, and error occurrence.

[0212] The control unit 78 executes substantially the same processing as the control unit 48, but in this modified example, the processing of steps S15 and S20 in Fig. 5 is unnecessary. Also, the processing of Fig. 6 is unnecessary. Note that the hardware configuration of the control unit 78 is the same as that of the control unit 48, and therefore detailed description thereof will be omitted.

[0213] The home system 150 may include multiple parent cameras 40 and / or multiple child cameras 20. The child cameras 20 may be omitted from the home system 150. In this case, the number of parent cameras 40 may be one or multiple. The control units for the parent cameras 40 and the child cameras 20 may be provided separately from each other. The parent cameras 40 and the child cameras 20 may share a common control unit. That is, a single control unit may control the parent cameras 40 and the child cameras 20. In addition, when the child cameras 20 are omitted, a single control unit may control one or more parent cameras 40.

[0214] In the first to third embodiments, the sensor 10 does not have to be included in the monitoring system 100 (home system 150). In this case, for example, an existing sensor installed in the residence of the subject TR1 may be connected to the monitoring system 100, and data on the subject's condition may be acquired from the existing sensor.

[0215] Furthermore, in the above first to third embodiments, the sensor 10, the parent camera 40, and the child camera 20 were separate entities, but the sensor 10 and the parent camera 40 may be integrated, or the sensor 10 and the child camera 20 may be integrated.

[0216] In the first to third embodiments, the slave camera 20 and the master camera 40 may be provided with a filter that blocks visible light, and the control units 28 and 48 may control the filter to cover the lenses of the slave camera 20 and the master camera 40 when it is not possible to capture an image of the subject TR1, and to expose the lenses when it is possible to capture an image of the subject TR1. This makes it possible to use the slave camera 20 and the master camera 40 as the sensor 10.

[0217] Furthermore, in the first to third embodiments, the sensor 10 and the slave camera 20 do not have to be included in the monitoring system 100 (home system 150). In this case, for example, an existing sensor and an existing camera installed in the residence of the subject TR1 may be connected to the home system 150 to acquire data regarding the subject's condition from the existing sensor and acquire visible light images from the existing camera. In this case, the home system 150 may include a cover or the like that covers the lens of the existing camera, and the control unit 48 may place the existing camera in a state in which it is physically unable to capture an image of the subject TR1 (a state in which the cover covers the lens of the existing camera) until the state of the subject TR1 estimated from the data acquired by the existing sensor reaches a predetermined state.

[0218] Furthermore, in the above first to third embodiments, one of the slave camera 20 and the master camera 40 may be a camera that cannot be made unable to capture images of the subject TR1 under normal circumstances (for example, not having a cover 422).

[0219] In the first to third embodiments, the parent camera 40 may not include the imaging unit 21, the microphone 22, and the speaker 23. In this case, the parent camera 40 functions as a control device that controls the entire home system 150.

[0220] Furthermore, in the first to third embodiments, the condition of the subject TR1 is estimated based on data acquired by an infrared array sensor. However, this is not limiting. For example, if the sensor 10 is an infrared camera, a vector representing the subject TR1's movements may be acquired by comparing frame images from the infrared camera, and the condition of the subject TR1 may be estimated based on the feature quantities of the vector. Furthermore, instead of or in addition to an infrared camera, a thermograph may be used as the sensor 10. For example, the condition of the subject TR1 may be determined by combining the vector representing the movement of the subject TR1 detected by the infrared camera with changes in body temperature. Furthermore, for example, if the sensor 10 is a radio wave sensor, the condition of the subject TR1 may be determined to be normal if the measurable data for "heart rate," "respiratory rate," and "blood pressure" are comparable to normal data (previously measured data). However, if the difference from the normal data is equal to or greater than a threshold, an abnormality may be determined. Furthermore, if the sensor 10 is a depth sensor, the posture of the subject TR1 may be detected, and if daily behavior (standing, walking, sitting, sleeping) is detected, the subject TR1 may be determined to be normal. If abnormal behavior (falling, prolonged immobility) is detected, the subject TR1 may be determined to be abnormal. If the sensor 10 is a vibration sensor, the sensor may be determined to be abnormal if vibration exceeding a threshold is detected. If the sensor 10 is a sound sensor, the sensor may be determined to be abnormal if an impact sound exceeding a threshold is detected. If the sensor 10 is a wearable sensor, the subject TR1's condition may be determined to be normal if measurable data on "heart rate," "respiratory rate," and "blood pressure" are compared with normal data (previously measured data). If the difference from the normal data is equal to or greater than a threshold, the subject TR1 may be determined to be abnormal. Furthermore, for example, a line sensor may be used as the sensor 10.

[0221] Furthermore, in the first to third embodiments, the state of the subject TR1 may be estimated by combining different types of sensors 10. For example, the state of the subject TR1 may be estimated by combining a vibration sensor and a sound sensor.

[0222] Furthermore, in the first to third embodiments, the predetermined state was described as a state in which an abnormality occurred in the subject TR1, but this is not limited to this. For example, if the sensor 10 is a thermometer and a hygrometer, heatstroke is likely to occur when the measured temperature is equal to or higher than a predetermined value and the measured humidity is equal to or higher than a predetermined value. In this case, rather than determining whether or not the subject TR1 has heatstroke (whether or not an abnormality has occurred), a state in which the subject TR1 may have heatstroke (a state in which it is suspected that an abnormality has occurred in the subject TR1) may be set as the predetermined state, and timing of the image capture standby time may be started.

[0223] In the first to third embodiments, the input to prohibit image capture or distribution is received via the microphone 42 of the parent camera 40 or the microphone 22 of the child camera 20, but this is not limiting. For example, the remote controller 30 may be provided with a microphone, and the input to prohibit image capture may be received via the microphone.

[0224] Furthermore, in the first embodiment, the input for prohibiting (canceling) image capture or distribution is not limited to a predetermined voice, but may be, for example, a predetermined gesture, an operation on a predetermined device (remote controller 30, smartphone, etc.), etc. If the input for prohibiting (canceling) image capture is a predetermined gesture, and control unit 48 determines that an abnormality has occurred in subject TR1, it may cause parent camera 40 or child camera 20 to be in a state where it can capture image of subject TR1.

[0225] Furthermore, in the first to third embodiments, when image distribution has started, image capture and image distribution may be stopped, for example, when a predetermined operation is performed using the remote controller 30. For example, when the fallen subject TR1 recovers from the fallen state, the subject TR1 can instruct the master camera 40 to stop image capture and image distribution using the remote controller 30. Furthermore, when a person OB1 who is watching over the subject TR1 who has received a message or checked the distributed images visits the residence H1 of the subject TR1, the person OB1 who is watching over the subject TR1 can instruct the master camera 40 to stop image capture and image distribution using the remote controller 30. Furthermore, an instruction to stop image distribution may be transmitted from the mobile terminal MT1 of the person OB1 who is watching over the subject TR1.

[0226] In the first to third embodiments, while an image is being distributed, the fact that "distribution is in progress" may be continuously notified from a speaker or the like.

[0227] Furthermore, in the first to third embodiments, the control units 48 and 28 may not perform the above processing when the subject TR1 is asleep. For example, if the subject TR1 is asleep in bed at a predetermined time, the control units 48 and 28 may not perform the above processing. Whether the subject TR1 is asleep in bed can be detected, for example, by a weight sensor provided on the bed. This makes it possible to prevent the sleep of the subject TR1 from being determined to be abnormal.

[0228] Furthermore, in the first to third embodiments, if a predetermined voice such as "help me" is input during the standby time for image capture, image capture may be started without waiting for the standby time for image capture to elapse, and image distribution may also be started.

[0229] In addition, in the first to third embodiments, a part or all of the processes executed by the control unit 28 may be executed by the control unit 48. Furthermore, the second embodiment and the third embodiment may be combined as appropriate.

[0230] The above processing functions can be realized by a computer. In this case, a program is provided that describes the processing contents of the functions that a processing unit (CPU) should have. By executing the program on a computer, the above processing functions are realized on the computer. The program that describes the processing contents can be recorded on a computer-readable recording medium (excluding carrier waves).

[0231] When distributing a program, the program is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. Alternatively, the program can be stored in a storage device of a server computer and transferred from the server computer to other computers via a network.

[0232] A computer that executes a program stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. The computer then reads the program from its own storage device and executes processing in accordance with the program. Note that the computer can also read the program directly from a portable recording medium and execute processing in accordance with that program. The computer can also execute processing in accordance with the program received each time a program is transferred from the server computer.

[0233] The above-described embodiments are preferred examples of the present invention and can be combined as appropriate. However, the present invention is not limited to these and can be implemented in various modifications without departing from the spirit of the present invention.

[0234] REFERENCE SIGNS LIST 10 Sensor 20 Child camera 21 Imaging unit 28 Control unit 30 Remote controller 40 Parent camera 41 Imaging unit 48 Control unit 100 Monitoring system 150 Home system MT1 Mobile terminal

Claims

1. An acquisition unit that acquires data related to the state of a target person, An imaging unit that starts imaging an image including the target person when the state of the target person is a predetermined state, A control unit that sets the imaging direction of the imaging unit to a direction in which the target person is not included in the imaging range until the state of the target person becomes the predetermined state, A monitoring system comprising the above.

2. The control unit sets the imaging direction of the imaging unit to a direction in which the target person cannot visually recognize the lens of the imaging unit until the state of the target person becomes the predetermined state. The monitoring system according to Claim 1.

3. An acquisition unit that acquires data related to the state of a target person, A camera body comprising an imaging unit that starts imaging an image including the target person when the state of the target person is a predetermined state, A control unit that causes the camera body to wait at a location where the target person cannot visually recognize the imaging unit until the state of the target person becomes the predetermined state, A monitoring system comprising the above.

4. The data related to the state of the target person is data other than a visible light image. The monitoring system according to Claim 1 or Claim 3.

5. The acquisition unit includes at least one of a wearable sensor, an infrared sensor, a radio wave sensor, a depth sensor, a vibration sensor, a microphone, a temperature sensor, and a humidity sensor. The monitoring system according to Claim 1 or Claim 3.

6. The appearance of the imaging unit is different between a state where imaging of the target person is impossible and a state where imaging of the target person is possible. The monitoring system according to Claim 1 or Claim 3.

7. The predetermined state is a state in which an abnormality has occurred in the target person or a state in which it is presumed that an abnormality has occurred in the target person. The monitoring system according to Claim 1 or Claim 3.

8. A control device comprising a control unit that sets the imaging direction of an imaging unit that images an image including the target person to a direction in which the target person is not included in the imaging range until the state of the target person, determined based on the data acquired by the acquisition unit that acquires data related to the state of the target person, becomes a predetermined state.

9. A control device comprising a control unit that causes a camera body comprising an imaging unit that images an image including the target person to wait at a location where the target person cannot visually recognize the imaging unit until the state of the target person, determined based on the data acquired by the acquisition unit that acquires data related to the state of the target person, becomes a predetermined state.