Monitoring system, monitoring method, and program

Abstract

To provide a monitoring system capable of externally interfering with the imaging results of the imaging unit, a monitoring method, and a program.SOLUTION: A monitoring system 100 includes a sound acquisition unit 31, a sound storage unit 32, an imaging unit 11, a communication unit 13, and a sound output unit 33. The sound acquisition unit 31 acquires the voices of a user. The sound storage unit 32 stores the voices. The imaging unit 11 picks up images of the imaging target. The communication unit 13 is configured so as to communicate with an external device A1 and transmit the imaging results by the imaging unit 11 to the external device A1. The sound output unit 33 outputs the voice in response to the instruction output based on the imaging result by the external device A1.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure generally relates to a surveillance system, a surveillance method, and a program, and more particularly, to a surveillance system, a surveillance method, and a program that transmit an imaging result to an external device. [Background technology]

[0002] Patent Document 1 discloses a monitoring device that includes a human sensor, a recording and recording means, a storage means, a first communication means, and a control means. When the human sensor detects a person, the control means captures a facial image of the person using the recording and recording means. Next, the control means compares the facial image with face data for authentication stored in the storage means to authenticate the person, and when authentication is rejected, activates the recording and recording means to capture surrounding video and audio. The control means then transmits the video and audio to an external recording server and / or a mobile terminal using the first communication means. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-196562 A Summary of the Invention [Problem to be solved by the invention]

[0004] There has been proposed a monitoring system in which an imaging unit is installed indoors and the imaging results of the imaging unit are transmitted to an external device, such as the monitoring device of Patent Document 1. In such a monitoring system, there is a demand for interference with the imaging results of the imaging unit from the outside.

[0005] An object of the present disclosure is to provide a monitoring system, a monitoring method, and a program that allow interference with the imaging results of an imaging unit from outside. [Means for solving the problem]

[0006] A surveillance system according to an aspect of the present disclosure includes an audio acquisition unit, an audio storage unit, an imaging unit, a communication unit, and an audio output unit. The audio acquisition unit acquires a user's audio. The audio storage unit stores the audio. The imaging unit captures an image of an imaging target. The communication unit is configured to be able to communicate with an external device and transmits an imaging result of the imaging unit to the external device. The audio output unit outputs the audio in response to an output instruction from the external device based on the imaging result.

[0007] A monitoring method according to one aspect of the present disclosure includes an audio acquisition step, an audio storage step, an imaging step, a communication step, and an audio output step. In the audio acquisition step, a user's audio is acquired. In the audio storage step, the audio is stored. In the imaging step, an image of an imaging target is captured. In the communication step, the imaging result of the imaging step is transmitted to an external device. In the audio output step, the audio is output in response to an output instruction from the external device based on the imaging result.

[0008] A program according to one aspect of the present disclosure is a program for causing a computer system to execute the above-described monitoring method. Effect of the Invention

[0009] According to the present disclosure, there is an advantage that the imaging result of the imaging unit can be interfered with from outside. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a monitoring system according to this embodiment. [Diagram 2] FIG. 2 is an explanatory diagram illustrating imaging results and selection buttons that a display control unit of the monitoring system causes an external device to display. [Diagram 3] FIG. 3 is a flowchart showing the pre-storage steps in the above monitoring system. [Figure 4]FIG. 4 is a flowchart showing monitoring steps when a detection unit in the above monitoring system detects an image capture target. [Diagram 5] FIG. 5 is a flowchart showing monitoring steps performed when a user's operation requesting display of an imaging result in the above monitoring system is accepted. [Figure 6] FIG. 6 is an explanatory diagram illustrating imaging results and selection buttons that a display control unit of the monitoring system according to the above modified example causes an external device to display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] (Embodiment) (1) Overview An overview of a monitoring system 100 according to this embodiment will be described below with reference to FIGS.

[0012] The monitoring system 100 of this embodiment is a system that allows a user to check the imaging results of imaging target X1 (see FIG. 2) at a location away from the location where imaging target X1 exists. In other words, the monitoring system 100 of this embodiment is a system that allows a user to remotely check the imaging results of imaging target X1 and monitor the status of imaging target X1. The imaging target X1 of the present disclosure is a person other than the user (e.g., the user's child) or an animal (e.g., a pet kept by the user), etc. In short, the monitoring system 100 of this embodiment is a monitoring system that allows a user to remotely watch over imaging target X1 based on the imaging results of imaging target X1.

[0013] The surveillance system 100 according to this embodiment includes an audio acquisition unit 31, an audio storage unit 32, an imaging unit 11, a communication unit 13, and an audio output unit 33, as shown in FIG.

[0014] The voice acquisition unit 31 acquires the user's voice. The voice storage unit 32 stores the user's voice acquired by the voice acquisition unit 31. The imaging unit 11 captures an image of an imaging target X1. The communication unit 13 is configured to be able to communicate with an external device A1, and transmits the imaging results of the imaging unit 11 to the external device A1. The voice output unit 33 outputs the voice stored in the voice storage unit 32 in response to an output instruction from the external device A1 based on the imaging results of the imaging unit 11.

[0015] As described above, in the surveillance system 100 of this embodiment, the user can issue an output instruction to the audio output unit 33 via the external device A1 based on the imaging result of the imaging unit 11, and can cause the audio output unit 33 to output audio. In short, the surveillance system 100 of this embodiment has the advantage that the imaging result of the imaging unit 11 can be interfered with from outside.

[0016] (2) Detailed configuration (2-1) Surveillance system The detailed configuration of the monitoring system 100 of this embodiment will be described below with reference to FIGS.

[0017] The surveillance system 100 of this embodiment includes a camera device 1, a server 2, and an audio output device 3, as shown in FIG.

[0018] The surveillance system 100 is a system in which a user can remotely check the image capture results of an image capture target X1 (see FIG. 2) captured by a camera device 1 on a display unit A11 of an external device A1, and in response to an output instruction given by the user via an operation unit A12 of the external device A1, the user's voice that has been stored in advance can be output from an audio output device 3.

[0019] In the description of this embodiment, as an example, it is assumed that the surveillance system 100 is used when the user confirms on the display unit A11 of the external device A1 that the user's child, who is the subject X1, has returned home based on the image capture results captured by the camera device 1, and the user's voice that has been previously stored for the child is output from the audio output device 3.

[0020] The external device A1 is a terminal operated by a user. The external device A1 mainly comprises a computer having a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) and a memory. In the present disclosure, it is assumed that the external device A1 is a mobile terminal such as a smartphone or a tablet computer owned by the user. The external device A1 may be a wearable device such as a smart watch, or may be a laptop computer.

[0021] As shown in FIG. 1, the external device A1 includes a display unit A11, an operation unit A12, and a communication unit A13.

[0022] The display unit A11 displays information to the user. The display unit A11 is, for example, a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The operation unit A12 has a function of accepting user operations. In this embodiment, the external device A1 is equipped with a touch panel display, and the touch panel display functions as the display unit A11 and the operation unit A12. However, the operation unit A12 is not limited to a touch panel display, and may be, for example, a keyboard, a pointing device, or a mechanical switch.

[0023] The communication unit A13 is connected to the network NT1, thereby performing bidirectional communication with the server 2 via the network NT1. More specifically, the communication unit A13 performs bidirectional communication with a communication unit 22 of the server 2, which will be described later, via the network NT1. In the embodiment, the communication unit A13 is connected to the network NT1, for example, via a mobile phone network (carrier network) provided by a telecommunications carrier or a public wireless LAN (Local Area Network). The communication unit A13 may be connected to the network NT1 via a router or the like by wireless communication using radio waves as a medium. The "wireless communication" in the present disclosure refers to wireless communication such as Wi-Fi (registered trademark) and low-power wireless (specified low-power wireless) that does not require a license.

[0024] (2-2) Camera equipment The camera device 1 is a device having a function of capturing an image of an object X1. The camera device 1 of this embodiment is a device that captures an image of a user's child, who is the object X1, returning home. As an example, the camera device 1 is installed inside or around the user's house.

[0025] The camera device 1 includes an imaging unit 11, a detection unit 12, and a communication unit 13.

[0026] The imaging unit 11 captures an image of the imaging target X1. More specifically, the imaging unit 11 adjusts an imaging range, which is an imaging possible range, in advance, and captures an imaging range including the imaging target X1 when the imaging target X1 enters the imaging range. The imaging unit 11 of this embodiment acquires video data as an imaging result. Note that "video data" in this disclosure refers to data consisting of a plurality of still images obtained by stop motion photography or the like. The imaging unit 11 is composed of, for example, a camera having an imaging element and a lens. Specifically, the imaging unit 11 of this embodiment adjusts the imaging range so as to capture an image of the imaging target X1, the user's child, returning home.

[0027] The imaging unit 11 of this embodiment captures an imaging range including the imaging target X1 when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, or when control contents by a request control unit 211 described later are received from the communication unit 22 of the server 2. Note that when the imaging unit 11 receives control contents by the request control unit 211 from the communication unit 22 of the server 2, if the imaging target X1 is included in the imaging range, the imaging unit 11 captures an imaging range including the imaging target X1, and if the imaging target X1 is not included in the imaging range, the imaging unit 11 captures an imaging range not including the imaging target X1.

[0028] The detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11. As an example, the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 when it detects infrared rays emitted from the imaging target X1. Note that the detection unit 12 may detect that the imaging target X1 has entered the imaging range of the imaging unit 11 when it detects light, ultrasonic waves, or the like reflected by the imaging target X1. That is, the detection unit 12 may be a human presence sensor.

[0029] The communication unit 13 is configured to be able to communicate with a communication unit 22 (described later) of the server 2 via the network NT1. Since the communication unit 22 of the server 2 is configured to be able to communicate with the communication unit A13 of the external device A1, the communication unit 13 is configured to be able to communicate with the communication unit A13 of the external device A1 via the network NT1 and the communication unit 22 of the server 2. In this embodiment, the communication unit 13 is connected to the network NT1 via a router or the like, for example, by wireless communication. Note that the communication unit 13 may also be connected to the network NT1 by wired communication.

[0030] When the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. More specifically, when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the communication unit 13 transmits video data acquired by the imaging unit 11 as the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. When the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the communication unit 13 of this embodiment continues to transmit the video data acquired by the imaging unit 11 to the communication unit A13 of the external device A1 for a preset period.

[0031] Furthermore, even when the communication unit 13 receives control contents by the request control unit 211 (described later) from the communication unit 22 of the server 2, it transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. Even when the communication unit 13 receives control contents by the request control unit 211 from the communication unit 22 of the server 2, the communication unit 13 of the present embodiment continues to transmit video data acquired by the imaging unit 11 to the communication unit A13 of the external device A1 for a preset period.

[0032] (2-3) Server The server 2 controls the camera device 1, the external device A1, and the audio output device 3. As shown in Fig. 1, the server 2 includes a control unit 21 and a communication unit 22. The server 2 is installed outside the user's house.

[0033] The communication unit 22 is configured to be able to communicate with each of the communication unit 13 of the camera device 1, the communication unit A13 of the external device A1, and a communication unit 34 (described later) of the audio output device 3 via the network NT1. In this embodiment, the communication unit 22 is connected to the network NT1 via a router or the like, for example, by wireless communication. Note that the communication unit 22 may also be connected to the network NT1 by wired communication.

[0034] The control unit 21 includes a request control unit 211 , a display control unit 212 , and a sound control unit 213 .

[0035] The request control unit 211 controls the communication unit 13 of the camera device 1 to transmit the imaging result of the imaging unit 11 when the operation unit A12 of the external device A1 accepts a user's operation requesting display of the imaging result. More specifically, the request control unit 211 controls the camera device 1 to transmit the imaging result of the imaging unit 11 when the communication unit 22 receives a signal from the communication unit A13 indicating that the operation unit A12 of the external device A1 has accepted a user's operation requesting display of the imaging result. That is, in the camera device 1, when the operation unit A12 of the external device A1 accepts a user's operation requesting display of the imaging result, the imaging unit 11 captures an imaging target X1 that is within the imaging range, and the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. In this embodiment, the communication unit 22 transmits the control contents of the communication unit 13 by the request control unit 211 to the communication unit 13 of the camera device 1.

[0036] The display control unit 212 causes the display unit A11 of the external device A1 to display the imaging result of the imaging unit 11. That is, the display control unit 212 causes the display unit A11 of the external device A1 to display the video data acquired by the imaging unit 11 as the imaging result of the imaging unit 11. More specifically, the display control unit 212 controls the communication unit 22 to transmit the imaging result of the imaging unit 11 transmitted from the communication unit 13 of the camera device 1 to the communication unit A13 of the external device A1 as the imaging result of the imaging unit 11, and controls the display unit A11 of the external device A1 to display the video data acquired by the imaging unit 11 as the imaging result of the imaging unit 11. The display control unit 212 of this embodiment causes the display area R1 (see FIG. 2) on the display unit A11 of the external device A1 to display the video data acquired by the imaging unit 11 as the imaging result of the imaging unit 11.

[0037] The display control unit 212 of this embodiment causes the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11 when the imaging results of the imaging unit 11 are transmitted from the communication unit 13 of the camera device 1 to the communication unit A13 via the communication unit 22.

[0038] In this embodiment, as described above, when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the communication unit 13 of the camera device 1 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. For this reason, when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the display control unit 212 of this embodiment causes the display unit A11 of the external device A1 to display the imaging result of the imaging unit 11. This configuration has the advantage that the user can know the timing when the situation of the imaging target X1 has changed, and the user can check the situation of the imaging target X1 at the necessary timing.

[0039] Furthermore, in this embodiment, as described above, when the operation unit A12 of the external device A1 accepts an operation requesting display of the imaging results, the communication unit 13 of the camera device 1 transmits the imaging results of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. Therefore, when the operation unit A12 of the external device A1 accepts an operation requesting display of the imaging results, the display control unit 212 causes the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11. This configuration has the advantage that the user can check the status of the imaging target X1 at a timing desired by the user.

[0040] The display control unit 212 of this embodiment controls the display unit A11 of the external device A1 to display in real time the imaging results of the imaging unit 11 transmitted from the communication unit 13 of the camera device 1. In other words, the display control unit 212 of this embodiment controls the display unit A11 of the external device A1 to display in real time the current situation of the imaging target X1 being imaged while the imaging results of the imaging unit 11 are continuously transmitted from the communication unit 13 of the camera device 1.

[0041] The display control unit 212 further displays on the display unit A11 a selection button B1 (see FIG. 2) for receiving an output instruction from the user based on the imaging result of the imaging unit 11. The user issues an output instruction to the audio output unit 33 to output the user's voice by selecting the selection button B1 displayed on the display unit A11. The above configuration has the advantage that the user can easily issue an output instruction.

[0042] In this embodiment, the display control unit 212 displays a plurality of selection buttons B1 (four in the illustrated example). As shown in Fig. 2, as an example, the selection button B1a displays the word "Welcome home," and the selection button B1b displays the word "Snack." Similarly, the selection button B1c displays the word "Homework," and the selection button B1d displays the word "Hand washing."

[0043] In this embodiment, the display control unit 212 displays a plurality of selection buttons B1 in a display area R2 different from the display area R1 in which the imaging result of the imaging unit 11 is displayed, as shown in FIG. 2. The display area R2 in which the plurality of selection buttons B1 are displayed is located below the display area R1 in which the imaging result of the imaging unit 11 is displayed, in the display unit A11. That is, the plurality of selection buttons B1 are displayed below the display area R1 in which the imaging result of the imaging unit 11 is displayed, in the display unit A11. This configuration has the advantage that the user can easily select the selection button B1 while viewing the imaging result of the imaging unit 11. Note that the dashed line frame surrounding the display area R2 shown in FIG. 2 is a virtual frame illustrated for the purpose of explanation, and is not a frame that is actually displayed by the display unit A11.

[0044] Each of the four selection buttons B1 is associated one-to-one with a plurality of user voices stored in a voice storage unit 32 (described later) of the voice output device 3. As an example, the selection button B1a is associated with the user voice saying "Welcome home," and the selection button B1b is associated with the user voice saying "There's a snack here, so eat it." Similarly, the selection button B1c is associated with the user voice saying "Do your homework," and the selection button B1d is associated with the user voice saying "Wash your hands."

[0045] The voice control unit 213 controls the voice output unit 33 to output the user's voice stored in the voice storage unit 32 in response to the output instruction received by the selection button B1. That is, the voice output unit 33 outputs the user's voice stored in the voice storage unit 32 in response to the output instruction received by the selection button B1. In this embodiment, the communication unit 22 transmits the control content of the voice control unit 213 over the voice output unit 33 to a communication unit 34 of the voice output device 3, which will be described later.

[0046] (2-4) Audio output device The audio output device 3 is a device having a function of outputting the user's voice to the imaging target X1. The audio output device 3 of this embodiment is a device that outputs the user's voice to the imaging target X1, which is the user's child. As an example, the audio output device 3 is installed inside the user's house. Specifically, the audio output device 3 is a parent unit or a speaker of an intercom installed inside the user's house.

[0047] As shown in FIG. 1, the audio output device 3 includes an audio acquisition unit 31, an audio storage unit 32, an audio output unit 33, and a communication unit .

[0048] The voice acquisition unit 31 acquires the voice of the user. More specifically, the voice acquisition unit 31 records the words actually spoken by the user and acquires them as the user's voice. The voice acquisition unit 31 is, for example, configured with a microphone having a sound collection element. The voice storage unit 32 stores the voices of multiple users acquired by the voice acquisition unit 31. More specifically, the voice storage unit 32 stores the voices of multiple users acquired by the voice acquisition unit 31 in advance before the user issues an output instruction (i.e., before the user selects the selection button B1). For example, when the user installs the voice output device 3 indoors in the user's house or sets the voice output device 3, the user stores the voices of multiple users acquired by the voice acquisition unit 31 in the voice storage unit 32. The voice storage unit 32 is, for example, a storage device such as a magnetic core memory or a semiconductor memory. The voice storage unit 32 may also be an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0049] The voice storage unit 32 of this embodiment stores, as an example, four user voices: "Welcome home," "There's a snack here, so eat it," "Do your homework," and "Wash your hands."

[0050] The audio output unit 33 outputs the user's voice stored in the audio storage unit 32 based on the control content of the audio control unit 213. More specifically, the audio output unit 33 outputs the user's voice stored in the audio storage unit 32 based on the control content of the audio control unit 213 in response to an output instruction by the user based on the imaging result of the imaging unit 11.

[0051] In this embodiment, as described above, a plurality of selection buttons B1 are displayed on the display unit A11 (see FIG. 2). For this reason, the voice control unit 213 of the server 2 controls the voice output unit 33 to output the voice associated with the selection button B1 for which the output instruction by the user has been received, among the voices of the plurality of users stored in the voice storage unit 32. That is, the voice output unit 33 outputs the voice associated with the selection button B1 for which the output instruction by the user has been received, among the voices of the plurality of users stored in the voice storage unit 32. In other words, the voice output unit 33 outputs the voice associated with the selection button B1 selected by the user, among the voices of the plurality of users stored in the voice storage unit 32. This configuration has the advantage that the voice output unit 33 can output the appropriate user voice according to the situation of the imaging target X1.

[0052] Specifically, when the selection button B1a receives an output instruction from the user, the audio output unit 33 outputs the user's voice saying "Welcome home," and when the selection button B1b receives an output instruction from the user, the audio output unit 33 outputs the user's voice saying "There's a snack here, so eat it." Similarly, when the selection button B1c receives an output instruction from the user, the audio output unit 33 outputs the user's voice saying "Do your homework," and when the selection button B1d receives an output instruction from the user, the audio output unit 33 outputs the user's voice saying "Wash your hands."

[0053] In this embodiment, the audio control unit 213 controls the audio output unit 33 to output the user's audio stored in the audio storage unit 32 at the timing when an output instruction from the user is received from the external device A1. In short, the audio output unit 33 in this embodiment outputs the user's audio stored in the audio storage unit 32 at the timing when an output instruction from the user is received from the external device A1. This configuration has the advantage that the user can output an appropriate user's audio according to the real-time situation of the imaging target X1.

[0054] The communication unit 34 is configured to be able to communicate with the communication unit 22 of the server 2 via the network NT1. Since the communication unit 22 of the server 2 is configured to be able to communicate with the communication unit A13 of the external device A1, the communication unit 34 is configured to be able to communicate with the communication unit A13 of the external device A1 via the network NT1 and the communication unit 22 of the server 2. In this embodiment, the communication unit 34 is connected to the network NT1 via a router or the like, for example, by wireless communication. Note that the communication unit 34 may also be connected to the network NT1 by wired communication.

[0055] In this embodiment, the communication unit 34 receives control information for the audio output unit 33 from the audio control unit 213 of the server 2 and outputs the control information to the audio output unit 33 .

[0056] (3) Monitoring method In this embodiment, the monitoring method performed by the monitoring system 100 will be described with reference to the flowcharts of Figures 3 to 5. Note that the flowcharts of Figures 3 to 5 are merely examples of the monitoring method performed by the monitoring system 100 of this embodiment, and the order of the processes may be changed as appropriate, or any of the processes may be omitted as appropriate.

[0057] The monitoring method includes a pre-storage step and a monitoring step. The pre-storage step is a step of pre-storing the voices of multiple users acquired by the voice acquisition unit 31 before the user issues an output instruction (i.e., before the user selects the selection button B1). In short, the pre-storage step is a step of pre-storing the voices of multiple users acquired by the voice acquisition unit 31 before imaging the imaging target X1 and outputting the voices in response to an output instruction from the external device A1 based on the imaging result (before the monitoring step).

[0058] The monitoring step is a step of capturing an image of the imaging target X1 and outputting sound in response to an output instruction from the external device A1 based on the imaging result. As an example, the monitoring step will be described for a case where the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 and a case where a user operation requesting display of the imaging result is received.

[0059] (3-1) Pre-storage step As shown in FIG. 3, the pre-storing step includes a voice acquiring step ST11 and a voice storing step ST12.

[0060] In a voice acquisition step ST11, the voice acquisition unit 31 acquires the user's voice. More specifically, in the voice acquisition step ST11, the voice acquisition unit 31 records the words actually spoken by the user and acquires them as the user's voice. Then, in a voice storage step ST12, the voice storage unit 32 stores the voices of the multiple users acquired by the voice acquisition unit 31 in the voice acquisition step ST11.

[0061] (3-2) Monitoring step when the detection unit detects an imaging target The monitoring steps performed when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 include a detection step ST21, an imaging step ST22, a communication step ST23, a display control step ST24, an output instruction step ST25, and an audio output step ST26, as shown in FIG. 4.

[0062] In a detection step ST21, the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11. In the detection step ST21 of this embodiment, the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 when it detects infrared rays emitted from the imaging target X1. Thereafter, in an imaging step ST22, the imaging unit 11 images the imaging target X1. More specifically, in the imaging step ST22, the imaging target X1 is imaged when it enters the imaging range.

[0063] Then, in communication step ST23, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. In short, in communication step ST23, when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, the communication unit 13 continues to transmit video data acquired by the imaging unit 11 to the communication unit A13 of the external device A1 for a preset period.

[0064] In the display control step ST24, the display control unit 212 causes the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11. More specifically, in the display control step ST24, the display control unit 212 controls the communication unit 22 to transmit the imaging results of the imaging unit 11 transmitted from the communication unit 13 of the camera device 1 to the communication unit A13 of the external device A1, and controls the display unit A11 of the external device A1 to display video data acquired by the imaging unit 11 as the imaging result of the imaging unit 11. In the display control step ST24 of this embodiment, the display control unit 212 controls the display unit A11 of the external device A1 to display in real time the imaging results of the imaging unit 11 that are continuously transmitted from the communication unit 13 of the camera device 1.

[0065] Furthermore, in display control step ST24, the display control unit 212 further displays, on the display unit A11, a selection button B1 (see FIG. 2) for receiving an output instruction from a user based on the imaging result of the imaging unit 11. In this embodiment, in display control step ST24, the display control unit 212 displays the selection button B1 in a display area R2 different from the display area R1 in which the imaging result of the imaging unit 11 is displayed.

[0066] In the output instruction step ST25, the user selects a selection button B1 displayed on the display unit A11 to give an output instruction to the audio output unit 33 to output the user's voice, and the audio control unit 213 controls the audio output unit 33 to output the user's voice stored in the audio storage unit 32 in response to the output instruction received by the selection button B1. In the output instruction step ST25 of this embodiment, the audio control unit 213 controls the audio output unit 33 to output the voice associated with the selection button B1 for which an output instruction from the user has been received, among the voices of multiple users stored in the audio storage unit 32.

[0067] Then, in a voice output step ST26, the voice output unit 33 outputs the user's voice stored in the voice storage unit 32 based on the control contents of the voice control unit 213. More specifically, in the voice output step ST26 of this embodiment, the voice output unit 33 outputs the voice associated with the selection button B1 for which an output instruction from the user has been received, from among the voices of the multiple users stored in the voice storage unit 32.

[0068] (3-3) Monitoring step when a user operation requesting display of imaging results is received The monitoring steps performed when the operation unit A12 of the external device A1 receives a user's operation requesting display of the imaging result include a display request step ST31, an imaging step ST32, a communication step ST33, a display control step ST34, an output instruction step ST35, and an audio output step ST36, as shown in Fig. 5. The display control step ST34, the output instruction step ST35, and the audio output step ST36 are similar to the above-mentioned display control step ST24, the output instruction step ST25, and the audio output step ST26, and therefore detailed explanations thereof will be omitted.

[0069] In the display request step ST31, the user performs an operation to request display of the imaging result using the operation unit A12 of the external device A1, and the request control unit 211 controls the communication unit 13 of the camera device 1 to transmit the imaging result of the imaging unit 11 when the operation of the user is received from the communication unit A13 in the display request step ST31. More specifically, in the display request step ST31, the request control unit 211 controls the communication unit 13 of the camera device 1 to transmit the imaging result of the imaging unit 11 when the operation unit A12 of the external device A1 receives a signal from the communication unit A13 indicating that the operation of the user requesting display of the imaging result has been received. Thereafter, in the imaging step ST32, the imaging unit 11 captures the imaging target X1. More specifically, in the imaging step ST32, if the imaging target X1 is included in the imaging range, the imaging unit 11 captures the imaging range including the imaging target X1, and if the imaging target X1 is not included in the imaging range, the imaging unit 11 captures the imaging range not including the imaging target X1.

[0070] In communication step ST33, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. In short, in communication step ST33, when the communication unit 13 receives the control contents by the request control unit 211 in the display request step ST31 from the communication unit 22 of the server 2, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2. That is, in communication step ST33, when the operation unit A12 of the external device A1 accepts a user's operation requesting display of the imaging result, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2.

[0071] (4) Variations The above-described embodiment is merely one of various embodiments of the present disclosure. The above-described embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. The following modified examples may be realized in appropriate combination. In addition, functions similar to those of the monitoring system 100 according to the above-described embodiment may be embodied in a program that is a computer program, or a non-transitory recording medium on which a program is recorded. The program according to one aspect is a program for causing a computer system to execute the monitoring method in the above-described embodiment.

[0072] In the above embodiment, it is assumed that the surveillance system 100 is used when the user confirms on the display unit A11 of the external device A1 that the user's child, who is the imaging subject X1, has returned home based on the imaging results captured by the camera device 1, and the user's voice that has been stored in advance for the child is output from the audio output device 3. However, the surveillance system 100 may also be used when the user confirms on the display unit A11 of the external device A1 the status of the user's pet, who is the imaging subject X1, based on the imaging results captured by the camera device 1, and the user's voice that has been stored in advance for the pet is output from the audio output device 3.

[0073] Assuming the above case, the voice storage unit 32 stores, as an example, four user voices, "Hey," "Pat-pat," "Good boy," and "Come here." As shown in Fig. 6, the selection button B2a is associated with the user voice "Hey," and the selection button B2b is associated with the user voice "Pat-pat." Similarly, the selection button B2c is associated with the user voice "Good boy," and the selection button B2d is associated with the user voice "Come here."

[0074] The situation in which the monitoring system 100 is used is not limited to the above.

[0075] In the above embodiment, the imaging unit 11 captures an image of the imaging range including the imaging target X1 when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, or when control contents by the request control unit 211 described later are received from the communication unit 22 of the server 2. However, the imaging unit 11 may capture the imaging range at all times. In this case, when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11, or when control contents by the request control unit 211 described later are received from the communication unit 22 of the server 2, the communication unit 13 transmits the imaging result of the imaging unit 11 to the communication unit A13 of the external device A1 via the communication unit 22 of the server 2.

[0076] In the above embodiment, the display control unit 212 displays a plurality of selection buttons B1 in a display area R2 different from the display area R1 in which the imaging result of the imaging unit 11 is displayed. However, as shown in FIG. 6, the display control unit 212 may display a plurality of selection buttons B2 in a position that does not overlap with the imaging target X1 in the display area R1 in which the imaging result is displayed. The plurality of selection buttons B2 are displayed above the imaging target X1 in the display area R1 in which the imaging result is displayed. This configuration has the effect of making the display area R1 larger than the configuration (see FIG. 2) in which the plurality of selection buttons B1 are displayed in the display area R2 different from the display area R1 in which the imaging result of the imaging unit 11 is displayed. As a result, there is an advantage that the user can easily check the situation of the imaging target X1 in more detail.

[0077] In the above-described embodiment, the display control unit 212 causes the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11 when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 or when the operation unit A12 of the external device A1 accepts an operation requesting the display of the imaging results. However, the display control unit 212 may cause the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11 only when the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11. Also, the display control unit 212 may cause the display unit A11 of the external device A1 to display the imaging results of the imaging unit 11 only when the operation unit A12 of the external device A1 accepts an operation requesting the display of the imaging results.

[0078] In the above-described embodiment, the detection unit 12 is a human presence sensor. However, the detection unit 12 may detect that the imaging target X1 has entered the imaging range of the imaging unit 11 based on the imaging result of the imaging unit 11. More specifically, the detection unit 12 of this embodiment may detect that the imaging target X1 has entered the imaging range of the imaging unit 11 when the data capacity of the video data acquired by the imaging unit 11 has changed.

[0079] In the above case, in the monitoring step when the detection unit 12 detects the imaging target X1, the order of the detection step ST21 and the imaging step ST22 is reversed. That is, in the imaging step ST22, the imaging range including the imaging target X1 is constantly imaged, and in the detection step ST21, the detection unit 12 detects that the imaging target X1 has entered the imaging range of the imaging unit 11 based on the imaging result of the imaging unit 11 in the imaging step ST22.

[0080] In the above embodiment, the camera device 1 and the audio output device 3 are integrated, but they may be separate. More specifically, the camera device 1 may include an audio output unit 33.

[0081] In the above embodiment, the audio output device 3 includes the audio capture unit 31. However, the audio capture unit 31 may be included in the camera device 1 or the external device A1.

[0082] In the above embodiment, the audio output device 3 includes the audio storage unit 32. However, the audio storage unit 32 may be included in the camera device 1, the server 2, or the external device A1.

[0083] (summary) The surveillance system (100) of the first aspect includes an audio acquisition unit (31), an audio storage unit (32), an imaging unit (11), a communication unit (13), and an audio output unit (33). The audio acquisition unit (31) acquires the user's audio. The audio storage unit (32) stores the audio. The imaging unit (11) captures an image of an imaging target (X1). The communication unit (13) is configured to be able to communicate with an external device (A1) and transmits the imaging results of the imaging unit (11) to the external device (A1). The audio output unit (33) outputs audio in response to an output instruction from the external device (A1) based on the imaging results.

[0084] This aspect has the advantage that the imaging results of the imaging section (11) can be interfered with from outside.

[0085] In the surveillance system (100) of the second aspect, in the first aspect, the audio output unit (33) outputs audio at the timing when an output instruction is received from the external device (A1).

[0086] According to this aspect, there is an advantage that the user can output an appropriate user voice according to the real-time situation of the imaging target (X1).

[0087] The surveillance system (100) of the third aspect is the first or second aspect, and further includes a display control unit (212) that causes the display unit (A11) of the external device (A1) to display the imaging result. The display control unit (212) further causes the display unit (A11) to display selection buttons (B1, B2) that accept an output instruction based on the imaging result. The audio output unit (33) outputs audio in response to the output instruction accepted by the selection buttons (B1, B2).

[0088] According to this aspect, there is an advantage that the user can easily give an output instruction.

[0089] In the surveillance system (100) of the fourth aspect, in the third aspect, the display control unit (212) displays selection buttons (B1, B2) in a position that does not overlap with the imaging target (X1) in the display area (R1) where the imaging results are displayed.

[0090] This embodiment has the advantage that the user can easily select the selection buttons (B1, B2) while viewing the imaging results of the imaging section (11).

[0091] In the surveillance system (100) of the fifth aspect, in the third aspect, the display control unit (212) displays selection buttons (B1, B2) in a display area (R2) different from the display area (R1) in which the imaging results are displayed.

[0092] This embodiment has the advantage that the user can easily check the detailed condition of the imaging target (X1).

[0093] In the surveillance system (100) of the sixth aspect, in any one of the third to fifth aspects, the audio storage unit (32) stores a plurality of audios. The display control unit (212) causes a plurality of selection buttons (B1, B2) to be displayed on the display unit (A11). Each of the plurality of selection buttons (B1, B2) is in one-to-one correspondence with a plurality of audios. The audio output unit (33) outputs the audio associated with the selection button (B1, B2) for which an output instruction has been received from among the plurality of audios.

[0094] This aspect has the advantage that the audio output unit (33) can output an appropriate user's audio depending on the situation of the imaging target (X1).

[0095] The surveillance system (100) of the seventh aspect is in any one of the first to sixth aspects, and further includes a detection unit (12) and a display control unit (212). The detection unit (12) detects that an imaging target (X1) has entered an imaging range of the imaging unit (11). When the detection unit (12) detects that the imaging target (X1) has entered an imaging range of the imaging unit (11), the display control unit (212) causes the display unit (A11) of the external device (A1) to display the imaging result.

[0096] According to this aspect, the user can know the timing when the situation of the imaging target (X1) has changed, and there is an advantage that the user can check the situation of the imaging target (X1) at the necessary timing.

[0097] The surveillance system (100) of an eighth aspect is in any one of the first to seventh aspects, and further includes a display control unit (212). When receiving an operation requesting display of an imaging result, the display control unit (212) causes the imaging result to be displayed on the display unit (A11) of the external device (A1).

[0098] This aspect has the advantage that the user can check the status of the imaging target (X1) at a timing desired by the user.

[0099] The monitoring method of the ninth aspect includes an audio acquisition step (ST11), an audio storage step (ST12), an imaging step (ST22, ST32), a communication step (ST23, ST33), and an audio output step (ST26, ST36). In the audio acquisition step (ST11), the user's audio is acquired. In the audio storage step (ST12), the audio is stored. In the imaging step (ST22, ST32), an image of an imaging target (X1) is captured. In the communication step (ST23, ST33), the imaging result of the imaging step (ST22, ST32) is transmitted to an external device (A1). In the audio output step (ST26, ST36), audio is output in response to an output instruction from the external device (A1) based on the imaging result.

[0100] This embodiment has the advantage that the imaging results of the imaging unit (11) can be interfered with from outside without using a dedicated monitoring system (100).

[0101] A program according to a tenth aspect is a program for causing a computer system to execute the monitoring method according to the ninth aspect.

[0102] This embodiment has the advantage that the imaging results of the imaging unit (11) can be interfered with from outside without using a dedicated monitoring system (100). [Explanation of symbols]

[0103] 100 Surveillance System 11 Imaging unit 12 Detection unit 13. Communications Department 212 Display control unit 31 Voice Acquisition Unit 32 Audio storage unit 33 Audio output section A1 External device A11 Display section B1, B2 selection button R1 display area R2 display area ST11 Audio acquisition step ST12 Voice recording step ST22, ST32 Imaging steps ST23, ST33 communication steps ST26, ST36 Audio output steps X1 Image capture target

Claims

1. A voice acquisition unit that acquires a user's voice; a voice storage unit that stores the voice; An imaging unit that captures an image of an imaging target; a communication unit configured to be able to communicate with an external device and configured to transmit an imaging result of the imaging unit to the external device; an audio output unit that outputs the audio in response to an output instruction from the external device based on the imaging result, Surveillance system.

2. The audio output unit outputs the audio at a timing when the output instruction is received from the external device. The monitoring system of claim 1 .

3. a display control unit that displays the imaging result on a display unit of the external device; the display control unit further causes the display unit to display a selection button for receiving the output instruction based on the imaging result; the audio output unit outputs the audio in response to the output instruction accepted by the selection button. The monitoring system of claim 1 .

4. the display control unit displays the selection button at a position not overlapping with the imaging target in a display area in which the imaging result is displayed, The monitoring system according to claim 3.

5. the display control unit displays the selection button in a display area different from a display area in which the imaging result is displayed. The monitoring system according to claim 3.

6. The voice storage unit stores a plurality of the voices, the display control unit causes a plurality of the selection buttons to be displayed on the display unit; each of the plurality of selection buttons is associated one-to-one with each of the plurality of voices; the audio output unit outputs a sound associated with the selection button for which the output instruction has been received, among the plurality of sounds. The monitoring system according to claim 3.

7. a detection unit that detects that the imaging target has entered an imaging range of the imaging unit; and a display control unit that displays the imaging result on a display unit of the external device when the detection unit detects that the imaging target has entered the imaging range of the imaging unit. The monitoring system of claim 1 .

8. a display control unit that displays the imaging result on a display unit of the external device when an operation for requesting display of the imaging result is received, The monitoring system of claim 1 .

9. A voice acquisition step of acquiring a voice of a user; a voice storage step of storing the voice; An imaging step of imaging an imaging target; a communication step of transmitting the imaging result of the imaging step to an external device; and outputting the sound in response to an output instruction from the external device based on the imaging result. Monitoring method.

10. A program for causing a computer to execute the monitoring method according to claim 9.

Images