Communication system, control method, and program
The communication system addresses the lack of comfort in network systems by using voice and image recognition to personalize user interactions and enhance security, improving communication comfort and security.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-27
- Publication Date
- 2026-04-08
AI Technical Summary
Existing network systems lack comfort in communication between residents and the network system, particularly in identifying multiple users and managing external communication effectively.
A communication system comprising an indoor unit with a speaker, microphone, and processing unit, and an outdoor unit with a speaker, microphone, and imaging unit, which recognizes registered users' voices and images to provide personalized voice outputs and manage external communication securely.
Improves communication comfort by identifying registered users and enhancing security through personalized voice outputs and secure external communication management.
Smart Images

Figure 2026060783000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to a communication system, a control method, and a program, and more particularly, to a communication system, a control method, and a program that perform voice output.
Background Art
[0002] Patent Document 1 discloses a network system. The network system of Patent Document 1 includes a plurality of home appliances such as a vacuum cleaner and a television. In the network system of Patent Document 1, when a user gives a voice command to the vacuum cleaner, the vacuum cleaner emits a voice for increasing the volume of the television.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, in a network system (communication system) such as Patent Document 1, it is desired to make the communication between the network system and the residents more comfortable.
[0005] In view of the above reasons, the present disclosure is made, and an object thereof is to provide a communication system, a control method, and a program capable of improving the comfort of communication.
Means for Solving the Problems
[0006] A communication system according to one aspect of the present disclosure is installed in a residence. The communication system comprises an indoor unit, a second speaker, and an imaging unit. The indoor unit is installed inside the residence. The indoor unit has a first speaker, a microphone, and a processing unit that performs processing. The second speaker is installed outside the residence and is configured to communicate with the indoor unit. The imaging unit is installed outside the residence and is configured to communicate with the indoor unit. When the audio input to the microphone matches the registered audio of a pre-registered registrant, the processing unit causes the first speaker to output audio including the registered name of the registrant. When the imaging unit captures an image of the registrant, the processing unit causes the second speaker to output audio that does not include the registered name of the registrant.
[0007] A control method according to one aspect of the present disclosure is performed by a communication system. The communication system includes an indoor unit installed inside a house. The control method comprises a first step and a second step. In the first step, when the voice input to the microphone of the indoor unit matches the registered voice of a registered person that has been registered in advance, the indoor unit outputs a voice including the registered name of the registered person from a first speaker. In the second step, when the registered person is captured by an imaging unit set up outside the house, the indoor unit outputs a voice that does not include the registered name of the registered person from a second speaker installed outside the house.
[0008] A program according to one aspect of this disclosure is a program for causing one or more processors to execute the control method. [Effects of the Invention]
[0009] According to this disclosure, it is possible to improve the comfort of communication. [Brief explanation of the drawing]
[0010] [Figure 1]Figure 1 is a schematic diagram showing the configuration of the communication system according to Embodiment 1. [Figure 2] Figure 2 is a schematic block diagram showing the configuration of the communication system described above. [Figure 3] Figure 3 is a schematic diagram showing an example of a name registration screen displayed by the aforementioned communication system. [Figure 4] Figure 4 is a schematic diagram showing an example of a voice registration screen displayed by the communication system described above. [Figure 5] Figure 5 is a schematic diagram showing an example of a voice selection screen displayed by the aforementioned communication system. [Figure 6] Figure 6 is a schematic diagram showing an example of an image registration screen displayed by the aforementioned communication system. [Figure 7] Figure 7 is a schematic diagram showing an example of the voice output of the communication system described above. [Figure 8] Figure 8 is a schematic diagram showing another example of the voice output of the same communication system. [Figure 9] Figure 9 is a schematic diagram showing yet another example of the voice output of the same communication system. [Figure 10] Figure 10 is a schematic diagram showing an example of a display screen displayed by the communication system described above. [Figure 11] Figure 11 is a flowchart showing the operation of the communication system described above. [Figure 12] Figure 12 is a flowchart showing the operation of the communication system described above. [Figure 13] Figure 13 is a flowchart showing the operation of the communication system described above. [Figure 14] Figure 14 is a flowchart showing the operation of the communication system described above. [Figure 15] Figure 15 is a schematic diagram showing the configuration of the communication system according to Embodiment 2.
Best Mode for Carrying Out the Invention
[0011] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the drawings. In the embodiments described below, common elements are denoted by the same reference numerals, and duplicate descriptions of common elements may be omitted. Note that the following embodiments and modification examples are only a part of various embodiments of the present disclosure. Also, the following embodiments and modification examples can be variously modified according to design and the like as long as the object of the present disclosure can be achieved. Further, it is also possible to appropriately combine the configurations of the embodiments and modification examples.
[0012] Each drawing described in the present disclosure is a schematic drawing, and the ratio of the size and thickness of each component in each drawing does not necessarily reflect the actual dimensional ratio.
[0013] (Embodiment 1) ((1) Overview First, the overview of the communication system 100 according to Embodiment 1 will be described with reference to FIGS. 1 and 2.
[0014] The communication system 100 of Embodiment 1 is a control system installed in the house 200. The communication system 100 of Embodiment 1 is a system that controls various facility devices 301 (see FIG. 2) based on a voice instruction of a registered user (for example, person H1) for the indoor unit 1.
[0015] The communication system 100 includes an indoor unit 1, a speaker 32 (second speaker), and an imaging unit 34.
[0016] The speaker 32 is installed outside the house 200. The speaker 32 is configured to be communicable with the indoor unit 1. <000The indoor unit 1 is installed inside the house 200. The indoor unit 1 includes a speaker 15 (first speaker), a microphone 16, and a processing unit 17 that performs processing.
[0019] The processing unit 17 outputs a voice message from the speaker 15 that includes the registered name of the registrant when the voice input to the microphone 16 matches the registered voice of the registrant that has been registered in advance. Here, "audio message that includes the registered name of the registrant" includes, for example, the registered name of the registrant and a voice message that responds to the voice input to the microphone 16. "Audio message that responds to the voice input to the microphone 16" includes, if the voice input to the microphone 16 is a voice instruction, a voice message indicating that the voice instruction has been received, a voice message indicating that the control corresponding to the voice instruction has been executed, and a voice message regarding whether or not the control corresponding to the voice instruction can be executed.
[0020] Furthermore, when the imaging unit 34 captures an image of a registered person, the processing unit 17 outputs audio that does not include the registered person's name from the speaker 32 installed outside the room. Here, "audio that does not include the registered person's name" includes, for example, audio corresponding to the registered person's actions captured by the imaging unit 34. "Registered person's actions" include actions such as the registered person standing still, the registered person walking or running in the direction of approaching the house 200, the registered person walking or running in the direction of moving away from the house 200, the registered person standing still, or the registered person sitting down.
[0021] According to the communication system 100 of Embodiment 1, when a voice instruction is received from a registered person inside the house 200, the system outputs a voice message including the registered person's name. This makes it clear, for example, who gave the instruction if multiple people H1 live in the house 200. This improves the comfort of communication between the people H1 living in the house 200 and the communication system 100.
[0022] Furthermore, according to the communication system 100 of Embodiment 1, when the imaging unit 34 captures an image of a registered person who is outside the house 200, it is possible to suppress the reduction in security due to communication outside the house by outputting audio that does not include the registered person's name.
[0023] (2) Details The detailed configuration of the communication system 100 according to Embodiment 1 will be described below with reference to Figures 1 to 10.
[0024] (2.1) Communication System As shown in Figure 2, the communication system 100 of Embodiment 1 comprises a home system 300 and a server 9. The home system 300 and the server 9 are configured to communicate with each other via a network NT1 such as the Internet. In this disclosure, "communication possible" means that signals can be sent and received directly or indirectly via a network or repeater, etc., by an appropriate communication method such as wired communication or wireless communication.
[0025] (2.2) Home System Configuration The home system 300 is a system installed in a house 200. Embodiment 1 assumes that the home system 300 is installed in a house 200, for example, a detached house. In other words, in Embodiment 1, the user of the home system 300 (or communication system 100) is person H1, such as a resident of the detached house. Note that the house 200 may be an apartment building or the like. Embodiment 1 will describe the case in which multiple people H1 live in the house 200.
[0026] The home system 300 comprises an indoor unit 1, an information terminal 2, an outdoor unit 3, a plurality of equipment devices 301, and a communication device 8.
[0027] (2.2.1) Communication equipment The communication device 8 is, for example, a router. The communication device 8 in Embodiment 1 relays communication between the indoor unit 1, the information terminal 2, the outdoor unit 3, and the multiple equipment devices 301. The communication device 8 can communicate wirelessly with each of the indoor unit 1, the information terminal 2, the outdoor unit 3, and the multiple equipment devices 301.
[0028] Furthermore, the communication device 8 is configured to communicate with the server 9 via a network NT1 such as the Internet.
[0029] (2.2.2) Equipment The multiple pieces of equipment 301 are home appliances installed in the residence 200. The multiple pieces of equipment 301 include equipment 5, equipment 6, and equipment 7.
[0030] Equipment 5 is a television receiver. Equipment 5 is configured to communicate with indoor unit 1 via communication device 8. Based on control instructions from indoor unit 1, equipment 5 performs actions such as switching the power on / off, changing channels, and changing the volume.
[0031] Equipment 6 is a lighting device. Equipment 6 is configured to communicate with indoor unit 1 via communication device 8. Based on control instructions from indoor unit 1, equipment 6 switches between turning on / off, changes brightness, etc.
[0032] Equipment 7 is an air conditioning unit (air conditioner). Equipment 7 is configured to communicate with indoor unit 1 via communication device 8. Based on control instructions from indoor unit 1, equipment 7 performs actions such as switching the power on / off, switching between cooling and heating operation, and changing the set temperature.
[0033] In addition to equipment 5, equipment 6, and equipment 7, the multiple pieces of equipment 301 may also include equipment such as a vacuum cleaner, an intercom master unit, an intercom sub-unit, a smart speaker, or a HEMS (Home Energy Management System) controller.
[0034] (2.2.3) Outdoor unit The outdoor unit 3 is installed outside the house 200. For example, the outdoor unit 3 is installed outside the entrance of the house 200.
[0035] As shown in Figure 2, the outdoor unit 3 comprises a communication unit 31, a speaker 32 (second speaker), a microphone 33 (second microphone), an imaging unit 34, and a processing unit 35.
[0036] The communication unit 31 includes an interface that can communicate with the indoor unit 1. In Embodiment 1, the communication unit 31 is configured to communicate with the indoor unit 1 via a communication device 8.
[0037] The speaker 32 outputs sound based on the control of the processing unit 35. The speaker 32 is configured to communicate with the indoor unit 1 via the communication unit 31.
[0038] The microphone 33 acquires sounds, including the voice of person H1, converts the acquired sounds into electrical signals, and outputs them to the processing unit 35. The microphone 33 is configured to communicate with the indoor unit 1 via the communication unit 31.
[0039] The imaging unit 34 captures images of the exterior of the house 200 and generates images. The imaging unit 34 is a camera having an image sensor. In Embodiment 1, the imaging range of the imaging unit 34 is set to be in front of the outdoor unit 3. The term "image" in this disclosure includes moving images, still images, and frame-by-frame images. In Embodiment 1, the imaging unit 34 generates an image that is a color moving image. In the following description, the image generated by the imaging unit 34 capturing images of the exterior may be referred to as the "outdoor image".
[0040] The imaging unit 34 of Embodiment 1 basically continuously captures images of the exterior of the house 200 and generates color video images 24 hours a day. However, if the outdoor unit 3 is equipped with, for example, a motion sensor, the imaging unit 34 may be configured to start capturing images of the exterior when the motion sensor detects a person H1. The imaging unit 34 is configured to communicate with the indoor unit 1 via the communication unit 31.
[0041] The processing unit 35 primarily consists of a computer system having, for example, one or more processors and one or more memories. In the outdoor unit 3, the functions of the processing unit 35 are realized by one or more processors executing a program stored in memory. The program may be pre-stored in memory, provided via a telecommunication line such as the Internet, or provided on a non-temporary recording medium such as a memory card.
[0042] The processing unit 35 controls the communication unit 31, the speaker 32, and the imaging unit 34. The processing unit 35 transmits the outdoor image to the indoor unit 1 via the communication unit 31, etc. The processing unit 35 also transmits the electrical signal output from the microphone 33 to the indoor unit 1 via the communication unit 31, etc. Furthermore, the processing unit 35 outputs sound from the speaker 32 based on control instructions received from the indoor unit 1 via the communication unit 31.
[0043] (2.2.4) Information terminals Information terminal 2 is, for example, a smartphone owned by person H1. However, information terminal 2 may also be a tablet device or a personal computer.
[0044] The information terminal 2 includes a communication unit 21, a storage unit 22, a display unit 23, an operation unit 24, a speaker 25, a microphone 26, a processing unit 27, and an imaging unit 28.
[0045] The communication unit 21 includes an interface that can communicate with the indoor unit 1. In Embodiment 1, the communication unit 21 is configured to communicate with the indoor unit 1 via the communication device 8.
[0046] The storage unit 22 includes, for example, a semiconductor memory such as ROM (Read Only Memory) or EEPROM (Electrically Erasable Programmable Read Only Memory).
[0047] The display unit 23 displays various information. The operation unit 24 receives operation input from person H1. In Embodiment 1, the display unit 23 and the operation unit 24 are composed of touch panel displays. In other words, the operation unit 24 receives operation input from person H1 on the screen displayed on the display unit 23.
[0048] The speaker 25 outputs sound based on the control of the processing unit 27.
[0049] The microphone 26 acquires sounds including the voice of person H1, converts the acquired sounds into electrical signals, and outputs them to the processing unit 27.
[0050] The imaging unit 28 is a camera having an image sensor. The imaging unit 28 captures images of subjects such as a person H1 and generates images. In Embodiment 1, the imaging unit 28 generates images that are color videos.
[0051] The processing unit 27 primarily consists of a computer system having, for example, one or more processors and one or more memories. In the information terminal 2, the functions of the processing unit 27 are realized when one or more processors execute a program stored in memory. The program may be pre-stored in memory, provided via a telecommunication line such as the Internet, or provided on a non-temporary recording medium such as a memory card.
[0052] The processing unit 27 controls the communication unit 21, the display unit 23, the speaker 25, and the imaging unit 28.
[0053] In Embodiment 1, the information terminal 2 is used when registering person H1 as a registered user (or user) of the communication system 100.
[0054] For example, when person H1 performs a predetermined operation on the operation unit 24 of the information terminal 2, such as launching an application for using the communication system 100, the processing unit 27 displays a registration screen on the display unit 23.
[0055] Referring to Figures 3 to 6, the registration display screen shown by the display unit 23 will be explained. As shown in Figure 3, the display unit 23 displays a name registration screen G1 (display screen) for registering the name of person H1 who intends to become a registrant. In other words, the name registration screen G1 is a display screen that prompts person H1 to enter a name for registration.
[0056] The name registration screen G1 includes area R1, a name input field B1, and a button B2. Area R1 displays a message prompting person H1 to enter a name, such as "Please enter your name. You will be called by the name you register." The name input field B1 is for entering person H1's name. Person H1 enters the name by performing a predetermined operation on the name input field B1. The name can be person H1's real name or a nickname. Button B2 is a button to complete the name registration.
[0057] As shown in Figure 4, the display unit 23 displays a voice registration screen G2 (display screen) for registering the voice of person H1 who intends to become a registrant. In other words, the voice registration screen G2 is a display screen that prompts person H1 to input voice.
[0058] The voice registration screen G2 includes area R2 and button B3. Area R2 displays a message prompting person H1 to input (or record) voice, such as "After pressing the record button, please read the following sentence aloud: Good morning, it's a nice morning again today." Button B3 is for starting person H1's voice input. The voice of person H1 input into the microphone 26 of the information terminal 2 is registered as a reference voice for speaker recognition by the communication system 100.
[0059] As shown in Figure 5, the display unit 23 displays a voice selection screen G3 (display screen) for determining the response voice pattern. In other words, the voice selection screen G3 is a display screen that allows person H1 to select (or decide) the response voice pattern. Here, the "response voice pattern" is a pattern of pitch, volume, tone of voice, etc., when the communication system 100 outputs voice to person H1. The "response voice pattern" may include, for example, the voices of men of different age groups, the voices of women of different age groups, the voices of characters from anime, games, movies, etc., or the voices of celebrities and voice actors.
[0060] The voice selection screen G3 includes area R3 and buttons B4, B5, B6, B7, and B8. Area R3 displays a message prompting person H1 to select a response voice pattern, such as "Please select a response voice." Buttons B4 through B8 are buttons for allowing person H1 to select a response voice pattern. For example, each of buttons B4 through B8 is an icon containing an image associated with the corresponding response voice pattern. Here, "image" includes, for example, images of men of different age groups, images of women of different age groups, images of characters from anime, games, movies, etc., or images of celebrities or voice actors. Button B8 is the button for completing the selection of the response voice.
[0061] As shown in Figure 6, the display unit 23 displays an image registration screen G4 (display screen) for registering an image of person H1 who intends to become a registrant. In other words, the image registration screen G4 is a display screen that allows person H1 to register an image of themselves.
[0062] The image registration screen G4 includes area R4, area R5, and button B9. Area R4 displays a message prompting person H1 to register an image of themselves, such as, "Please rotate 360° after pressing the video recording button while ensuring your entire body is visible as shown below." Area R5 contains image G41. Image G41 is an image used to explain to person H1 that they should rotate 360° while standing after the imaging unit 28 starts imaging (i.e., after operating button B9). Button B9 is the button used to start imaging person H1. When button B9 is operated, the imaging unit 28 is activated and the generation of a color video image begins. In Embodiment 1, a color video is generated of person H1 rotating 360° while standing. In Embodiment 1, a registration image of person H1, who will be the registrant, is generated based on the color video generated by the imaging unit 28. The registered image of person H1 is registered as a reference image for image recognition by the communication system 100.
[0063] The processing unit 27 transmits the registered name information of person H1, the voice information of person H1, the selected response voice pattern information, and the image of person H1 to the indoor unit 1 via the communication unit 21 or the like.
[0064] (2.2.5) Indoor unit As shown in Figure 1, the indoor unit 1 is installed inside the house 200. The indoor unit 1 in Embodiment 1 is, for example, a smart speaker.
[0065] As shown in Figure 2, the indoor unit 1 comprises a communication unit 11, a storage unit 12, a display unit 13, an operation unit 14, a speaker 15 (first speaker), a microphone 16 (first microphone), and a processing unit 17.
[0066] The communication unit 11 includes an interface that can communicate with the outdoor unit 3, the information terminal 2, the multiple equipment devices 301, and the server 9. In Embodiment 1, the communication unit 21 is configured to communicate with the outdoor unit 3, the information terminal 2, the multiple equipment devices 301, and the server 9 via the communication device 8.
[0067] The storage unit 12 includes, for example, a semiconductor memory such as ROM (Read Only Memory) or EEPROM (Electrically Erasable Programmable Read Only Memory). The storage unit 12 of Embodiment 1 stores information about the registered name, the registered person's voice, the person's response voice, and the registered image for each registered person living in the residence 200. The storage unit 12 of Embodiment 1 stores information about the registered name, the registered person's voice, the person's response voice, the registered image, and the presence / absence information for multiple registered persons. Here, "present / absence information" is information indicating whether the registered person is at home in the residence 200 or out. The storage unit 12 of Embodiment 1 also stores messages addressed to the registered persons.
[0068] The display unit 13 displays various information. The operation unit 14 receives operation input from person H1. In Embodiment 1, the display unit 13 and the operation unit 14 are composed of touch panel displays. In other words, the operation unit 14 receives operation input from person H1 on the screen displayed on the display unit 13.
[0069] The speaker 15 outputs sound based on the control of the processing unit 17.
[0070] The microphone 16 acquires sounds including the voice of person H1, converts the acquired sounds into electrical signals, and outputs them to the processing unit 17.
[0071] The processing unit 17 primarily consists of a computer system having, for example, one or more processors and one or more memories. In the indoor unit 1, the functions of the processing unit 17 are realized when one or more processors execute a program stored in memory. The program may be pre-stored in memory, provided via a telecommunication line such as the Internet, or provided on a non-temporary recording medium such as a memory card.
[0072] The processing unit 17 controls the communication unit 11, the display unit 13, and the speaker 15.
[0073] The processing unit 17 stores registration information for each registrant living in the residence 200 in the storage unit 12 based on the information transmitted from the information terminal 2, including the registered name of person H1, the voice information of person H1, the selected response voice pattern information, and the image captured of person H1. Here, the processing unit 17 generates a 3D image that will be the registration image of person H1, who will be the registrant, based on the image of person H1 captured by the imaging unit 28 of the information terminal 2. The processing unit 17 generates a 3D image of person H1, who will be the registrant, based on the image of person H1 captured by the imaging unit 28, for example, using photogrammetry. The processing unit 17 stores the registration name information, the registrant's voice information, the response voice information, and the 3D registration image for each registrant in the storage unit 12.
[0074] The processing unit 17 performs speaker recognition when a voice command is received by the microphone 16. In other words, when the voice of person H1 is input to the microphone 16, the processing unit 17 determines whether the input voice matches the registered person's voice (i.e., the reference voice) stored in the memory unit 12. If there is a reference voice among the multiple reference voices stored in the memory unit 12 that matches the voice input to the microphone 16, the processing unit 17 determines that the voice input to the microphone 16 is the registered person's voice.
[0075] Furthermore, the processing unit 17 performs speech recognition, determines the content of the voice command input to the microphone 16, and outputs a corresponding voice message from the speaker 15. Here, the processing unit 17 outputs a voice message from the speaker 15 that includes the registered name corresponding to the voice input to the microphone 16.
[0076] Furthermore, the processing unit 17 performs voice recognition, determines the content of the voice command input to the microphone 16, and outputs a control command corresponding to the content to the equipment 301 installed in the house 200.
[0077] As shown in Figure 7, for example, if a registered person H1 gives the voice command "Turn on the TV" to the indoor unit 1, the indoor unit 1 will output a voice message such as "Ichiro, I'll turn on the TV." Here, "Ichiro" is the registered name of the person H1 who gave the voice command "Turn on the TV." The indoor unit 1 then outputs a control command to the equipment 5, which is a television receiver, to turn on the power.
[0078] Furthermore, the processing unit 17 determines whether or not the registered person has been captured by the imaging unit 34 of the outdoor unit 3, based on the registered person's image stored in the storage unit 12 and the outdoor image acquired from the imaging unit 34 of the outdoor unit 3. First, the processing unit 17 performs a person detection process on the outdoor image transmitted from the outdoor unit 3 to determine whether or not the outdoor image contains an image of person H1. If the outdoor image contains an image of person H1, the processing unit 17 determines whether or not there is a matching image of person H1 among the multiple registered images stored in the storage unit 12. If there is a registered image among the multiple registered images stored in the storage unit 12 that matches the image of person H1 contained in the outdoor image, the processing unit 17 determines that the registered person has been captured by the imaging unit 34 of the outdoor unit 3.
[0079] In Embodiment 1, since the registered image is a three-dimensional image, even if person H1 is captured from an angle other than the front, the imaging unit 34 can determine whether or not the captured person H1 is the registered person. This further improves the convenience of the communication system 100 for person H1 using the communication system 100.
[0080] When the processing unit 17 determines that a registered person has been captured by the imaging unit 34, it determines whether the registered person is approaching the imaging unit 34 based on the outdoor image. For example, the processing unit 17 determines whether the registered person is approaching the imaging unit 34 by checking whether the face portion of the image of person H1 included in the outdoor image is facing the imaging unit 34, and whether the image of person H1 gets larger over time. When the processing unit 17 determines that the registered person is approaching the imaging unit 34, it determines that the registered person captured by the imaging unit 34 has returned home. When the processing unit 17 determines that the registered person captured by the imaging unit 34 has returned home, it updates the home information corresponding to the registered person captured by the imaging unit 34 to information indicating that the person is at home.
[0081] As shown in Figure 8, when the processing unit 17 determines that a registered person captured by the imaging unit 34 has returned home, it outputs a voice message that does not include the registered person's name, such as "Welcome back!", to the speaker 32 of the outdoor unit 3.
[0082] Furthermore, in Embodiment 1, the processing unit 17 determines, based on the outdoor image, whether the registered person has left the imaging unit 34 when it determines that the registered person has been captured by the imaging unit 34. For example, the processing unit 17 determines whether the registered person has left the imaging unit 34 by checking whether the back of the head or back of the image of person H1 included in the outdoor image is facing the imaging unit 34, and whether the image of person H1 gets smaller over time. If the processing unit 17 determines that the registered person has left the imaging unit 34, it determines that the registered person captured by the imaging unit 34 has gone out. If the processing unit 17 determines that the registered person captured by the imaging unit 34 has gone out, it updates the home information corresponding to the registered person captured by the imaging unit 34 to information indicating that the person is out.
[0083] As shown in Figure 9, when the processing unit 17 determines that the registered person captured by the imaging unit 34 has gone out, it outputs a voice message that does not include the registered person's name, such as "Have a good day!", to the speaker 32 of the outdoor unit 3.
[0084] According to the communication system 100 of Embodiment 1, voice output is provided in response to the registered person's return home and departure, thereby further improving the comfort of communication between the person H1 living in the house 200 and the communication system 100.
[0085] Furthermore, if the processing unit 17 determines that person H1 included in the outdoor image is a visitor to the house 200, it displays the visitor display screen G6 on the display unit 13, as shown in Figure 10. The visitor display screen G6 includes an outdoor image G61, buttons B10 and B11. The outdoor image G61 includes an image of the visitor G62. Button B10 is a response button. The response button is operated when person H1, who is inside the house 200, goes outside the house 200 to directly respond to the visitor. Button B11 is a call button. The call button is operated when person H1, who is inside the house 200, makes a call with the visitor.
[0086] Furthermore, the processing unit 17 of Embodiment 1 has two operating modes: home mode and away mode. Home mode is the operating mode that the processing unit switches to when it determines that at least one of the one or more registered users (multiple registered users in Embodiment 1) who have been registered in advance is at home in the house 200. Away mode is the operating mode that the processing unit 17 switches to when it determines that all of the one or more registered users who have been registered in advance are out of the house 200. The processing unit 17 performs different processing depending on whether the operating mode is home mode or away mode. More specifically, the processing unit 17 determines what to do when a visitor comes to the house 200, depending on whether the operating mode is home mode or away mode.
[0087] (2.3) Server Server 9 is installed outside the house 200. Server 9 is installed, for example, by a company that provides indoor unit 1 and outdoor unit 3. Here, "providing" includes sales and rentals. Server 9 is configured to communicate with indoor unit 1 via network NT1 or the like.
[0088] Server 9, for example, backs up the registration information of registered users stored in the storage unit 12 of the indoor unit 1.
[0089] (3) Operation of the communication system Next, the operation of the communication system 100 will be explained with reference to Figures 11 to 14.
[0090] Figure 11 is a flowchart showing the operation of the communication system 100 when a person H1 gives a voice command to the indoor unit 1.
[0091] First, the communication system 100 determines whether or not a voice command has been given to the indoor unit 1 (step S1). If the communication system 100 determines that no voice command has been given to the indoor unit 1 (step S1: No), it repeats the process in step S1. On the other hand, if the communication system 100 determines that a voice command has been given to the indoor unit 1 (step S1: Yes), it performs speaker recognition on the voice input to the microphone 16 (step S2). Then, the communication system 100 determines whether or not the person H1 who gave the voice command to the microphone 16 is a registered user (step S3). If the communication system 100 determines that the person H1 who gave the voice command to the microphone 16 is not a registered user (step S3: No), it provides a guest response (step S9). Depending on the content of the voice command, the communication system 100 outputs a voice message such as "Guest, we will do XXX." Then, the communication system 100 gives a control command according to the content of the voice command (step S8) and ends the series of processes shown in Figure 11.
[0092] On the other hand, if the communication system 100 determines that the person H1 who gave the voice command to the indoor unit 1 is a registered user (step S3: Yes), it determines whether the voice command is the first voice command given by the registered user after they have returned home (step S4). In other words, the processing unit 17 of the communication system 100 in Embodiment 1 determines whether the voice command given by the registered user is the first voice command given by the registered user after they have returned home when the voice command is input to the microphone 16.
[0093] If the communication system 100 determines that the voice command is not the first voice command since the registered person returned home (step S4: No), it makes a response for the registered person (step S7). Depending on the content of the voice command, the communication system 100 makes a voice output including the registered person's name, such as "Ichiro-san, I will do XXX." Then, the communication system 100 makes a control command according to the content of the voice command (step S8) and ends the series of processes shown in Figure 11. On the other hand, if the processing unit 17 of the communication system 100 determines that the voice command is the first voice command since the registered person returned home (step S4: Yes), it determines whether a message addressed to the registered person is stored in the storage unit 12 (step S5). Here, a "message addressed to the registered person" is stored in the storage unit 12 when the registered person or a person H1 other than the registered person performs a predetermined operation on the indoor unit 1, etc. The communication system 100 refers to the storage unit 12 and determines whether a message addressed to the registered person is stored.
[0094] If the communication system 100 determines that no message addressed to the registered user is stored in the storage unit 12 (step S5: No), it performs a response for the registered user (step S7) and executes a voice command (step S8), and then terminates the series of processes shown in Figure 11. On the other hand, if the communication system 100 determines that a message addressed to the registered user is stored in the storage unit 12 (step S5: Yes), it plays the message addressed to the registered user (step S6). More specifically, the processing unit 17 of the communication system 100 outputs a voice message containing the message from the speaker 15 if there is a message addressed to the registered user. For example, the communication system 100 might output a voice message such as, "Ichiro, there's a watermelon in the refrigerator." This improves the convenience of the communication system 100 for the user H1. The communication system 100 then performs a response for the registered user (step S7) and executes a voice command (step S8), and then terminates the series of processes shown in Figure 11.
[0095] Figures 12 to 14 are flowcharts showing the actions that the communication system 100 performs in response to outdoor images.
[0096] First, the communication system 100 determines whether or not it has detected a person H1 outside the house 200 (step S21). Here, detection of person H1 outside is performed by determining whether or not the outdoor image contains an image of person H1. If the communication system 100 determines that the outdoor image does not contain an image of person H1 (step S21: No), it repeats the process in step S21. On the other hand, if the communication system 100 determines that the outdoor image contains an image of person H1 (step S21: Yes), it performs image recognition and identifies person H1 as captured by the imaging unit 34 of the outdoor unit 3 (step S22). Then, the communication system 100 determines whether or not the person H1 captured by the imaging unit 34 of the outdoor unit 3 is a registered person (step S23).
[0097] If the communication system 100 determines that the person H1 captured by the imaging unit 34 of the outdoor unit 3 is not a registered person (step S23: No), the process proceeds to step S41 in Figure 13. The processes from step S41 onward will be described later. On the other hand, if the communication system 100 determines that the person H1 captured by the imaging unit 34 of the outdoor unit 3 is a registered person (step S23: Yes), it determines whether or not the registered person is approaching the imaging unit 34 (step S24).
[0098] If the communication system 100 determines that a registered person is approaching the imaging unit 34 (step S24: Yes), it outputs a voice message such as "Welcome home!" upon returning home (step S25) and updates the home information corresponding to the registered person to information indicating that they are at home (step S26). Next, the communication system 100 determines whether the operating mode is away mode or not (step S27). If the communication system 100 determines that the operating mode is not away mode (step S27: No), it terminates the series of processes shown in Figure 12. On the other hand, if the communication system 100 determines that the operating mode is away mode (step S27: Yes), it switches the operating mode to home mode (step S28) and terminates the series of processes shown in Figure 12.
[0099] In step S24, if the system determines that the registered person is not approaching the imaging unit 34, that is, that the registered person is away from the imaging unit 34 (step S24: No), the communication system 100 outputs an audio message indicating that the person is leaving, such as "Have a good day!" (step S29). The communication system 100 then updates the home status information corresponding to the registered person to information indicating that the person is out (step S30). Next, the communication system 100 determines whether another registered person, other than the one determined to have left, is at home in the residence 200 (step S31). Here, the communication system 100 determines whether another registered person, other than the one determined to have left, is at home in the residence 200 by referring to the home status information of each registered person stored in the storage unit 12 of the indoor unit 1. If the communication system 100 determines that another person is at home in the residence 200 (step S31: Yes), it terminates the series of processes shown in Figure 12. On the other hand, if the communication system 100 determines that no other occupants are present in the residence 200 (step S31: No), it switches the operating mode to the absence mode (step S32) and terminates the series of processes shown in Figure 12.
[0100] In step S41 of Figure 13, the communication system 100 determines whether the operating mode is the "away mode". If the communication system 100 determines that the operating mode is not the "away mode" (step S41: No), the process proceeds to step S43. If the communication system 100 determines that the operating mode is the "away mode" (step S41: Yes), it turns on the lighting equipment 6 (step S42). This improves security.
[0101] Next, the communication system 100 determines whether or not the response conditions are met (step S43). For example, the communication system 100 determines that the response conditions are met if the person H1 being captured by the imaging unit 34 is facing the imaging unit 34 and the image of person H1 included in the outdoor image is of a predetermined size or larger. If the communication system 100 determines that the response conditions are not met (step S43: No), it determines that the person H1 being captured by the imaging unit 34 is not a visitor and terminates the series of processes shown in Figure 13. On the other hand, if the communication system 100 determines that the response conditions are met, it determines that the person H1 being captured by the imaging unit 34 is a visitor and outputs a response message (step S43). Here, the communication system 100 outputs an audio message such as "Hello, please tell me what you need" from the speaker 32 of the outdoor unit 3.
[0102] Next, the communication system 100 starts recording outdoor images (step S45). Next, the communication system 100 determines whether or not the visitor has stated their purpose (step S46). If the communication system 100 determines that the visitor has not stated their purpose (step S46: No), it repeats the process in step S46. On the other hand, if the communication system 100 determines that the visitor has stated their purpose (step S46: Yes), it determines whether or not the purpose is a delivery (step S47). Here, the communication system 100 determines whether or not the purpose is a delivery by performing speech recognition on the voice spoken by the visitor.
[0103] If the communication system 100 determines that the request is not for delivery (step S47: No), the process proceeds to step S51 in Figure 14. On the other hand, if the communication system 100 determines that the request is for delivery (step S47: Yes), it outputs a voice message for delivery, such as "Thank you. Please put the package in the delivery box," to the speaker 32 (step S48). Then, the communication system 100 completes the series of processes shown in Figure 13.
[0104] In step S51 of Figure 14, the communication system 100 outputs a voice message, such as "Please wait a moment while we call you," from the speaker 32 of the outdoor unit 3. The communication system 100 also outputs ringing music from the speaker 32 (step S52). Next, the communication system 100 outputs a ringing tone from the speaker 15 of the indoor unit 1 to notify person H1 in the house 200 that a visitor has arrived (step S53), and displays the visitor display screen G6 (see Figure 10) on the display unit 13 of the indoor unit 1 (step S54).
[0105] Next, the communication system 100 determines whether a response operation has been performed when person H1 in the residence 200 directly responds to a visitor (step S55). In Embodiment 1, the communication system 100 determines whether button B10 (see Figure 10) on the visitor display screen G6 has been pressed.
[0106] If the communication system 100 determines that button B10 has been pressed (step S55: Yes), it outputs a voice message for direct interaction, such as "I'm on my way, please wait," to the speaker 32 of the outdoor unit 3 (step S60). Then, the communication system 100 completes the series of processes shown in Figure 14. On the other hand, if the communication system 100 determines that button B10 has not been pressed (step S55: No), it determines whether or not a call operation has been performed when person H1 in the house 200 speaks with a visitor (step S56). In Embodiment 1, the communication system 100 determines whether or not button B11 (see Figure 10) on the visitor display screen G6 has been pressed.
[0107] If the communication system 100 determines that button B11 has been pressed (step S56: Yes), it initiates a call between the indoor unit 1 and the outdoor unit 3. In other words, the communication system 100 sets the system so that the sound input to microphone 16 (first microphone) is output from speaker 32 (second speaker), and the sound input to microphone 33 (second microphone) is output from speaker 15 (first speaker).
[0108] Next, the communication system 100 determines whether or not an operation to end the call has been performed on the control unit 14 of the indoor unit 1 (step S62). If the communication system 100 determines that no operation to end the call has been performed on the control unit 14 of the indoor unit 1 (step S62: No), it repeats the process in step S62. On the other hand, if the communication system 100 determines that an operation to end the call has been performed on the control unit 14 of the indoor unit 1 (step S62: Yes), it ends the call (step S63) and terminates the series of processes shown in Figure 14.
[0109] In step S56, if the communication system 100 determines that button B11 has not been pressed (step S56: No), the communication system 100 outputs an unavailable message from speaker 32, such as, "We are sorry, but we are currently unable to assist you. If you would like to leave a message, please speak your message." (step S57).
[0110] Next, the communication system 100 determines whether or not the visitor left a message (step S58). If the communication system 100 determines that the visitor did not leave a message (step S58: No), it terminates the series of processes shown in Figure 14. On the other hand, if the communication system 100 determines that the visitor did leave a message (step S58: Yes), it outputs a voice message indicating the end of the interaction, such as "Thank you," from the speaker 32 (step S59), and terminates the series of processes shown in Figure 14.
[0111] Note that the flowcharts shown in Figures 11 to 14 are merely examples, and the order of processing may be changed as appropriate, or processes may be added or deleted as appropriate.
[0112] (4) Variations The following are examples of modifications of Embodiment 1.
[0113] Functions equivalent to those of the communication system 100 according to the above embodiment may be embodied in a control method, a (computer) program, or a non-temporary recording medium on which the program is recorded. One control method according to one embodiment is executed by the communication system 100. The communication system 100 includes an indoor unit 1 installed inside the house 200. The control method has a first step and a second step. In the first step, when the voice input to the microphone 16 of the indoor unit 1 matches the registered voice of a registered person that has been registered in advance, the indoor unit 1 is made to output a voice including the registered name of the registered person from the speaker 15 (first speaker). In the second step, when the registered person is captured by the imaging unit 34 set up outside the house 200, the indoor unit 1 is made to output a voice that does not include the registered name of the registered person from the speaker 32 (second speaker) installed outside. One program according to one embodiment is a program for causing one or more processors to execute the above control method.
[0114] The entity executing the communication system 100 or control method in this disclosure includes a computer system. The computer system mainly consists of a processor and memory as hardware. The functionality of the communication system 100 or control method as the entity executing it in this disclosure is realized by the processor executing a program recorded in the computer system's memory. The program may be pre-recorded in the computer system's memory, provided via a telecommunications line, or provided on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that is readable by the computer system. The processor of the computer system consists of one or more electronic circuits including semiconductor integrated circuits (ICs) or large-scale integrated circuits (LSIs). The integrated circuits referred to here, such as ICs or LSIs, are named differently depending on the degree of integration, and include integrated circuits called system LSIs, VLSIs (Very Large Scale Integration), or ULSIs (Ultra Large Scale Integration). Furthermore, FPGAs (Field-Programmable Gate Arrays) that are programmed after the manufacture of LSIs, or logic devices that allow for the reconfiguration of junction relationships or circuit compartments within LSIs, can also be used as processors. Multiple electronic circuits may be integrated onto a single chip or distributed across multiple chips. Multiple chips may be integrated onto a single device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller also consists of one or more electronic circuits, including semiconductor integrated circuits or large-scale integrated circuits.
[0115] Furthermore, it is not essential for the communication system 100 to have multiple functions integrated into a single housing; the components of the communication system 100 may be distributed across multiple housings. Moreover, at least some of the functions of the communication system 100, for example, some of the functions of the indoor unit 1, may be implemented by the cloud (cloud computing), etc.
[0116] In Embodiment 1, at least some of the functions of the communication system 100, which are distributed across multiple devices, may be consolidated into a single housing. For example, some of the functions of the communication system 100, which are distributed across the indoor unit 1 and the equipment 301, may be consolidated into a single housing.
[0117] In Embodiment 1, the example shown was that the user's registration information is stored in the storage unit 12 of the indoor unit 1, but the user's registration information may also be stored in the storage unit of the server 9.
[0118] In Embodiment 1, an example was given in which the indoor unit 1 performs processing such as speaker determination, speech recognition, and image recognition. However, the processing such as speaker determination, speech recognition, and image recognition may also be performed by the processing unit of the server 9.
[0119] Embodiment 1 illustrates a case where the speaker 32 (second speaker), microphone 33 (second microphone), and imaging unit 34 are integrally included in the outdoor unit 3. However, the speaker 32, microphone 33, and imaging unit 34 may be separate devices. Each of the speaker 32, microphone 33, and imaging unit 34 only needs to be installed outside the house 200 and configured to communicate with the indoor unit 1.
[0120] (Embodiment 2) (composition) As shown in Figure 15, the communication system 100 of Embodiment 2 comprises an intercom master unit 4A installed inside the house 200 and an intercom slave unit 4B installed outside the house 200.
[0121] In addition to functioning as a general intercom master unit, the intercom master unit 4A also functions as the indoor unit 1 described in Embodiment 1. Specifically, the intercom master unit 4A comprises a communication unit 11, a storage unit 12, a display unit 13, an operation unit 14, a speaker 15 (first speaker), a microphone 16 (first microphone), and a processing unit 17.
[0122] In addition to functioning as a general intercom unit, the intercom unit 4B also functions as the outdoor unit 3 described in Embodiment 1. Specifically, the intercom unit 4B comprises a communication unit 31, a speaker 32 (second speaker), a microphone 33 (second microphone), an imaging unit 34, and a processing unit 35.
[0123] (modified version) Embodiment 2 illustrates a case where the indoor unit 1 and the intercom master unit 4A are integrally configured, and the outdoor unit 3 and the intercom sub-unit 4B are integrally configured. However, the indoor unit 1 and the intercom master unit 4A may be configured separately, and the outdoor unit 3 and the intercom sub-unit 4B may be integrally configured. Alternatively, the indoor unit 1 and the intercom master unit 4A may be integrated, and the outdoor unit 3 and the intercom sub-unit 4B may be configured separately.
[0124] (Appearance) As is clear from the embodiments and modifications described above, the communication system (100) according to the first embodiment is installed in a house (200). The communication system (100) comprises an indoor unit (1), a second speaker (speaker 32), and an imaging unit (34). The indoor unit (1) is installed inside the house (200). The indoor unit (1) has a first speaker (speaker 15), a microphone (16), and a processing unit (17) that performs processing. The second speaker is installed outside the house (200) and is configured to communicate with the indoor unit (1). The imaging unit (34) is installed outside the house (200) and is configured to communicate with the indoor unit (1). When the voice input to the microphone (16) matches the registered voice of a registered user that has been registered in advance, the processing unit (17) outputs a voice including the registered name of the user from the first speaker. When the imaging unit (34) captures an image of a registered person, the processing unit (17) outputs audio from the second speaker that does not include the registered person's name.
[0125] According to this embodiment, the comfort of communication between a person (H1) living in a house (200) and a communication system (100) can be improved. Furthermore, security can be improved.
[0126] In the second embodiment of the communication system (100), in the first embodiment, the processing unit (17) determines whether or not the registered person has been captured by the imaging unit (34) based on the registered person's registered image and the image acquired from the imaging unit (34). If the processing unit (17) determines that the registered person has been captured by the imaging unit (34), it outputs audio that does not include the registered person's registered name from the second speaker (speaker 32). The registered image is a three-dimensional image generated by capturing the registered person.
[0127] According to this embodiment, the convenience of the communication system (100) for the person (H1) using the communication system (100) is further improved.
[0128] In the third embodiment of the communication system (100), in the first or second embodiment, when the registered person is captured by the imaging unit (34), the processing unit (17) determines whether the registered person is approaching the imaging unit (34) based on the image generated by the imaging unit (34) capturing the registered person. If the processing unit (17) determines that the registered person is approaching the imaging unit (34), it determines that the registered person has gone home.
[0129] According to this embodiment, the comfort of communication between a person (H1) living in a house (200) and a communication system (100) can be further improved.
[0130] In the fourth embodiment of the communication system (100), in any of the first to third embodiments, the processing unit (17) determines whether the voice instruction from the registered user is the first voice instruction since the registered user returned home when the voice instruction is input to the microphone (16). If the processing unit (17) determines that the voice instruction is the first voice instruction, it determines whether a message addressed to the registered user is stored in the storage unit (12), and if a message is stored in the storage unit (12), it outputs the voice containing the message from the first speaker (speaker 15).
[0131] According to this embodiment, the convenience of the communication system (100) for the person (H1) using the communication system (100) can be improved.
[0132] In the fifth embodiment of the communication system (100), in any of the first to fourth embodiments, the processing unit (17) determines whether the registered person has left the imaging unit (34) when the registered person is captured by the imaging unit (34), based on the image generated by the imaging unit (34) capturing the registered person. If the processing unit (17) determines that the registered person has left the imaging unit (34), it determines that the registered person has gone out.
[0133] According to this embodiment, the comfort of communication between a person (H1) living in a house (200) and a communication system (100) can be further improved.
[0134] In the sixth aspect of the communication system (100), in any of the first to fifth aspects, the operating modes of the processing unit (17) include a home mode and an away mode. The home mode is the operating mode to which the processing unit (17) switches when it determines that at least one (H1) of the one or more pre-registered registered users, including the registered user, is at home in the residence (200). The away mode is the operating mode to which the processing unit (17) switches when it determines that all of the one or more registered users are out of the residence (200). The processing unit (17) performs different processing depending on whether the operating mode is home mode or away mode.
[0135] According to this embodiment, for example, when a person other than a registered person (H1) approaches the house (200) while it is in vacant mode, the lighting equipment can be turned on, thereby improving security.
[0136] Configurations other than those in the first embodiment are not essential to the communication system (100) and can be omitted as appropriate.
[0137] The control method relating to the seventh aspect is performed by a communication system (100). The communication system (100) includes an indoor unit (1) installed inside a house (200). The control method comprises a first step and a second step. In the first step, when the voice input to the microphone (16) of the indoor unit (1) matches the registered voice of a registered person that has been registered in advance, the indoor unit (1) outputs a voice including the registered name of the registered person from a first speaker (speaker 15). In the second step, when the registered person is captured by the imaging unit (34) set up outside the house (200), the indoor unit (1) outputs a voice that does not include the registered name of the registered person from a second speaker (speaker 32) installed outside.
[0138] According to this embodiment, the comfort of communication between a person (H1) living in a house (200) and a communication system (100) can be improved. Security can also be improved.
[0139] The program according to the eighth aspect is a program that causes one or more processors to execute the control method according to the seventh aspect.
[0140] According to this embodiment, the comfort of communication between a person (H1) living in a house (200) and a communication system (100) can be improved. Security can also be improved. [Explanation of Symbols]
[0141] 1 Indoor unit 12 Storage section 15. Speaker (1st speaker) 16 Microphones 17 Processing Unit 100 Communication Systems 200 houses 32 speakers (2nd speaker) 34 Imaging Unit
Claims
1. A communication system installed in a house, An indoor unit installed inside the aforementioned house, comprising a first speaker, a microphone, and a processing unit that performs processing, A second speaker is installed outside the aforementioned house and is configured to communicate with the aforementioned indoor unit, An imaging unit installed outside the aforementioned house and configured to communicate with the aforementioned indoor unit, Equipped with, The aforementioned processing unit, When the audio input to the microphone matches the registered voice of a pre-registered registrant, the first speaker outputs an audio message including the registrant's registered name. When the imaging unit captures an image of the registered person, the second speaker outputs audio that does not include the registered name of the registered person. Communication system.
2. The aforementioned processing unit, Based on the registered image of the registrant and the image acquired from the imaging unit, the imaging unit determines whether or not the registrant has been captured. When the imaging unit determines that the registered person has been imaged, it outputs audio from the second speaker that does not include the registered name of the registered person. The registered image is a three-dimensional image generated by capturing the registered person. The communication system according to claim 1.
3. The aforementioned processing unit, When the registered person is captured by the imaging unit, the imaging unit determines whether the registered person is approaching the imaging unit based on the image generated by capturing the registered person. If it is determined that the registered person is approaching the imaging unit, it is determined that the registered person has returned home. The communication system according to claim 1 or 2.
4. The aforementioned processing unit, When a voice command from the registered user is input to the microphone, it is determined whether or not the voice command is the first voice command from the registered user after they have returned home. When it is determined that the voice instruction is the first voice instruction, it is determined whether a message addressed to the registered user is stored in the storage unit, and if the message is stored in the storage unit, the audio containing the message is output from the first speaker. The communication system according to claim 1 or 2.
5. The aforementioned processing unit, When the registered person is captured by the imaging unit, the imaging unit determines whether the registered person is away from the imaging unit based on the image generated by capturing the registered person. If it is determined that the registered person is away from the imaging unit, it is determined that the registered person has left the premises. The communication system according to claim 1 or 2.
6. The operating modes of the aforementioned processing unit include a home mode and an away mode. The aforementioned home mode is an operating mode that the processing unit enters when it determines that at least one of the one or more registered users, including the registered user, is at home in the residence. The aforementioned absence mode is an operating mode that the processing unit enters when it determines that all of the one or more registered persons are out of the residence. The processing unit performs different processing depending on whether the operating mode is the home mode or the away mode. The communication system according to claim 5.
7. A control method performed by a communication system equipped with an indoor unit installed inside a house, The first step is to output a voice message, including the registered name of the registered user, from the first speaker of the indoor unit when the voice input to the microphone of the indoor unit matches the registered voice of the registered user that has been registered in advance. The second step is to output voice from a second speaker installed outside the house, which does not include the registered name of the registered person, when the registered person is captured by the imaging unit set up outside the house, Having, Control method.
8. To cause one or more processors to execute the control method described in claim 7, program.
Citation Information
Patent Citations
Network system, server, household appliances, program, and cooperation method of household appliances
JP2014230061A