Intercom system, control method, and control program

The intercom system addresses the need for enhanced usability by implementing triggerless voice recognition to automate safety and activity confirmation processes, improving user convenience and efficiency in facilities.

JP7584083B2Active Publication Date: 2024-11-15PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020200108
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-02
Publication Date
2024-11-15
Estimated Expiration
2040-12-02

AI Technical Summary

Technical Problem

Existing intercom systems lack advanced usability features to cater to diverse user needs, particularly in managing safety and activity confirmation of residents in various facilities.

Method used

An intercom system equipped with a voice recognition engine that performs triggerless voice recognition control, allowing for the execution of predetermined processes based on sound information without requiring a trigger word, and includes a control unit that outputs predetermined information followed by sound recognition.

Benefits of technology

Enhances usability by enabling efficient monitoring of residents, such as confirming the safety of children and elderly, through automated responses to voice inquiries without the need for trigger words, thus improving user convenience and system efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584083000001
    Figure 0007584083000001
  • Figure 0007584083000002
    Figure 0007584083000002
  • Figure 0007584083000003
    Figure 0007584083000003
Patent Text Reader

Abstract

To provide an intercom system capable of further improving usability.SOLUTION: An intercom system comprises: an acquisition unit for acquiring sound information inside a facility; a notification unit for outputting predetermined information to the inside of the facility; and a control unit that when a trigger word is contained in the sound information acquired by the acquisition unit and sound is acquired subsequently to the trigger word, executes processing based on a result of recognizing the sound. In the case that the predetermined information is output by the notification unit, the control unit executes predetermined processing on the basis of a result of recognizing sound acquired after the output of the predetermined information even when the trigger word is not contained in the sound information.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an intercom system, a control method, and a control program. [Background technology]

[0002] Conventionally, in collective housing such as an apartment building, an intercom system equipped with a lobby intercom device installed at the common entrance, a plurality of intercom master units installed in each dwelling unit, and a control unit that controls these devices has been widely known. For example, Patent Document 1 discloses an intercom system that, when absence information indicating that a resident is absent is acquired and a call is made to the intercom master unit of the corresponding dwelling unit, a call is made to an information terminal such as a smartphone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-078036 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, intercom systems are being introduced not only in collective housing such as apartment buildings, but also in various facilities such as detached houses, offices, factories, medical facilities, and accommodation facilities, and highly functional intercom systems with various functions to meet user needs have been proposed. However, user needs for intercom systems are becoming more diverse, and further improvements in usability are expected.

[0005] An object of the present disclosure is to provide an intercom system that can further improve usability. [Means for solving the problem]

[0006] The intercom system of the present disclosure comprises an acquisition unit that acquires sound information within a facility, an alarm unit that outputs specified information within the facility, and a control unit that, when the sound information acquired by the acquisition unit includes a trigger word and a sound is acquired following the trigger word, executes processing based on the recognition result of the sound, and is characterized in that, when the specified information is output by the alarm unit, the control unit executes the specified processing based on the recognition result of the sound acquired after the output of the specified information, even if the sound information does not include the trigger word.

[0007] The control method of the present disclosure is a control method applied to an intercom system configured to execute processing based on the recognition results of sound when sound information includes a trigger word and sound is obtained following the trigger word, and is characterized in including a step of outputting specified information, and a step of acquiring sound information after the output of the specified information, wherein even if the sound information does not include a trigger word, the control method includes a step of executing the specified processing based on the recognition results of the sound obtained after the output of the specified information.

[0008] Further, a control program according to the present disclosure is a program for implementing the above control method on a computer. Effect of the Invention

[0009] According to the intercom system of the present disclosure, it is possible to further improve usability. The intercom system of the present disclosure can be used, for example, to watch over children or elderly people, to check the safety of residents, and the like. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic diagram of an intercom system according to an embodiment; [Diagram 2] 1 is a block diagram showing a configuration of an intercom master unit according to an embodiment; [Diagram 3] 4 is a flowchart illustrating a control procedure of the intercom system according to an embodiment. [Figure 4]4 is a flowchart showing a control procedure according to the first embodiment. [Diagram 5] FIG. 2 is a diagram for explaining a first embodiment. [Figure 6] 10 is a flowchart showing a control procedure according to a second embodiment. [Figure 7] FIG. 11 is a diagram for explaining a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings. The embodiments described below are merely examples, and the present disclosure is not limited to the following embodiments. In addition, selective combinations of multiple embodiments and modified examples described below are included in the scope of the present disclosure.

[0012] The subject of the device and system of the present disclosure includes a computer. The computer executes a program to realize the functions of the subject of the device and system of the present disclosure. The computer includes a processor that operates according to the program as a main hardware configuration. The type of the processor does not matter as long as it can realize the above functions by executing the program. The processor is composed of one or more electronic circuits including an integrated circuit (IC) or a large scale integrated circuit (LSI). The multiple electronic circuits may be integrated into one chip or may be provided in multiple chips. The multiple chips may be integrated into one device or may be provided in multiple devices. The program is stored in a non-transitory storage medium such as a computer-readable ROM, an optical disk, or a hard disk drive. The program may be stored in the storage medium in advance, or may be supplied to the storage medium via a wide area communication network including the Internet.

[0013] Fig. 1 is a diagram showing a schematic configuration of an intercom system 1 which is an example of an embodiment. As shown in Fig. 1, the intercom system 1 is a system installed in a collective housing such as an apartment building, and includes a lobby intercom device 11 provided at a shared entrance 10, a plurality of intercom master units 21 provided in each dwelling unit 20, and a control device 30 which controls these devices. The control device 30 is a device which comprehensively controls the intercom system 1, and is connected to the lobby intercom device 11 and the intercom master unit 21 so as to be able to communicate with them.

[0014] The intercom system 1 includes a plurality of entrance slave units 22 provided in each dwelling unit 20. In general, one intercom master unit 21 and one entrance slave unit 22 are provided in each dwelling unit 20. The intercom master unit 21 is provided inside each dwelling unit 20 and is communicatively connected to one entrance slave unit 22. The entrance slave unit 22 is provided outside each dwelling unit 20 near the entrance. Each dwelling unit 20 may be provided with a sub-master unit that is communicatively connected to the entrance slave unit 22 via the intercom master unit 21.

[0015] The intercom system 1 will be described as being applied to collective housing such as condominiums, dormitories, company housing, and nursing homes, but the application of the intercom system according to the present disclosure is not limited to collective housing. The intercom system according to the present disclosure can be applied to offices, factories, research facilities, medical facilities, nursing care facilities, accommodation facilities, and the like. The intercom system according to the present disclosure may also be applied to detached houses.

[0016] The intercom system 1 may include a management office master unit 16 provided in a management room 15. The management office master unit 16 is communicably connected to the lobby intercom device 11 and the intercom master unit 21 via a control device 30. The management office master unit 16 can transmit various information to the lobby intercom device 11 and the multiple intercom master units 21, for example. In the example shown in FIG. 1, the control device 30 is connected to a server 31 via a gateway 32. The gateway 32 functions as a router. The control device 30 may obtain information necessary for controlling the intercom system 1 from the server 31.

[0017] Although the details will be described later, the intercom system 1 has a function of executing a predetermined process based on voice recognition. When sound information including a trigger word is acquired, the intercom system 1 is configured to execute a process based on the recognition result of the sound acquired following the trigger word. In other words, the intercom system 1 has a "voice assistant function" that recognizes a voice command following a trigger word and executes a process based on the voice command.

[0018] In addition, the intercom system 1 is configured to be capable of outputting predetermined information, such as information for confirming the safety of residents. Even if the sound information acquired after outputting the predetermined information does not contain a trigger word, the intercom system 1 executes a predetermined process based on the recognition result of the sound information. Hereinafter, this function may be referred to as a "triggerless voice recognition control function" to distinguish it from a voice assistant function that requires a trigger word.

[0019] As described above, the lobby intercom device 11 is installed at the common entrance 10. The lobby intercom device 11 is a device for calling each dwelling unit 20. A visitor can input the number of the dwelling unit 20 he or she is visiting into the lobby intercom device 11 to make a call. In the example shown in FIG. 1, a non-contact key detection device 12 that detects a pre-registered card key is installed at the common entrance 10. The card key is held by the resident of the apartment building, but may be provided to specific visitors such as a delivery person or newspaper delivery person. Each card key has identification information (ID). Therefore, it is possible to identify the owner of a card key authenticated by the non-contact key detection device 12.

[0020] The shared entrance 10 is provided with an entrance door 13 and a locking device 14 that locks the entrance door 13. The locking device 14 is, for example, an auto-locking device that automatically locks the entrance door 13 when the entrance door 13 is closed, and operates an electric lock attached to the entrance door 13 under the control of the control device 30. The entrance door 13 is, for example, an automatic door, and is basically kept locked under normal circumstances.

[0021] The lobby intercom device 11 is installed outside the front door 13 of the shared entrance 10. Therefore, in order for a visitor to enter inside the front door 13, the visitor must call the residence 20 they are visiting using the lobby intercom device 11 and ask the resident of that residence 20 to unlock the electric lock on the front door 13. The resident can confirm the visitor using the intercom master unit 21 and operate the intercom master unit 21 to unlock the electric lock. The non-contact key detection device 12, like the lobby intercom device 11, is installed outside the front door 13.

[0022] The lobby intercom device 11 generally includes a numeric keypad for inputting the dwelling unit number and a call button for making a call. A visitor can call the dwelling unit they are visiting by inputting the dwelling unit number using the numeric keypad and pressing the call button. The lobby intercom device 11 also includes, for example, a camera, a microphone, a speaker, a monitor, and a reverse master key insertion section. A resident or the like who owns a key can insert the key into the reverse master key insertion section to unlock the electronic lock on the front door 13.

[0023] The lobby intercom device 11 captures an image of the visitor with a camera and transmits the image to the intercom master unit 21 that made the call. The speaker outputs a ringtone, and if a resident responds, the visitor's voice, etc. Also, the visitor's voice is picked up by a microphone and transmitted to the intercom master unit 21 of the called dwelling unit 20, allowing the visitor to talk to the resident. The monitor may display, for example, the dwelling unit number entered with the numeric keypad, or the image captured by the camera.

[0024] As described above, each dwelling unit 20 is provided with one intercom master unit 21 and one entrance slave unit 22. The intercom master unit 21 is communicatively connected to the entrance slave unit 22, and is also communicatively connected to the lobby intercom device 11 via the branch switch 17 and the control device 30. The intercom master unit 21 enables a resident to talk to a visitor via the lobby intercom device 11 and the entrance slave unit 22, and to check an image of the visitor. In this embodiment, the intercom master unit 21 is equipped with a voice recognition engine that realizes a voice assistant function.

[0025] The intercom master unit 21 is connected to a wide area communication network, and may be configured to transmit a notification to a specific information terminal 60 informing the user that a visitor has arrived. Examples of wide area communication networks include an internet line and a telephone line. The intercom master unit 21 may also be configured to transmit information to confirm the safety of a resident to the information terminal 60 under triggerless voice recognition control. The information terminal 60 may be any device capable of receiving information from the intercom master unit 21, and examples include a smartphone, a mobile phone, a tablet terminal, and a personal computer.

[0026] The front door slave unit 22 has a call button for calling the intercom master unit 21. The front door slave unit 22 also has, for example, a camera, a microphone, and a speaker. When the call button is operated, a call is made to the intercom master unit 21 to which the front door slave unit 22 is connected, and the visitor is photographed by the camera of the front door slave unit 22, and the video is transmitted to the intercom master unit 21. The intercom master unit 21 may also be provided with a function for recording video of the visitor.

[0027] The control device 30 is communicatively connected to the lobby intercom device 11 at the shared entrance 10, the intercom master unit 21 in each dwelling unit 20, and the management office master unit 16 in the management room 15, and has the function of controlling these devices. The control device 30 is configured by a computer including a processor and memory. The memory is configured by, for example, RAM, ROM, a hard disk, etc. The control device 30 may be configured by one computer or multiple computers. Also, some or all of the functions of the control device 30 may exist in a device outside the condominium, such as a server 31.

[0028] The configuration of the intercom master unit 21 will be described in detail below with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the intercom master unit 21.

[0029] As shown in Fig. 2, the intercom master unit 21 includes a speaker 40, a microphone 41, a call button 42, and an unlock button 43. When the intercom master unit 21 receives a call signal generated based on a call operation of the lobby intercom device 11 or the front door slave unit 22, it outputs a call sound from the speaker 40. The call button 42 is a button for starting and ending a call with the front door slave unit 22, etc. When a resident presses the call button 42 of the intercom master unit 21, he or she can talk to a visitor, etc. via the lobby intercom device 11 or the front door slave unit 22 that has been called. The unlock button 43 is a button for unlocking the electric lock of the front door 13.

[0030] The intercom master unit 21 is also provided with a monitor 44. Images captured by the cameras of the lobby intercom device 11 and the entrance slave unit 22 are displayed on the monitor 44. The monitor 44 may also display weather-related information such as emergency earthquake alerts, information on the occurrence of abnormalities such as fires, and messages from the management office 15. An example of the monitor 44 is a touch panel monitor. The intercom master unit 21 is provided with a communication interface that receives audio and images captured by the entrance slave unit 22, etc.

[0031] The intercom master unit 21 further includes a setting operation unit 45 for performing various settings. The intercom master unit 21 has, for example, a flat box-shaped housing, and the talk button 42, the unlock button 43, the monitor 44, etc. are provided on the surface of the housing. The setting operation unit 45 may be provided on the surface of the housing like the talk button 42, etc., or may be displayed on the touch panel type monitor 44. In this embodiment, the content and activation conditions of the triggerless voice recognition control are set by the setting operation unit 45. Examples of the setting operation unit 45 include a plurality of buttons, a numeric keypad, a keyboard, etc. displayed on the monitor 44.

[0032] Intercom master unit 21 may be provided with buttons for adjusting the call volume, buttons for adjusting the brightness of monitor 44, buttons for playing recorded video, buttons for performing installation settings, etc. Installation settings may be performed using setting operation unit 45. Intercom master unit 21 may also be connected to a security system installed in dwelling unit 20.

[0033] The intercom master unit 21 includes a control unit 50 for executing calls with the lobby intercom device 11 and the entrance slave unit 22, displaying images captured by the camera, recording images, etc. The control unit 50 is composed of a microcomputer having a processor 51 and a memory 52, and is built into the intercom master unit 21. The memory 52 is composed of, for example, a RAM, a ROM, a hard disk, etc., and stores a control program and various setting information. The processor 51 realizes the functions of each processing unit of the control unit 50 by reading and executing the control program installed in the memory 52.

[0034] The control unit 50 includes a first processing unit 53 that executes processing to output a call sound from the speaker 40 and display an image of the visitor on the monitor 44 when a call signal is received from the lobby intercom device 11 or the front door slave unit 22. When the talk button 42 is pressed, the first processing unit 53 also sets the lobby intercom device 11 or the front door slave unit 22, which are the source of the call signal, in a state in which communication is possible, and transmits a voice signal acquired by the microphone 41 to the device in the communication state. The first processing unit 53 controls the operation of the intercom master unit 21 as a general intercom system.

[0035] The control unit 50 further includes a second processing unit 54, a third processing unit 55, and a fourth processing unit 56 as processing units for executing the voice assistant function and the triggerless voice recognition control function. In this embodiment, all of the configurations for executing the voice assistant function and the like are present in the intercom master unit 21. Specifically, the microphone 41 of the intercom master unit 21 serves as an acquisition unit that acquires sound information, and the speaker 40 serves as an alarm unit that outputs predetermined information such as safety confirmation information.

[0036] When a trigger word is included in the sound information acquired by the microphone 41 and a sound is acquired following the trigger word, the second processing unit 54 executes processing based on the recognition result of the sound. That is, the second processing unit 54 recognizes the trigger word and the voice command from the sound information acquired by the microphone 41, generates a recognition result, and executes a predetermined process based on the result. The intercom master unit 21 is equipped with a voice recognition engine that recognizes the trigger word and the voice command from the acquired sound information.

[0037] The trigger word is a keyword used when activating the voice assistant function, and is generally called a wake word. If the trigger word is not recognized from the sound information, the voice assistant function is not executed. Examples of the trigger word include the name of the intercom system 1, the name of the software of the voice assistant function (or the voice recognition engine), and words preregistered in the system. In addition, the trigger word may be arbitrarily set by the user by operating the setting operation unit 45.

[0038] The scope of application of the voice assistant function may cover all operations that can be performed by operating the intercom master unit 21. Specific examples include starting and ending calls with the lobby intercom device 11 and the front door slave unit 22, unlocking the electric lock on the front door 13, recording and playing back video, and adjusting the call volume. For example, a user can start a call with the front door slave unit 22 by issuing a voice command such as "put on call" after issuing a trigger word to the intercom master unit 21. The scope of application of the voice assistant function may be limited to specific operations, such as operations in a non-call state.

[0039] As described above, the control unit 50 executes triggerless voice recognition control that does not require a trigger word. The control unit 50 first outputs predetermined information from the speaker 40. Then, when the predetermined information is output, the control unit 50 executes predetermined processing based on the sound recognition result acquired after the output of the predetermined information, even if the sound information acquired by the microphone 41 does not include a trigger word. In this embodiment, the predetermined information is output by the function of the third processing unit 55, and processing based on the sound recognition result is executed by the function of the second processing unit 54.

[0040] When a predetermined activation condition is met, the third processing unit 55 causes the speaker 40 of the intercom master unit 21 to output predetermined information. The output of this predetermined information activates triggerless voice recognition control. In this case, the second processing unit 54 executes a predetermined process based on the sound recognition result acquired after the output of the predetermined information, even if the trigger word is not recognized by the voice recognition engine. That is, in this control mode, the output of the predetermined information by the third processing unit 55 serves as a trigger. Then, the user only needs to utter a word that serves as a command to automatically execute the predetermined process.

[0041] The third processing unit 55 may output the predetermined information multiple times when the voice recognition engine does not generate an appropriate recognition result for executing the predetermined process. An upper limit may be set for the number of times the predetermined information is output. Alternatively, an upper limit may be set for the time for outputting the predetermined information. That is, the third processing unit 55 outputs the predetermined information until, for example, the number or time of recognition errors of the voice command by the voice recognition engine exceeds a predetermined threshold. The second processing unit 54 may execute a process different from the process based on the appropriate authentication result when an appropriate recognition result is not generated.

[0042] Examples of activation conditions for outputting predetermined information include authentication of a specific card key by the non-contact key detection device 12 at the shared entrance 10, arrival of a preset time, and acquisition of specific information such as an emergency earthquake alert. Since each card key has identification information, for example, by registering the identification information of a card key held by a child in advance as information for activating the triggerless voice recognition control, the authentication information of the specific card key can be used as the activation condition.

[0043] For example, the third processing unit 55 causes the speaker 40 of the intercom master unit 21 to output predetermined information after a predetermined time has elapsed after a specific card key has been authenticated by the non-contact key detection device 12. At this time, the predetermined information may be output from the speaker of the lobby intercom device 11 or the entrance slave unit 22. The third processing unit 55 may also cause the speaker 40 to output the predetermined information when a preset time has arrived or when specific information such as an emergency earthquake alert has been acquired.

[0044] Examples of the above-mentioned predetermined information include information for confirming the safety of residents, information for managing the activities of residents, etc. Information for confirming safety is output to confirm, for example, whether or not children have returned home, the health of elderly people, and the state of residents when an abnormality such as an earthquake occurs. Information for managing activities is output to confirm, for example, whether or not medication has been taken, health checks have been performed, exercise for rehabilitation, medical equipment has been inspected, and hospital visits have been performed, and in some cases to encourage these actions. In addition, various information to be provided to residents, such as news, weather information, neighborhood information, and announcements about the apartment building, may be output as the predetermined information.

[0045] The above-mentioned predetermined information may be displayed on the monitor 44, but in this case, it is preferable to output a sound from the speaker 40 to notify that the information has been displayed on the monitor 44. It is more preferable that the sound output from the speaker 40 includes voice. The voice may be a synthesized voice preregistered in the intercom master unit 21, or may be a voice recorded by the resident or the like. Furthermore, if the predetermined information is information for confirming safety or information for managing activities, this voice includes an inquiry to the resident. Furthermore, the voice including the inquiry may include guidance on how to respond to the inquiry.

[0046] Examples of voice inquiries include those requiring a response such as "It is now 8 o'clock. Have you taken your blood pressure?" or "What was your blood pressure?". Examples of guidance on how to respond to inquiries include those specifying the response method such as "It is now 8 o'clock. Have you taken your blood pressure? Please answer with yes / no" or "What was your blood pressure? Please answer with your systolic blood pressure and then your diastolic blood pressure." Outputting guidance on how to respond makes it easier for residents to respond and also improves the accuracy of voice recognition.

[0047] In this embodiment, when a voice including an inquiry is output from the speaker 40, the resident's response (sound information) following the voice is acquired by the microphone 41, and a recognition result is generated by the voice recognition engine. The voice recognition engine converts the sound information acquired by the microphone 41 into text, for example, and recognizes a command for executing a predetermined process. This series of processes is executed by the function of the second processing unit 54. The voice recognition engine may be started after the inquiry voice is output, or an electronic sound such as "beep" may be output from the speaker 40 to notify the start of the engine.

[0048] After outputting the voice from the speaker 40, the control unit 50 may record the sound information collected by the microphone 41 regardless of the recognition result of the voice recognition engine. This sound information may be recorded in the memory 52 of the intercom master unit 21, or may be transmitted to at least one of the management office master unit 16, the server 31, and the information terminal 60 and recorded by these devices. This recording function allows, for example, a resident to check the contents of the response. It also allows the manager or the like to check the sound information.

[0049] An example of the above-mentioned predetermined process is, when safety confirmation information is output, outputting safety information receivable by the information terminal 60 using information related to the information terminal 60 that has been registered in advance. The intercom master unit 21 is connected to a wide area communication network such as the Internet or a telephone line, and is therefore capable of transmitting various information to the information terminal 60 such as a smartphone via the wide area communication network. For example, the memory 52 of the intercom master unit 21 stores information related to the information terminal 60, such as an email address, a telephone number, and account information for a predetermined application.

[0050] The second processing unit 54, for example, sends an email including the safety information to a preregistered email address. The safety information included in the email varies depending on the resident's response, i.e., the recognition result generated by the voice recognition engine, and whether or not the recognition result has been generated. In other words, the predetermined processing to be executed varies depending on the presence or absence of the recognition result and its contents. Note that if the recognition result is not generated, for example, no processing is executed depending on the contents of the predetermined information to be output.

[0051] For ease of explanation, the predetermined process executed when a recognition result is generated based on a positive response to predetermined information including an inquiry, indicating that the user has returned home, is in good health, is safe, etc., is referred to as a "first process." On the other hand, the predetermined process executed when a recognition result is generated based on a negative response or when no recognition result is generated is referred to as a "second process."

[0052] The second processing unit 54 ends the triggerless voice recognition control when a predetermined stop condition is met after predetermined information is output from the speaker 40. That is, when the stop condition is met, the second processing unit 54 does not execute processing based on sound information that does not include a trigger word. When the stop condition is met, a trigger word is required to operate the intercom system 1 by voice until the above-mentioned activation condition is met again. By setting a stop condition and automatically ending the triggerless voice recognition control, malfunction of the system can be effectively suppressed.

[0053] The above-mentioned stop condition includes, for example, that the elapsed time since the predetermined information was output exceeds a threshold, or that the number of times the predetermined information is output exceeds a threshold. In general, such a stop condition is established when appropriate voice recognition for executing the first process cannot be performed. The thresholds of the elapsed time and the number of times the information is output are not particularly limited, and may be arbitrarily set by operating the setting operation unit 45. The stop condition may also include whether or not sound information has been recognized, or whether or not a process based on sound information has been performed. When appropriate voice recognition for executing the first process has been performed, such a stop condition is established.

[0054] The intercom system 1 may be provided with at least one of a setting means for setting the content of the above-mentioned predetermined information and a setting means for setting the above-mentioned activation conditions. In this embodiment, the predetermined information and activation conditions can be set by operating the setting operation unit 45. The user can also set the content of the predetermined process executed based on the voice recognition result and the information required for the predetermined process. Note that the intercom system 1 may have several pieces of predetermined information, activation conditions, and predetermined processes preset. Triggerless voice recognition control may be executed based on the content selected by the user from among them.

[0055] The fourth processing unit 56 executes a process for setting the contents of the predetermined information to be output from the speaker 40. For example, when the setting operation unit 45 is operated, the fourth processing unit 56 stores the predetermined information and the contents of the predetermined process input by the operation in the memory 52. ​​The fourth processing unit 56 also executes a process for setting the start-up conditions. For example, when the setting operation unit 45 is operated, the fourth processing unit 56 stores the contents of the start-up conditions input by the operation in the memory 52. ​​The first processing unit 53 and the second processing unit 54 read out the setting information from the memory 52 and execute triggerless voice recognition control.

[0056] Hereinafter, a control procedure (operation) of the intercom system 1 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of trigger-less voice recognition control.

[0057] In summary, triggerless voice recognition control includes a first step of outputting predetermined information and a second step of acquiring sound information after the predetermined information is output. In the second step, a predetermined process is executed based on the recognition result of the sound acquired after the predetermined information is output, even if the sound information does not include a trigger word. A control program for realizing triggerless voice recognition control by a computer is stored in memory 52 of intercom master unit 21.

[0058] As shown in Fig. 3, when a predetermined activation condition is satisfied, triggerless voice recognition control is started (S1). In S1, it is determined whether the activation condition for triggerless voice recognition control is satisfied. The activation condition is satisfied, for example, when a pre-specified target person is detected at the shared entrance 10 or the like. The method of detecting the target person is not particularly limited, and examples include a method of detecting from authentication information of a card key by the non-contact key detection device 12, and a method of detecting from face authentication information of a camera installed at the shared entrance 10 or the like. The activation condition may also be satisfied when a preset time is reached or when specific information such as an emergency earthquake alert is acquired.

[0059] If it is determined in S1 that the activation condition is met, predetermined information such as information for confirming safety, information for managing activities, etc. is output (S2). The predetermined information may be video or text information output to monitor 44 of intercom master unit 21, but is preferably output as audio information from speaker 40. In this embodiment, the predetermined information is output from intercom master unit 21 to the resident in the room of dwelling unit 20, but the predetermined information may also be output from lobby intercom device 11 or entrance slave unit 22.

[0060] When the predetermined information is output in S2, a voice command is recognized from the sound information acquired thereafter, and a recognition result is generated (S3). The voice command in S3 is an instruction for executing the process of S4. A voice recognition engine mounted in the intercom master unit 21 converts the acquired sound information into text and recognizes the voice command (generation of recognition result). The sound information is acquired by the microphone 41 of the intercom master unit 21, but if the sound information cannot be acquired or if the appropriate voice command cannot be recognized, the recognition result is not generated. In that case, the process may return to S2 and output the predetermined information again.

[0061] In S3, even if the sound information acquired by the microphone 41 does not include a trigger word, a recognition result of the sound information is generated. In contrast, in the case of control by a voice assistant function in which S2 does not exist, a recognition result of the sound information is generated only when the sound information acquired by the microphone 41 includes a trigger word. In other words, in the case of control by the voice assistant function, if the trigger word is not recognized, a recognition result of the sound information is not generated. In S3, a recognition result of the sound information is generated regardless of whether or not the trigger word is recognized.

[0062] If an appropriate recognition result is generated in S3, a first process is executed based on the recognition result (S4). An example of the first process in S4 is to send a notification that the resident is safe to a pre-registered email address or the like when safety confirmation information is output in S2. On the other hand, if an appropriate recognition result is not generated in S3, a second process different from the process in S4 is executed (S5). An example of the second process in S5 is to send a notification that there is no response from the resident to a pre-registered email address or the like.

[0063] When the second process is executed, it may be possible to call the intercom master unit 21 from the information terminal 60. The intercom system 1 may be configured, for example, to call the intercom master unit 21 from the information terminal 60 and enable a call with the intercom master unit 21 even if the call button 42 is not pressed. The second process may also be a process of calling the information terminal 60 from the intercom master unit 21 and enabling a call with the intercom master unit 21. Such a call function may be activated only when the second process is executed. Software for realizing this call / call function may be installed in the intercom master unit 21 and the information terminal 60.

[0064] A resident outside the dwelling unit 20 can, for example, call the intercom master unit 21 from the information terminal 60 or respond to a call from the intercom master unit 21 to output a sound from the speaker 40 of the intercom master unit 21 into the room of the dwelling unit 20. In addition, if a security system is connected to the intercom master unit 21, it may be possible to access the security system from the information terminal 60 via the intercom master unit 21 and check the state of the room inside the dwelling unit 20.

[0065] After the predetermined information is output in S2, when a predetermined stop condition is satisfied, the triggerless voice recognition control is terminated (S6). When the stop condition is satisfied, a trigger word is required for subsequent voice control of the intercom system 1. The stop condition is satisfied, for example, when the elapsed time since the predetermined information was output exceeds a threshold value, or when the number of times the predetermined information is output exceeds a threshold value. Alternatively, the stop condition is satisfied when sound information is recognized, or when control based on sound information is executed.

[0066] When the process proceeds from S3 to S5, the trigger-less voice recognition control may be continued until a manual stop operation is performed. The manual stop operation can be performed by operating the intercom master unit 21, for example.

[0067] Hereinafter, a specific example of trigger-less voice recognition control will be described with reference to Fig. 4 to Fig. 7. Fig. 4 and Fig. 5 are diagrams showing an example of trigger-less voice recognition control for confirming that a child has returned home.

[0068] 4 and 5, triggerless voice recognition control is started when a child's return is detected at the shared entrance 10 (S11). Specifically, the child's return is detected at the shared entrance 10 when the card key held by the child is authenticated by the non-contact key detection device 12, or when the child's face is recognized from an image captured by the camera of the lobby intercom device 11 or a surveillance camera installed at the shared entrance 10. The intercom system 1 starts triggerless voice recognition control, for example, when a process to unlock the electric lock of the entrance door 13 is performed and it is determined that the process was initiated by a child.

[0069] When a child's return home is detected at the common entrance 10 based on authentication information of the card key or the like, safety (return home) confirmation information is output after a predetermined time has elapsed since the detection to confirm that the child has arrived safely inside the dwelling unit 20 (S12, S13). The return home confirmation information includes a voice inquiry requiring a response, such as "Please respond when XX-chan gets home," and is output from the speaker 40 of the intercom master unit 21. The predetermined time in S12 is determined, for example, taking into consideration the time it takes to arrive at the dwelling unit 20 from the common entrance 10.

[0070] The inquiry to confirm the child's return may be output multiple times at predetermined intervals after the predetermined time has elapsed. The voice of the inquiry may be a synthesized voice or a voice recorded by the resident. The voice of the inquiry may also include a guide on how to respond, such as "When XX-chan gets home, please respond with 'I'm home.'" Alternatively, when the child's return is detected at the shared entrance 10 or after the predetermined time has elapsed, a notification of the child's return may be sent from the intercom system 1 to the information terminal 60, so that the information terminal 60 can make an inquiry to confirm the child's return in real time.

[0071] When a voice inquiry as to whether or not the child has returned home is output from the speaker 40 of the intercom master unit 21, a voice command is recognized from the sound information acquired by the microphone 41 thereafter, and a recognition result is generated (S14). In S14, even if the acquired sound information does not contain a trigger word, a recognition result for the sound information is generated. In other words, when a child who has returned home hears the voice inquiry as to whether or not the child has returned home output from the speaker 40, and responds by saying "I'm home," indicating that the child has returned home, the response is recognized as a voice command for executing the process described below, even if it does not contain a trigger word.

[0072] When a response indicating that the user has returned home is given and voice recognition is performed, the control unit 21 outputs information to confirm that the user has returned home (S15). Specifically, the control unit 21 uses information related to the information terminal 60, such as an email address, a telephone number, and account information for a specific application, stored in the memory 52 of the intercom master unit 21, to output a notification that can be received by the information terminal 60, such as sending an email including the information to the email address. The intercom master unit 21 may record a response to the inquiry for confirmation of the user's return home and output the response as the information to confirm that the user has returned home. When a response indicating that the user has returned home is recognized or when the information to confirm that the user has returned home is output, the control unit 21 terminates the triggerless voice recognition control, assuming that a specific stop condition has been met.

[0073] On the other hand, if the response indicating the return home is not recognized, the device outputs unconfirmed return home information, such as by sending an email including the unconfirmed return home information to the registered email address (S16). In this case, the information terminal 60 may call the intercom master unit 21, enabling a call with the intercom master unit 21. Alternatively, in S16, instead of or in addition to outputting the unconfirmed return home information, the intercom master unit 21 may call the information terminal 60, enabling a call with the intercom master unit 21, and access to the security system from the information terminal 60 may be permitted.

[0074] In this case, a resident outside the dwelling unit 20 can have a voice prompting a response output from the speaker 40 of the intercom master unit 21 into the dwelling unit 20. In addition, the resident can access the security system from the information terminal 60 and check the state of the interior of the dwelling unit 20 using the security system's camera. When a response indicating the return of the resident is recognized from the output of the voice prompting a response, or when return of the resident confirmation information is output, it is determined that a predetermined stop condition is met and the triggerless voice recognition control is terminated. On the other hand, if a response indicating the return of the resident is still not recognized, the triggerless voice recognition control may be continued until a manual stop operation is performed.

[0075] 6 and 7 are diagrams illustrating an example of triggerless voice recognition control for confirming taking of medicine.

[0076] In the examples shown in Fig. 6 and Fig. 7, when the current time reaches a preset time, triggerless voice recognition control is started (S21). Intercom master unit 21 has information on the current time and the preset time, and when the two times match, outputs activity management information for confirming whether or not the medicine has been taken, such as "Have you taken your medicine?" (S22). This activity management information is a voice inquiry that requires a response as to whether or not the medicine has been taken, and is output from speaker 40 of intercom master unit 21. The voice inquiry may include guidance on how to respond, such as "Have you taken your medicine? Please answer yes / no."

[0077] The inquiry about taking medicine may be output multiple times at predetermined intervals until a voice response is recognized. Also, when the current time reaches a preset time, information on the time of taking medicine may be transmitted from the intercom system 1 to the information terminal 60, and the information terminal 60 may be configured to make an inquiry in real time. In addition to or instead of the inquiry about taking medicine, an inquiry about health conditions including whether or not a drug injection or rehabilitation exercises have been performed, blood pressure and blood glucose measurement results, etc. may be made according to the needs of the resident. Such settings may be made by the resident or by a care worker such as a care manager.

[0078] When a voice inquiry about whether or not the medicine has been taken is output from speaker 40 of intercom master unit 21, a voice command is recognized from the sound information acquired by microphone 41 thereafter, and a recognition result is generated (S23). In S23, even if the acquired sound information does not contain a trigger word, a recognition result for the sound information is generated. For example, if an elderly person who should take medicine hears the voice inquiry about whether or not the medicine has been taken output from speaker 40 and responds by saying, "I took it," indicating that the medicine has been taken, the response is recognized as a voice command for executing the process described below, even if it does not contain a trigger word.

[0079] When a response indicating that the medicine has been taken is given and voice recognition is performed, taking confirmation information is output (S24). At this time, a list (taking history) summarizing the number of times the medicine has been taken, the taking time, etc. may be created and stored in memory 52, etc., and this list may be output as the taking confirmation information. Intercom master unit 21 outputs a notification that can be received by information terminal 60, for example, by sending an email including the taking confirmation information to a registered email address. When a response indicating that the medicine has been taken is recognized or when the taking confirmation information is output, it is considered that a predetermined stop condition has been met, and the triggerless voice recognition control is terminated.

[0080] On the other hand, if a response indicating that the medicine has been taken is not recognized, unconfirmed information is output, such as by sending an email containing unconfirmed information to the registered email address (S25). If a response indicating that the medicine has not been taken, such as "I haven't taken it yet," is given in S23 and voice recognition is performed, unconfirmed information is output, and a voice urging the user to take the medicine, such as "Please take your medicine as soon as possible," may be output from the speaker 40 of the intercom master unit 21.

[0081] If the voice recognition engine does not recognize the response, the sound information collected by the microphone 41 at that time may be acquired. For example, the intercom master unit 21 outputs an inquiry about whether the medicine has been taken, and then records the sound information collected by the microphone 41. The intercom master unit 21 may also transmit the recorded sound information to at least one of the management office master unit 16, the server 31, and the information terminal 60. In particular, in the case of elderly people, it is expected that the content of the speech will not be recognized by the voice recognition engine, but if the sound information is recorded, the manager or the like can listen to the sound information and check whether the medicine has been taken, the resident's situation, etc.

[0082] Furthermore, if there is no response in S23 and no voice recognition result is generated, unconfirmed medication information may be output, and the information terminal 60 may call the intercom master unit 21 to enable a call with the intercom master unit 21. Alternatively, in S25, instead of or in addition to outputting the unconfirmed medication information, the intercom master unit 21 may call the information terminal 60 to enable a call with the intercom master unit 21, or access to the security system may be permitted from the information terminal 60. If there is no response, it is assumed that an abnormality has occurred in the resident's health, and by enabling such a response, the abnormality of the resident can be quickly identified.

[0083] As described above, according to the intercom system 1, by issuing a voice command following a trigger word, various operations can be performed on the intercom master unit 21. Furthermore, by outputting voice inquiries such as safety confirmation information and activity management information from the speaker 40 of the intercom master unit 21, it is possible to, for example, confirm that children have returned home, manage the health of elderly people, and confirm the safety of residents in the event of an earthquake, etc.

[0084] When a resident hears the voice inquiry, they only need to respond in accordance with the inquiry, and the specified process will be automatically executed by the intercom system 1. There is no need to utter a trigger word in this case. In other words, by using the nearby intercom system 1, it is possible to quickly watch over children or elderly people, check on the safety of residents, and so on, with a simple voice response that does not require a trigger word.

[0085] Furthermore, in the intercom system 1, the contents of the triggerless voice recognition control, including the predetermined information to be output from the speaker 40, the activation conditions for outputting the predetermined information, and the predetermined processing to be executed in response to the resident's response, can be arbitrarily set according to the needs of each user. Residents, etc. can easily set and change these contents by operating the setting operation unit 45.

[0086] In today's world where user needs and lifestyles are becoming more diverse, the intercom system 1 can be an extremely useful, convenient, and user-friendly system.

[0087] The above embodiment may be appropriately modified in design without impairing the object of the present disclosure. For example, in the above embodiment, the voice recognition engine is mounted on the intercom master unit 21, but the voice recognition engine may be mounted on the control device 30, the lobby intercom unit 11, the entrance slave unit 22, the server 31, or another device connected to the intercom system 1 so as to be able to communicate with the intercom system 1.

[0088] In addition, in the above-mentioned triggerless voice recognition control, a voice inquiry requesting a response is output as the predetermined information, but information not requesting a response may also be output. Examples of information not requesting a response include various types of information, such as news of a genre preset by the resident, information on new product releases, sales, weather information, the schedule for the day, and announcements about the apartment. When such information is output, for example, a voice command requesting the transmission of information, such as "email that information," or a voice command requesting additional information, such as "what's the weather tomorrow?" can be issued to execute the desired process without a trigger word. [Explanation of symbols]

[0089] 1 Intercom system, 10 Shared entrance, 11 Lobby intercom device, 12 Non-contact key detection device, 13 Entrance door, 14 Lock device, 15 Management room, 16 Management office master unit, 17 Switch, 20 Residence, 21 Intercom master unit, 22 Entrance slave unit, 30 Control device, 31 Server, 32 Gateway, 40 Speaker, 41 Microphone, 42 Talk button, 43 Unlock button, 44 Monitor, 45 Setting operation unit, 50 Control unit, 51 Processor, 52 Memory, 53 First processing unit, 54 Second processing unit, 55 Third processing unit, 56 Fourth processing unit, 60 Information terminal

Claims

1. An acquisition unit that acquires sound information within a facility; a notification unit that outputs predetermined information within the facility; a control unit that, when a trigger word is included in the sound information acquired by the acquisition unit and a sound is acquired following the trigger word, executes a process based on a recognition result of the sound; Equipped with The predetermined information includes a voice of an inquiry to a person in the facility and guidance on how to respond to the inquiry, An intercom system in which, when the specified information is output by the alarm unit, the control unit executes a specified processing based on the sound recognition result obtained after the output of the specified information, even if the sound information does not include the trigger word.

2. 2. The intercom system according to claim 1, further comprising a first setting means for setting the content of said predetermined information.

3. a second setting means for setting a start condition for outputting the predetermined information; The intercom system according to claim 1 , wherein the notification unit outputs the predetermined information when the activation condition is satisfied.

4. An intercom system as described in any one of claims 1 to 3, wherein the control unit does not execute processing based on the sound information that does not include the trigger word when a specified stop condition is met after the specified information is output by the alarm unit.

5. The intercom system according to claim 4 , wherein the stop condition includes a condition in which an elapsed time since the predetermined information was output exceeds a threshold, or a condition in which the number of times the predetermined information is output exceeds a threshold.

6. The intercom system according to claim 4 or 5, wherein the stop condition includes that the sound information has been recognized or that a process based on the sound information has been executed.

7. A control method applied to an intercom system configured to execute a process based on a recognition result of a sound when a trigger word is included in sound information and a sound is acquired following the trigger word, comprising: outputting predetermined information including a query to persons within the facility and instructions on how to respond to said query; a step of acquiring the sound information after the predetermined information is output, and a step of executing a predetermined process based on a sound recognition result acquired after the predetermined information is output even if the sound information does not include the trigger word; A control method comprising:

8. A control program for implementing the control method according to claim 7 on a computer.

Citation Information

Patent Citations

  • Cat type conversation robot

    JP2019061111A

  • Interaction system control method, interaction system and program

    JP2020003925A

  • Intercom system, processing method, and program

    JP2020078036A

  • Method, controller and program

    JP2020112692A

  • Information processing device, information processing method, and program

    WO2020158435A1