Information terminal, intercom system, control method, and computer program product

Abstract

The objective of this disclosure is to improve user convenience while reducing power consumption. The information terminal (10) disclosed herein includes a first voice recognition unit (1821), a second voice recognition unit (1822), and a control processing unit (183). The first voice recognition unit (1821) identifies whether the sound input to the microphone (131) contains a trigger word. The second voice recognition unit (1822) identifies the sound input to the microphone (131) as a control command. The control processing unit (183) performs control based on the control command identified by the second voice recognition unit (1822). When a trigger word is identified by the first voice recognition unit (1821), the second voice recognition unit (1822) is activated.

Description

Technical Field

[0001] This disclosure generally relates to an information terminal, a walkie-talkie system, a control method and program, and more specifically, to an information terminal that functions as a walkie-talkie device, a walkie-talkie system equipped with the information terminal, and a control method and program for the information terminal. Prior Technology

[0002] Previously, an intercom system for use in apartment buildings was known (for example, see Japanese Patent Application Publication No. 2004-64249, hereinafter referred to as "Document 1"). The intercom system of Document 1 includes an intercom set in the lobby of the common entrance hall of the apartment building, an intercom set in each unit, and a video doorbell set in the outdoor area (entrance hall) of each unit.

[0003] In this type of intercom system, visitors use the lobby intercom to call the intercom master unit. Residents then initiate a conversation between the lobby intercom and the intercom master unit by performing the prescribed operations on the intercom master unit according to the call. The same applies when calling the intercom master unit from a video doorbell; residents then initiate a conversation between the video doorbell and the intercom master unit by performing the prescribed operations on the intercom master unit according to the call. Summary of the Invention

[0004] In the information terminal similar to the walkie-talkie master unit in Reference 1, it is hoped that user convenience can be improved while power consumption can be reduced.

[0005] This disclosure was made in view of the above-mentioned issues, and aims to provide an information terminal, walkie-talkie system, control method and program that can improve user convenience and reduce power consumption.

[0006] The information terminal disclosed herein includes a first voice recognition unit, a second voice recognition unit, and a control processing unit. The first voice recognition unit identifies whether the sound input to the microphone contains a trigger word. The second voice recognition unit identifies the sound input to the microphone as a control command. The control processing unit performs control based on the control command identified by the second voice recognition unit. When the trigger word is identified by the first voice recognition unit, the second voice recognition unit is activated.

[0007] The information terminal disclosed herein includes a voice recognition unit and a control processing unit. The voice recognition unit recognizes whether the sound input to the microphone contains a trigger word and a control command. The control processing unit performs control based on the control command recognized by the voice recognition unit. The control processing unit is activated either when the trigger word is recognized by the voice recognition unit or when the control command is recognized by the voice recognition unit.

[0008] The walkie-talkie system disclosed herein includes the aforementioned information terminal and other terminals for communication including calls with the aforementioned information terminal.

[0009] The control method disclosed herein is a control method for an information terminal. The control method includes a first voice recognition step, a startup step, a second voice recognition step, and a control processing step. The first voice recognition step includes using a first voice recognition unit to perform voice recognition processing on the sound input to the microphone to determine whether it contains a trigger word. The startup step includes activating the second voice recognition unit when the first voice recognition step identifies the trigger word. The second voice recognition step includes using the second voice recognition unit to perform voice recognition processing on the sound input to the microphone to receive a control command. The control processing step includes performing control based on the control command identified in the second voice recognition step.

[0010] The control method disclosed herein is a control method for an information terminal. The control method includes a voice recognition step, a startup step, and a control processing step. The voice recognition step includes using a voice recognition unit to perform voice recognition processing on the sound input to the microphone to determine whether it contains a trigger word and to perform voice recognition processing on a control command. The startup step includes starting the control processing unit when the voice recognition step recognizes the trigger word, or when the voice recognition step recognizes the control command. The control processing step includes using the control processing unit to perform control based on the control command recognized in the voice recognition step.

[0011] The state-mode program disclosed herein is a program used to cause one or more processors to execute the above-described control method. Simple Explanation of the Diagram

[0012] Figure 1 is a block diagram of an information terminal in one implementation form. Figure 2 is a block diagram of a walkie-talkie system that includes the same information terminal as above. Figure 3 is a diagram illustrating the connection relationship of the main parts of the information terminal as described above. Figure 4 is a front view of the information terminal as above. Figure 5 is a diagram illustrating the processing of the same information terminal in standby mode. Figure 6 is a diagram illustrating the processing of the sound recognition trigger word state in the standby state of the same information terminal. Figure 7 is a diagram illustrating the processing during a call in the same information terminal as above. Figure 8 is a diagram illustrating the processing of the same information terminal during a call. Figure 9 is a flowchart of the control method for the information terminal as described above. Figure 10 is a diagram illustrating the processing of the information terminal in call state in Variation Example 1. Figure 11 is a block diagram of the main parts of the information terminal in Variation Example 2. Figure 12 is a flowchart of the control method of the information terminal as described above. Implementation

[0013] The implementation forms and variations described below are merely examples of this disclosure, and this disclosure is not limited to these implementation forms and variations. Even outside of the implementation forms and variations described below, various changes can be made according to the design, etc., as long as they do not depart from the technical concept of this disclosure.

[0014] (1) Summary The information terminal 10 of this embodiment (see Figure 1) is generally applied to the walkie-talkie system 1 as shown in Figure 2. The walkie-talkie system 1 is applied, for example, to a multi-family residential building 5 such as an apartment. The walkie-talkie system 1 of this embodiment includes the information terminal 10. In this embodiment, the walkie-talkie system 1 includes a plurality of information terminals 10 (two in Figure 2) that each function as a walkie-talkie device. The walkie-talkie system 1 further includes a front hall walkie-talkie 20 (other terminals), a control device 30, and a plurality of (two in Figure 2) entryway handsets 40 (other terminals).

[0015] In the intercom system 1, each of the plurality of information terminals 10 communicates with the lobby intercom 20 via a control device 30. Furthermore, in the intercom system 1, each of the plurality of information terminals 10 corresponds one-to-one with each of the plurality of entryway handsets 40. Additionally, the intercom system 1 of this embodiment can be applied not only to apartment buildings 5, but also to, for example, detached houses. Alternatively, the intercom system 1 can also be applied to non-residential facilities such as offices, shops, schools, or nursing homes.

[0016] In other words, the walkie-talkie system 1 can be applied to facilities or complexes. If "facility" is "residential," it corresponds to the residents of detached houses or complex 5. If it is "non-residential," it can correspond to offices, shops, schools, or nursing facilities, etc. Furthermore, a "complex facility" can be a complex 5 where multiple residents (private units) gather, or a non-residential complex facility where multiple offices or shops (private units) gather, or a complex facility where the lower floor is a non-residential unit and the upper floor is a complex residential unit.

[0017] Each of the plurality of information terminals 10 may be, for example, a resident terminal (intercom master unit) installed in each of the plurality of households E2 contained in the apartment building 5. It is assumed that each information terminal 10 functions as a resident information panel, for example, as a room master unit installed in each household E2.

[0018] Each information terminal 10 is connected to the control device 30 via the second trunk line 62, branch line 63, and splitter 50. Each information terminal 10 is configured to communicate with the front hall intercom 20 via the control device 30 (e.g., making calls and sending control signals). Furthermore, each information terminal 10 is connected to a corresponding entryway sub-unit 40 via a connecting cable 64. Each information terminal 10 is configured to communicate with its corresponding entryway sub-unit 40 (e.g., making calls and sending control signals).

[0019] A lobby intercom 20 is installed, for example, in the common entrance hall (lobby) E1 of the apartment building 5. The lobby intercom 20 is connected to the control device 30 via a first main line 61. The lobby intercom 20 is configured to communicate (e.g., make calls and transmit video signals) with each information terminal 10 via the control device 30. The lobby intercom 20 is installed, for example, on the wall of the common entrance hall E1. Video signals are transmitted from the lobby intercom 20 to the information terminal 10, and the information terminal 10 can display the video (image).

[0020] The control device 30 is, for example, located in the management office E3 of the apartment building 5. The control device 30 is connected to the lobby intercom 20 via a first trunk line 61 and to each information terminal 10 via a second trunk line 62. That is, the control device 30 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

[0021] Multiple entryway sub-units 40 are installed, for example, in the entryway outside unit E2 of apartment building 5. Each entryway sub-unit 40 is connected to a corresponding information terminal 10 via a connecting cable 64. Each entryway sub-unit 40 is configured to communicate with the corresponding information terminal 10 (e.g., making calls, transmitting video signals, etc.).

[0022] In this embodiment, the first trunk line 61, the second trunk line 62, the branch line 63, and the connecting line 64 are all twisted-pair cables. That is, in reality, the first trunk line 61, the second trunk line 62, the branch line 63, and the connecting line 64 are composed of two wires, but are represented by one line in the diagram. At least one of the first trunk line 61, the second trunk line 62, the branch line 63, and the connecting line 64 may be a wire other than a twisted-pair cable.

[0023] The information terminal 10 of this embodiment acquires the voice of a resident (hereinafter referred to as "user") in household E2 and performs voice recognition on the acquired voice. As shown in FIG1, the information terminal 10 of this embodiment includes a sound acquisition unit 13 and a voice recognition unit 182. The sound acquisition unit 13 acquires the sound including the user's voice. The sound acquisition unit 13 acquires the sound input to the microphone 131. The sound acquisition unit 13 has a microphone 131 here. It is assumed that the microphone 131 is located in the information terminal 10 itself. However, the microphone 131 is located in a device different from the information terminal 10 (such as a smartphone, tablet terminal, wearable terminal, etc., a portable terminal), and the information terminal 10 can also communicate with different devices and acquire the user's voice. The voice recognition unit 182 performs voice recognition on the sound input to the microphone 131 (the sound acquired by the sound acquisition unit 13). Specifically, the sound recognition unit 182 recognizes the sound input to the microphone 131 as sound related to the control commands performed by the control processing unit 183.

[0024] Furthermore, the information terminal 10 performs operation-related controls related to the walkie-talkie system 1 based on the results of voice recognition. As shown in FIG1, the information terminal 10 includes a control processing unit 183. The control processing unit 183 performs control based on the control commands recognized by the voice recognition unit 182.

[0025] In summary, the information terminal 10 is configured to be voice-operable. For example, if it is determined (through voice recognition) that the voice of a user in resident E2 contains a keyword (command word) for controlling the opening and closing of the entrance door 200 (door) located in the common entrance hall E1 (i.e., voice recognition of the command word is successful), the information terminal 10 performs control corresponding to the command word. Specifically, when the voice recognition unit 182 detects "unlock" as a control command, the information terminal 10 performs unlocking control for opening the electric lock 201 of the entrance door 200 (see Figure 2). Here, the entrance door 200 is configured to be opened and closed by the electric lock 201 (see Figure 2).

[0026] Thus, by enabling voice operation through the information terminal 10, user convenience can be improved.

[0027] In the information terminal 10 of this embodiment, when the acquired user's voice contains a specified keyword (command word), the voice recognition unit 182 determines whether the acquired user's voice contains a control command. Specifically, when determining whether the acquired user's voice contains a trigger word (voice recognition), and determining that it contains a trigger word, the voice recognition unit 182 determines whether the user's voice acquired after the trigger word contains a keyword (command word) of a control command (voice recognition). Furthermore, for the user's voice acquired after the trigger word, when the voice recognition unit 182 identifies the command word, the control processing unit 183 performs control corresponding to the control command corresponding to the identified command word. In particular, in the voice recognition unit 182 of this embodiment, the determination of whether the user's voice contains a command word is only performed when the acquired user's voice contains a trigger word or the like (described later). In this way, for example, even if a user accidentally utters a command word during a daily conversation and the microphone 131 picks up the sound, it prevents unintentional control actions that correspond to the control command.

[0028] Furthermore, in the information terminal 10 of this embodiment, as shown in FIG1, the voice recognition unit 182 includes a first voice recognition unit 1821 and a second voice recognition unit 1822. The first voice recognition unit 1821 performs voice recognition on the sound input to the microphone 131 to determine whether it contains a trigger word. The second voice recognition unit 1822 performs voice recognition on the sound input to the microphone 131 to identify control commands. In the information terminal 10 of this embodiment, the second voice recognition unit 1822, which performs voice recognition for control commands, and the first voice recognition unit 1821, which performs voice recognition for trigger words, are separate (independent circuits) (see FIG3). Moreover, when the trigger word is identified by the first voice recognition unit 1821, the second voice recognition unit 1822 is activated.

[0029] Thus, in the information terminal 10 of this embodiment, the second voice recognition unit 1822 is activated when the first voice recognition unit 1821 recognizes a trigger word (i.e., when the voice recognition of the trigger word by the first voice recognition unit 1821 is successful). In other words, the second voice recognition unit 1822 stops operating except under specified conditions such as when the first voice recognition unit 1821 recognizes a trigger word. For example, in a comparative example of an information terminal that has both a voice recognition unit that performs voice recognition of trigger words and a voice recognition of instruction words integrated into one circuit, the entire voice recognition unit needs to be constantly activated in advance in order to wait for a trigger word. In contrast, in the information terminal 10 of this embodiment, only the first voice recognition unit 1821 that performs voice recognition of trigger words can be constantly activated. Therefore, in the information terminal 10 of this embodiment, the power consumption of the voice recognition unit 182 can be reduced. Furthermore, it can effectively prevent the user from accidentally uttering commands that correspond to control instructions.

[0030] In this embodiment, as an example, it is assumed that the information terminal 10 is a resident terminal (intercom master unit). However, it is not limited to this; the information terminal 10 can also be, for example, a lobby intercom 20 or an entrance hall sub-unit 40. Furthermore, the information terminal 10 can also be, for example, the master unit in the manager's room included in the intercom system 1.

[0031] (2) Details (2-1) Information Terminal As shown in Figure 1, the information terminal 10 includes a first communication unit 11, a second communication unit 12, a sound acquisition unit 13, an operation unit 14, a sound output unit 15, a display unit 16, a memory unit 17, a processing unit 18, and a third communication unit 19. The information terminal 10 further includes a housing 100 (see Figure 4) that holds the first communication unit 11, the second communication unit 12, the sound acquisition unit 13, the operation unit 14, the sound output unit 15, the display unit 16, the memory unit 17, the processing unit 18, and the third communication unit 19.

[0032] The information terminal 10 has, for example, a computer system with a processor and memory. Furthermore, the computer system functions as a processing unit 18 by executing programs stored in memory through the processor. The programs executed by the processor are pre-recorded in the computer system's memory, but can also be recorded on non-temporary recording media such as memory cards, or provided via electrical communication lines such as the Internet.

[0033] The first communication unit 11 is a communication interface used for communication with the front hall intercom 20 (communication unit 21). The first communication unit 11 is connected to the control device 30 via the second trunk line 62, branch line 63, and splitter 50. The first communication unit 11 transmits audio signals and control signals to the front hall intercom 20 via the control device 30. Furthermore, the first communication unit 11 receives call signals, audio signals, and video signals from the front hall intercom 20 via the control device 30.

[0034] The second communication unit 12 is a communication interface used for communication with external devices (here, server 70). The second communication unit 12 is connected to server 70 via network NT1. The second communication unit 12 can receive various information from server 70. Furthermore, control device 30 is connected to network NT1 and server 70 via gateways, etc., and information terminal 10 can also be connected to server 70 via branch line 63 and control device 30.

[0035] The third communication unit 19 is a communication interface used to communicate with the entryway sub-unit 40. The third communication unit 19 is connected to the entryway sub-unit 40 via a connecting cable 64. The third communication unit 19 sends voice signals and control signals to the entryway sub-unit 40, and receives call signals, voice signals, and video signals from the entryway sub-unit 40.

[0036] The information terminal 10 can obtain at least three operational states based on its communication status with the front hall intercom 20 and the entryway sub-unit 40. The operational states obtainable by the information terminal 10 in this embodiment include a calling state, a talking state, and a standby state. The operational states obtainable by the information terminal 10 in this embodiment further include a mode operation state. The calling state is the state of receiving a call signal from the front hall intercom 20 or the entryway sub-unit 40 and receiving a call. The talking state is the state of establishing communication by talking with the front hall intercom 20 or the entryway sub-unit 40. The mode operation state is the state of executing a prescribed operation mode. An example of a "prescribed operation mode" is an operation mode for crime prevention, an operation mode for door monitor confirmation, and an operation mode for video playback. The standby state is a state that is neither a talking state, a calling state, nor a mode operation state.

[0037] Furthermore, regarding the actions of controlling machines such as air conditioners and the actions of scene control, as described later, for the information terminal 10, these are instantaneous actions that send instruction signals to the outside for control. The likelihood of maintaining these actions for a longer period (e.g., more than one minute) is low. However, when the actions of controlling machines such as air conditioners and the actions of scene control are performed for a longer period for the information terminal 10, they can also be equivalent to the aforementioned mode of action. For example, when scene control includes a mode for playing video recordings, the scene control (video playback) mode can also be the mode specified above.

[0038] Furthermore, for convenience, the terminals that can communicate with the information terminal 10, including making calls (here, the front hall intercom 20 and the entrance sub-unit 40) will be referred to as "other terminals". Additionally, the terminals that can communicate with the information terminal 10, including making calls (other terminals), can also be the administrator's office main unit.

[0039] The sound acquisition unit 13 acquires at least the sound including the user's voice and outputs the acquired sound information (sound data) to the processing unit 18. The sound acquisition unit 13 is equipped with a microphone 131. The sound acquisition unit 13 converts the ambient sound including the user's voice (sound) input to the microphone 131 and located in front of the information terminal 10 into an sound signal (sound information) and outputs it to the processing unit 18.

[0040] The sound output unit 15 includes a speaker 151. When the information terminal 10 is in a state where it can communicate with the lobby intercom 20 (communication state), the speaker 151 outputs sound (including the voice of visitors, etc.) based on the sound signal (sound data) sent from the lobby intercom 20. When the information terminal 10 is in a state where it can communicate with the entryway sub-unit 40 (communication state), the speaker 151 outputs sound (including the voice of visitors, etc.) based on the sound signal (sound data) sent from the entryway sub-unit 40. Furthermore, depending on the status of the information terminal 10, the speaker 151 outputs, for example, various sound messages or electronic sounds stored in the memory unit 17.

[0041] The sound acquisition unit 13 includes a microphone 131. Here, the sound acquisition unit 13 includes a first microphone 1311 and a second microphone 1312 as two microphones 131.

[0042] As shown in Figure 4, the first microphone 1311 and the second microphone 1312 are respectively positioned on the upper left and right sides of the housing 100 of the information terminal 10 when viewed from the front. The first microphone 1311 and the second microphone 1312 are separately configured. Here, the first microphone 1311 is located further away from the speaker 151 than the second microphone 1312. In other words, the first microphone 1311 is a remote microphone.

[0043] In this embodiment, the information terminal 10, for example, serves as voice data for calls. When communicating with other terminals (front hall intercom 20 or entryway handset 40), it utilizes the user's voice input to the first microphone 1311. The voice input to the first microphone 1311 undergoes voice processing for calls primarily in the call processing unit 185 (the second voice processing unit 1851) of the processing unit 18, and is then sent to the other terminal in the call. That is, by utilizing the voice data for calls from the remote first microphone 1311 instead of the second microphone 1312, the echo of the visitor's voice output from the speaker 151 is suppressed from reverberating in the microphone 131.

[0044] On the other hand, the information terminal 10 in this embodiment, for example, uses the user's voice input to the first microphone 1311 and the second microphone 1312 as sound data for voice recognition. In particular, the processing unit 18 (the first sound processing unit 181) has a function of performing beamforming related to improving the directionality of sound reception using the two microphones 131. The processing unit 18 estimates the direction from which the user speaks to the information terminal 10 based on the user's voice input from the first microphone 1311 and the second microphone 1312, and performs processing to improve the sensitivity to sound signals from the specified direction based on the estimation result.

[0045] The operation unit 14 is configured to accept user operations. As shown in FIG4, the operation unit 14 has a call button 141, an end button 142, an unlock button 143, and a home button 144.

[0046] The call button 141 is used to initiate a call (to a visitor, etc.) to another terminal (the front hall intercom 20 or the entryway sub-unit 40). For example, if the call button 141 is pressed while the first communication unit 11 is receiving a call signal for calling a resident (calling state), voice communication can be conducted between the information terminal 10 and other terminals (the front hall intercom 20). Similarly, if the call button 141 is pressed while the third communication unit 19 is receiving a call signal for calling a resident (calling state), voice communication can be conducted between the information terminal 10 and other terminals (the entryway sub-unit 40).

[0047] The end button 142 is used to end calls (call state) with other terminals (front hall intercom 20, or entrance terminal 40). For example, in the state of a voice call with the front hall intercom 20 via the first communication unit 11 (call state), pressing the end button 142 will end the voice call with the front hall intercom 20. The end button 142 is also used to end the mode operation state of the information terminal 10 and return it to the standby state. For example, when the information terminal 10 is in a mode operation state where video playback is a prescribed action, pressing the end button 142 will end the mode operation state and return the information terminal 10 to the standby state. Additionally, in the call state, pressing the call button 141 will also end the voice call.

[0048] Unlock button 143 is used to unlock the electric lock 201 on the door (here, the entrance door 200 in the common entrance hall E1; see Figure 2) of the facility where the information terminal 10 is located (here, the apartment 5). For example, when making an audio call with the intercom 20 in the lobby via the first communication unit 11 (call state), pressing unlock button 143 sends an unlock signal from the information terminal 10 via the control device 30 to unlock the electric lock 201. As a result, the electric lock 201 is unlocked, and the visitor can open the entrance door 200 and enter the common entrance hall E1. Alternatively, pressing unlock button 143 also ends the audio call with the intercom 20 in the lobby, along with the unlocking of the electric lock 201.

[0049] The home button 144 is used to change the screen displayed on the display unit 16 to a specified home screen. When the home button 144 is pressed, the information terminal 10 controls the screen displayed on the display unit 16 to change to the home screen.

[0050] In this embodiment, as an example, the call button 141, end button 142, unlock button 143, and home button 144, as shown in FIG4, are implemented by an electrostatic capacitive touch sensor disposed around the display section 16 on the front surface of the housing 100 of the information terminal 10. That is, the user can accept operation input simply by lightly touching the call button 141, end button 142, unlock button 143, and home button 144 with their fingertips. However, the call button 141, end button 142, unlock button 143, and home button 144 are not limited to being implemented by a touch sensor; at least some of them can also be implemented by a button-type switch.

[0051] Display unit 16 is, for example, a liquid crystal display (LCD). Various images can be displayed on display unit 16. For example, display unit 16 is configured to display images. When information terminal 10 is in a state where it can communicate with the front hall intercom 20, display unit 16 displays the image captured by the communication target, i.e., the front hall intercom 20. When information terminal 10 is in a state where it can communicate with the entryway sub-unit 40, display unit 16 displays the image captured by the communication target, i.e., the entryway sub-unit 40. Furthermore, when information terminal 10 has a touch panel display, the touch panel display can also serve as both display unit 16 and operation unit 14.

[0052] As shown in Figures 1 and 3, the memory unit 17 includes a first memory unit 171 and a second memory unit 172. Each of the first memory unit 171 and the second memory unit 172 is composed of a read-write memory (memory device). Each of the first memory unit 171 and the second memory unit 172 is, for example, flash memory.

[0053] The memory unit 17 stores, for example, a dictionary file used for voice recognition. The dictionary file can be downloaded and stored from the server 70 via the second communication unit 12. In this embodiment, the dictionary file includes a trigger dictionary D0 and a command dictionary D1. In addition to the dictionary file, the memory unit 17 also stores information displayed on the screen of the display unit 16, sound information, and various setting information.

[0054] As shown in Figure 3, the trigger dictionary D0 is stored in the first memory unit 171. Trigger words are registered in the trigger dictionary D0. A trigger word refers to a designated keyword that triggers the detection of a control command. The trigger words registered in the trigger dictionary D0 are predetermined. For example, during the manufacturing of the information terminal 10, predetermined trigger words are registered in the trigger dictionary D0 of the first memory unit 171. The trigger word is, for example, expected to be the product name of the information terminal 10, or its abbreviation, i.e., a relatively small number of characters. Alternatively, the user of the information terminal 10 can also register any trigger word in the trigger dictionary D0 using the voice acquisition unit 13, the operation unit 14, the display unit 16, etc. Or, one of the multiple candidate trigger words predetermined and stored in the first memory unit 171 can also be registered as a trigger word in the trigger dictionary D0 based on operations such as those performed on the operation unit 14.

[0055] As shown in Figure 3, the instruction dictionary D1 is stored in the second memory unit 172. The instruction dictionary D1 contains instruction words for a plurality of control instructions. These multiple control instructions are used to control at least one of the information terminal 10 and one or more machines connected to the information terminal 10. Here, the information terminal 10 is communicatively connected to, for example, the controller of a HEMS (Home Energy Management System) installed in the residence E2, and the HEMS controller can control one or more electrical machines (air conditioners, lighting fixtures, air purifiers, range hoods, etc.). "One or more machines connected to the information terminal 10" may include, for example, electrical machines controllable by the HEMS controller. When the information terminal 10 receives a control instruction related to the control of a machine connected to the information terminal 10 via voice input, the corresponding electrical machine is controlled, for example, via the HEMS controller.

[0056] As control commands for controlling the information terminal 10, there are, for example, commands for "answering" to start a call with another terminal (e.g., a call with a visitor) to initiate a call from that terminal, commands for "unlocking" to unlock the electric lock 201 of the entrance door 200, and commands for "ending" to end a call with another terminal and end a mode action state. As control commands for controlling one or more machines connected to the information terminal 10, there are commands for "turning on machine name (e.g., turning on the air conditioner)" to turn on the power of the controlled machine, and commands for "turning off machine name (e.g., turning off the air conditioner)" to turn off the power of the controlled machine.

[0057] In this embodiment, the instruction dictionary D1 includes a plurality of dictionaries (dictionary 1 D11 and dictionary 2 D12). The number and types of control instructions (instruction words) registered in the plurality of dictionaries (dictionary 1 D11 and dictionary 2 D12) are different from each other. Furthermore, in the information terminal 10, a dictionary corresponding to the operating state of the information terminal 10 is selected from the plurality of dictionaries (dictionary 1 D11 and dictionary 2 D12) for voice recognition. In the information terminal 10 of this embodiment, when the operating state of the information terminal 10 is standby mode or mode operation mode, dictionary 11 is used for voice recognition. Also, when the operating state of the information terminal 10 is call mode or call state, dictionary 2 D12 is used for voice recognition. The number of control instructions (instruction words) registered in dictionary 1 D11 is greater than the number of control instructions (instruction words) registered in dictionary 2 D12. Since dictionary D12 is used in call or call state, it mainly records command words (such as "answer", "unlock") for control instructions related to the information terminal 10 itself or to other terminals (front hall intercom 20 and entryway handset 40) during a call. Since dictionary D11 is used in standby or mode operation state, it mainly records command words (such as "turn on air conditioner", "turn off air conditioner") for control instructions to control one or more machines connected to the information terminal 10. In addition, there are also keywords such as "end" recorded in both dictionary D11 and dictionary D12. The control instructions recorded in command dictionary D1 can be set to be valid or invalid according to the operation state of information terminal 10.

[0058] As shown in Figure 1, the processing unit 18 includes a sound processing unit (hereinafter also referred to as "first sound processing unit") 181, a voice recognition unit 182, a control processing unit 183, a display processing unit 184, and a call processing unit 185. As shown in Figure 3, the call processing unit 185 includes a sound processing unit (hereinafter also referred to as "second sound processing unit") 1851.

[0059] The first sound processing unit 181 performs prescribed sound processing on the sound input to the microphone 131 of the sound acquisition unit 13. The first sound processing unit 181 performs prescribed sound processing on the sound data (sound information) from the sound acquisition unit 13 and generates sound data for sound recognition.

[0060] Specifically, the first sound processing unit 181 performs beamforming processing on the sound input to the first microphone 1311 and the sound input to the second microphone 1312. Beamforming processing refers to, for example, controlling the phase difference between the sound waves input to the first microphone 1311 and the sound waves input to the second microphone 1312 to selectively pick up sound waves from a specified direction (the direction the user is facing towards the information terminal 10). That is, the prescribed sound processing performed by the first sound processing unit 181 includes beamforming processing, which improves the directivity of the sound pickup direction based on the sound input to the first microphone 1311 and the sound input to the second microphone 1312. This reduces the sound components from the surrounding environment, making it easier to selectively acquire the user's voice. Furthermore, the first sound processing unit 181 is configured to perform prescribed filtering processing on the sound data acquired by the sound acquisition unit 13. The prescribed filtering processing includes, for example, noise removal processing to reduce noise components. That is, the prescribed sound processing performed by the first sound processing unit 181 includes noise removal processing.

[0061] The sound recognition unit 182 performs sound recognition on the sound input to the microphone 131 (in this embodiment, the first microphone 1311 and the second microphone 1312). In other words, the sound recognition unit 182 performs sound recognition processing on the sound acquired by the sound acquisition unit 13. The sound recognition unit 182 performs sound recognition processing on the sound processed by the first sound processing unit 181 using the dictionary files (trigger dictionary D0 and instruction dictionary D1) stored in the memory unit 17.

[0062] As shown in Figures 1 and 3, the sound recognition unit 182 includes a first sound recognition unit 1821 and a second sound recognition unit 1822.

[0063] The first sound recognition unit 1821 performs sound recognition (hereinafter also referred to as "trigger sound recognition") on the sound input to the microphone 131 to determine whether it contains a trigger word. The first sound recognition unit 1821 uses the trigger dictionary D0 stored in the first memory unit 171 to perform trigger sound recognition. By performing trigger sound recognition, the first sound recognition unit 1821 monitors the sound processed by the first sound processing unit 181 and determines whether it contains a trigger word.

[0064] The second sound recognition unit 1822 performs sound recognition related to control commands (hereinafter also referred to as "command sound recognition") on the sound input to the microphone 131. The second sound recognition unit 1822 uses the command dictionary D1 (first dictionary D11 or second dictionary D12) stored in the second memory unit 172 to perform command sound recognition. By performing command sound recognition, the second sound recognition unit 1822 monitors the sound processed by the first sound processing unit 181 and determines whether it contains any command word. When the second sound recognition unit 1822 determines that the sound input to the microphone 131 contains a command word (command word detection), it outputs the command word (control command) to the control processing unit 183.

[0065] In the information terminal 10 of this embodiment, a first voice recognition unit 1821 for trigger voice recognition and a second voice recognition unit 1822 for command voice recognition are installed separately. The first voice recognition unit 1821, which performs trigger voice recognition in the voice recognition unit 1822, is essentially always operational, monitoring the input of a voice including a trigger word to the microphone 131. The microphone 131 is also always operational. That is, in a non-call state where the information terminal 10 is not communicating with other terminals, the microphone 131 is capable of receiving audio. On the other hand, the second voice recognition unit 1822, which performs command voice recognition in the voice recognition unit 182, is operational under certain conditions (activated state, i.e., power-consuming state), and inactive under other conditions (non-activated state). The inactive state refers to, for example, a state that does not consume power, or a low-power-consumption state such as sleep mode.

[0066] More specifically, when the prescribed activation conditions are met, the second sound recognition unit 1822 is activated and enters the active state. Furthermore, when the prescribed deactivation conditions are met, the second sound recognition unit 1822 changes from the active state to the inactive state.

[0067] In the information terminal 10 of this embodiment, the activation condition includes the voice recognition trigger word of the first voice recognition unit 1821 in the standby state or mode operation state. Also, the activation condition includes the information terminal 10 receiving a call from another terminal (front hall intercom 20 or entrance sub-unit 40) (i.e., entering a call state).

[0068] Furthermore, the stopping condition includes the termination of a call (call state) between the information terminal 10 and other terminals (front hall intercom 20 or entryway sub-unit 40). The stopping condition also includes the termination of a call from another terminal (call state) without initiating a call between the information terminal 10 and other terminals (front hall intercom 20 or entryway sub-unit 40). Furthermore, the stopping condition includes, in standby or mode operation mode, the sound recognition of any control command word by the second sound recognition unit 1822 after the sound recognition trigger word by the first sound recognition unit 1821. Furthermore, the stopping condition includes, in standby or mode operation mode, the waiting time elapsed after the sound recognition trigger word by the first sound recognition unit 1821 without the command word being sound-recognized. For example, a pre-set waiting time length. The waiting time length is, for example, 3 seconds, but not limited to this. The information terminal 10 may also be configured so that the user can set the waiting time length.

[0069] In summary, the second voice recognition unit 1822 only operates under specified conditions. Furthermore, the second voice recognition unit 1822 performs command voice recognition on voice input to the microphone 131 when it is in the operating state. Even if a command word is input to the microphone 131 when the second voice recognition unit 1822 is not in the operating state, command voice recognition by the voice recognition unit 182 (the second voice recognition unit 1822) is not performed.

[0070] The designated state for the second voice recognition unit 1822 to become active includes the period from the moment the first voice recognition unit 1821 recognizes the trigger word in the standby state or the mode operation state until the second voice recognition unit 1822 recognizes the command word or the waiting time has elapsed. Furthermore, the designated state for the second voice recognition unit 1822 to become active includes the period during which the information terminal 10 receives a call from another terminal (front hall intercom 20 or entryway sub-unit 40). Furthermore, the designated state for the second voice recognition unit 1822 to become active includes the period during which the information terminal 10 is in a conversation with another terminal (front hall intercom 20 or entryway sub-unit 40). Thus, the second voice recognition unit 1822 is activated and becomes active when in a conversation with another terminal.

[0071] More specifically, as shown in Figure 3, the information terminal 10 includes a first processing circuit 101 and a second processing circuit 102. Each of the first processing circuit 101 and the second processing circuit 102 is, for example, an integrated circuit consisting of a Central Processing Unit (CPU), memory, and interface, also known as a System on a Chip (SoC). The first processing circuit 101 and the second processing circuit 102 are constructed from different chips. As shown in Figure 3, the first processing circuit 101 includes circuit components constituting a first sound processing unit 181, a first sound recognition unit 1821, and a first memory unit 171 (memory). The second processing circuit 102 includes circuit components constituting a second sound recognition unit 1822 and a second memory unit 172 (memory). As shown in Figure 3, the first processing circuit 101 is connected to the sound acquisition unit 13, the second processing circuit 102, and the call processing unit 185 (the provided third processing circuit 103). Furthermore, the second processing circuit 102 is connected to the first processing circuit 101, the call processing unit 185 (the third processing circuit 103), the first communication unit 11, and the third communication unit 19. When the first processing circuit 101 recognizes a voice trigger word and inputs a start signal S1 (see Figure 6) from the first processing circuit 101, or inputs a call signal S2 (see Figure 7) from the first communication unit 11 or the third communication unit 19, the second processing circuit 102 is activated and enters an active state. When the aforementioned stop condition is met, the second processing circuit 102 enters a non-active state.

[0072] Thus, by having the second sound recognition unit 1822 (second processing circuit 102) only operate under specified conditions, the power consumption of the sound recognition unit 182 can be reduced.

[0073] Furthermore, the second voice recognition unit 1822 changes the dictionary used for command voice recognition according to the operating state of the information terminal 10. When the information terminal 10 is in standby or mode operation state, the second voice recognition unit 1822 uses the first dictionary D11 for command voice recognition. In other words, when the second voice recognition unit 1822 is activated by the start signal S1 from the first processing circuit 101, it uses the first dictionary D11 for command voice recognition. Also, when the information terminal 10 is in call or conversation state, the second voice recognition unit 1822 uses the second dictionary D12 for command voice recognition. In other words, when the second voice recognition unit 1822 is activated by the call signal S2 from the first communication unit 11 or the third communication unit 19, it uses the second dictionary D12 for command voice recognition. Therefore, the command words for voice recognition can be changed according to the operating state of the information terminal 10.

[0074] Furthermore, consider the second voice recognition unit 1822 which uses a common command dictionary to perform command voice recognition regardless of the operating state of the information terminal 10, and performs judgment on the adoption and rejection of command words recognized by voice based on the operating state of the information terminal 10. However, in this case, such judgment and rejection processing is required, which may increase the power consumption of the information terminal 10. In contrast, in the information terminal 10 of this embodiment, the dictionary used for command voice recognition is changed according to the operating state of the information terminal 10, thus eliminating the aforementioned judgment and rejection processing. This reduces the processing of the voice recognition unit 182 and reduces the power consumption of the information terminal 10.

[0075] In the information terminal 10 of this embodiment, the sound processed by the first sound processing unit 181 is sent to different destinations depending on whether the second sound recognition unit 1822 is active or inactive. When the second sound recognition unit 1822 is inactive, the sound processed by the first sound processing unit 181 is sent to the first sound recognition unit 1821 (see path A1 in Figure 5), where the first sound recognition unit 1821 performs trigger sound recognition processing. On the other hand, when the second sound recognition unit 1822 is active, the sound processed by the first sound processing unit 181 is sent to the second sound recognition unit 1822 without passing through the first sound recognition unit 1821 (see path A2 in Figures 6-8), where the second sound recognition unit 1822 performs command sound recognition processing. Thus, in the information terminal 10 of this embodiment, before the sound recognition trigger word from the first sound recognition unit 1821, the sound processed by the first sound processing unit 181 is sent from the first sound processing unit 181 to the first sound recognition unit 1821 (see path A1 in Figure 5). After the sound recognition trigger word from the first sound recognition unit 1821, the sound processed by the first sound processing unit 181 is sent from the first sound processing unit 181 to the second sound recognition unit 1822 without passing through the first sound recognition unit 1821 (see path A2 in Figure 6). Furthermore, in the information terminal 10 of this embodiment, when a call is received from another terminal (front hall intercom 20, or entryway sub-unit 40), the sound input to the microphone 131 is sent to the second sound recognition unit 1822 without passing through the first sound recognition unit 1821 (see path A2 in Figure 7). Furthermore, in the information terminal 10 of this embodiment, during a call from another terminal (front hall intercom 20 or entryway handset 40), the sound input to the microphone 131 is not transmitted to the second voice recognition unit 1822 via the first voice recognition unit 1821 (see path A2 in Figure 8). This reduces the processing load of the voice recognition unit 182 and also reduces the power consumption of the information terminal 10.

[0076] The control processing unit 183 performs control based on the control commands recognized by the second voice recognition unit 1822. The control processing unit 183 performs control corresponding to the control commands based on the command words recognized by the second voice recognition unit 1822. For example, when the information terminal 10 is in a call state receiving a call from the front hall intercom 20 or in a call state with the front hall intercom 20, and the second voice recognition unit 1822 recognizes the command word "unlock," the control processing unit 183 performs control to unlock the electric lock 201 of the entrance door 200 of the common entrance (front hall) E1 of the apartment building 5 (hereinafter also referred to as "unlock control"). Furthermore, when a call is received from the front hall intercom 20, and the second voice recognition unit 1822 recognizes the command word "respond", the control processing unit 183 performs control to initiate a conversation with the front hall intercom 20 (a conversation with the visitor, etc.) (hereinafter also referred to as "conversation control").

[0077] Furthermore, the control processing unit 183 performs controls corresponding to the operation of the operation unit 14. For example, when the call button 141 is pressed in a call state, the control processing unit 183 performs call control. Also, when the unlock button 143 is pressed in a call or talk state, the control processing unit 183 performs unlock control. Additionally, each button on the operation unit 14 is set to be active or inactive according to the operating state of the information terminal 10. For example, the call button 141 is active in a call state and inactive in other operating states (talk state, standby state, mode operating state). Similarly, the unlock button 143 is active in both call and talk states and inactive in other operating states (standby state, mode operating state). The information terminal 10 can also notify the user that a button is active by illuminating (lighting up or flashing) each button on the operation unit 14 when it is active.

[0078] The control processing unit 183 is in an inactive state, for example, during the standby state of the information terminal 10. For example, when the first voice recognition unit 1821 triggers a voice recognition word or the second voice recognition unit 1822 triggers a voice recognition command word, the control processing unit 183 is activated and enters an active state. Also, for example, when the operation unit 14 is operated, the control processing unit 183 is activated and enters an active state. For example, after a predetermined operation time has elapsed since activation, the control processing unit 183 returns to an inactive state.

[0079] The display processing unit 184 causes the display unit 16 to display various screens. For example, the display processing unit 184 processes images captured by the communication target (in a call or from the call source) or other terminals (front hall intercom 20, entryway handset 40) on the display unit 16. Furthermore, the display processing unit 184 processes screens for displaying the home screen, settings screen, and screens corresponding to various operation states.

[0080] The call processing unit 185 handles calls with other terminals. As shown in FIG3, in addition to the first processing circuit 101 and the second processing circuit 102, the information terminal 10 also has a third processing circuit 103. The third processing circuit 103 is an integrated circuit that integrates a CPU, memory, interface, etc. on a single chip, also known as a SoC (System on a chip). As shown in FIG3, the circuit components constituting the call processing unit 185 are provided in the third processing circuit 103. The third processing circuit 103 (call processing unit 185) is basically in a non-operational state at all times. When a call signal S2 is received from the first communication unit 11 or the third communication unit 19 and an activation signal S3 is input from the second processing circuit 102, it is activated and becomes operational.

[0081] The call processing unit 185 acquires the sound data (sound information) acquired by the sound acquisition unit 13 (microphone 131).

[0082] The sound input to microphone 131 is input to call processing unit 185 without passing through the first sound processing unit 181. That is, when in a call with other terminals (front hall intercom 20 or entrance handheld unit 40), the sound input to microphone 131 is sent to call processing unit 185 without passing through the first sound processing unit 181. By sending the sound input to microphone 131 to call processing unit 185 without passing through the first sound processing unit 181, sound whose waveform is not distorted by sound processing (e.g., beamforming processing) can be used for calls.

[0083] Furthermore, the call processing unit 185 uses only one of the sounds input to the first microphone 1311 or the second microphone 1312 for call processing. As described above, the call processing unit 185 uses only the sound input to the first microphone 1311, which is relatively far from the speaker 151, for call processing. In other words, the distance L1 between the first microphone 1311 and the speaker 151 (see Figure 4) is greater than the distance L2 between the second microphone 1312 and the speaker 151 (see Figure 4), and the call processing unit 185 uses only the sound input to the first microphone 1311 for call processing. This suppresses the howling sound generated by the microphone 131 picking up the sound (of the visitor) output from the speaker 151.

[0084] The call processing unit 185 outputs the audio data (audio information) acquired from the audio acquisition unit 13 to the device operated by the person at the call destination. The call processing unit 185 transmits the audio data to other terminals (front hall intercom 20 or entrance handheld device 40) during the call via the first communication unit 11 or the third communication unit 19. For example, when the information terminal 10 is in a call with the front hall intercom 20, the call processing unit 185 transmits the audio data signal (audio signal) to the front hall intercom 20 via the first communication unit 11.

[0085] Furthermore, the call processing unit 185 obtains audio data signals (sound signals) from other terminals (front hall intercom 20 or entrance handheld unit 40) during a call via the first communication unit 11 or the third communication unit 19. The call processing unit 185 sends the audio data (sound information) obtained from other terminals during a call to the sound output unit 15, and outputs it as sound from the speaker 151.

[0086] As described above, the call processing unit 185 includes a second sound processing unit 1851. The second sound processing unit 1851 performs specified sound processing on the sound data (sound information) acquired by the sound acquisition unit 13 to generate sound data for communication. That is, when the call processing unit 185 (its second sound processing unit 1851) is in a call with another terminal, it performs specified sound processing on the sound input to the microphone 131 (here, the first microphone 1311). In this way, the sound data input to the microphone 131 can be processed into a form suitable for communication. The sound data (sound information) processed by the second sound processing unit 1851 is then sent to the other terminal (front hall intercom 20 or entryway handset 40) in the call.

[0087] The second sound processing unit 1851 uses the sound data acquired by the sound acquisition unit 13 and the sound data acquired by other terminals in the call to perform echo removal processing. That is, the specified sound processing performed by the call processing unit 185 includes echo removal processing. This allows sound with suppressed echo components to be used in the call. The call processing unit 185 (second sound processing unit 1851) is equipped with an echo canceller as a component for performing echo removal processing, and an echo canceller may be provided instead of or added to it. Furthermore, the call processing unit 185 (second sound processing unit 1851) is configured to perform a specified filtering process on the sound data acquired by the sound acquisition unit 13. The specified filtering process includes, for example, noise removal processing to reduce noise components. That is, the specified sound processing performed by the call processing unit 185 includes noise removal processing.

[0088] In the information terminal of this embodiment, when in a call with another terminal (front hall intercom 20 or entryway handset 40), the sound input to the microphone 131 is sent to the first sound processing unit 181 and the call processing unit 185. That is, even during a call with another terminal, the sound input to the microphone 131 is sent to the voice recognition unit 182 via the first sound processing unit 181. Therefore, even during a call, voice recognition can be performed by the voice recognition unit 182.

[0089] (2-2) Front Hall Intercom As shown in Figure 2, the front hall intercom 20 includes a communication unit 21, a processing unit 22, a communication unit 23, a display unit 24, an operation unit 25, a memory unit 26, and a camera unit 27.

[0090] The front hall intercom 20 has, for example, a microcomputer with a processor and memory. The microcomputer functions as a processing unit 22 by executing programs stored in the memory via the processor. The programs executed by the processor are pre-recorded in the microcomputer's memory, or can be recorded on non-temporary recording media such as memory cards, or provided via electrical communication lines such as the Internet.

[0091] The communication unit 21 is a communication interface used to communicate with the information terminal 10 (the first communication unit 11). The communication unit 21 is connected to the control device 30 (the communication unit 31) via the first trunk line 61. The communication unit 21 sends call signals, voice signals, and video signals to the information terminal 10 via the control device 30. Furthermore, the communication unit 21 receives voice signals and control signals from the information terminal 10 via the control device 30. Here, the communication signal from the front hall intercom 20 includes information (such as address information) used to designate the information terminal 10. Therefore, only the information terminal 10 assigned address information consistent with the address information contained in the communication signal can receive the communication signal.

[0092] The processing unit 22 is configured as a control and communication unit 21, a voice communication unit 23, and a camera unit 27, etc.

[0093] The communication unit 23 is configured to include a speaker and a microphone, and can communicate with the information terminal 10.

[0094] Display unit 24 is, for example, a liquid crystal display. Display unit 24 is configured to display images captured by camera unit 27. Furthermore, display unit 24 is configured to display messages to visitors, etc. These messages are, for example, messages used to prompt visitors to speak. Display unit 24 may display messages such as "Please speak." In this case, the same audio message can also be output (announced) from the speaker of intercom unit 23, or from a speaker separately from the speaker of intercom unit 23. Also, display unit 24 and speaker can be used together. Additionally, when the lobby intercom 20 has a touch panel display, the touch panel display can also serve as both display unit 24 and operation unit 25.

[0095] The operation unit 25 is configured, for example, to accept operations from visitors and residents of the apartment complex 5. The operation unit 25 may be, for example, an input interface having a plurality of push-button switches and a touch panel.

[0096] The memory unit 26 is composed of readable and writable memory. The memory unit 26 is, for example, flash memory. The memory unit 26 stores, for example, image data of images captured by the camera unit 27.

[0097] The camera unit 27 is equipped with an imaging element and is used to photograph subjects (visitors, etc.). In this embodiment, the imaging area (field of view) of the camera unit 27 is set in front of the lobby intercom 20. In this embodiment, the camera unit 27 is a camera for capturing moving images. Furthermore, in this embodiment, the camera unit 27 is a camera for capturing color images. Alternatively, the camera unit 27 can be a camera for capturing still images (still camera) or a camera for capturing monochrome images.

[0098] The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 27 uses an optical system such as a lens to image light from the subject onto the imaging surface (light-receiving surface) of the imaging element, and the imaging element converts the light from the subject into an electrical signal. Furthermore, the imaging unit 27 outputs the output signal of the imaging element as an image signal to the processing unit 22.

[0099] (2-3) Control device As shown in Figure 2, the control device 30 includes a communication unit 31, a processing unit 32, and a memory unit 33.

[0100] The control device 30 includes, for example, a microcomputer with a processor and memory. The microcomputer functions as a processing unit 32 by executing a program stored in memory via the processor. The program executed by the processor is pre-recorded in the microcomputer's memory, but it can also be recorded on a non-temporary recording medium such as a memory card, or provided via an electrical communication line such as the Internet.

[0101] The communication unit 31 includes each information terminal 10 and a communication interface for communicating with the lobby intercom 20. The communication unit 31 is connected to the lobby intercom 20 via a first trunk line 61 and to each information terminal 10 via a second trunk line 62. That is, the communication unit 31 is configured to relay communication between each information terminal 10 and the lobby intercom 20. Furthermore, the communication unit 31 is connected to the electric lock 201 of the entrance door 200, and is configured to communicate with the electric lock 201.

[0102] The processing unit 32 is configured as a control and communication unit 31. Based on instructions from the information terminal 10, the processing unit 32 controls the unlocking action of the electric lock 201 of the entrance door 200. For example, the processing unit 32 outputs an unlocking signal instructing the electric lock 201 to unlock via the communication unit 31.

[0103] The memory unit 33 is composed of read-write memory. For example, the memory unit 33 is flash memory. The memory unit 33 stores, for example, a correspondence table showing the relationship between the room numbers assigned to each resident E2 and the address information assigned to each information terminal 10. That is, in the control device 30, the processing unit 32 refers to the correspondence table, generates a signal that replaces the room number contained in the signal from the front hall intercom 20 with the corresponding address information of the information terminal 10, and sends this signal from the communication unit 31 to each information terminal 10. Furthermore, in each information terminal 10, when the address information contained in the signal received by the first communication unit 11 matches the address information stored in the memory unit 17, the processing unit 18 obtains the information contained in the signal. Also, in each information terminal 10, when the address information contained in the signal received by the first communication unit 11 does not match the address information stored in the memory unit 17, the processing unit 18 discards the information contained in the signal.

[0104] Furthermore, although this embodiment is configured with the communication unit 31 connected to the electric lock 201, it is not limited to this configuration. The control device 30 may also have a communication unit different from the communication unit 31, which is configured to be connected to the electric lock 201. Additionally, the lobby intercom 20 may also have a communication unit different from the communication unit 21 (electric lock communication unit), and the electric lock communication unit is connected to the electric lock 201. In this case, when the information terminal 10 performs unlocking control, the lobby intercom 20 outputs an unlocking signal to the electric lock 201, unlocking the electric lock 201.

[0105] (2-4) Entryway Sub-mechanism As shown in Figure 2, each entryway sub-unit 40 is connected to its corresponding information terminal 10 via a connecting cable 64. The entryway sub-unit 40 sends call signals, audio signals, and video signals to the information terminal 10. Furthermore, the entryway sub-unit 40 receives audio signals and control signals from the information terminal 10.

[0106] (3) Actions Referring to Figures 5-8, the operation of the information terminal 10 will be explained. Furthermore, in Figures 5-8, the non-operating processing circuits of the first processing circuit 101 to the third processing circuit 103 are shaded. Also, in Figures 6-8, the non-operating (unused) dictionaries of the first dictionary D11 and the second dictionary D12 are shaded.

[0107] In the standby state of the information terminal 10, as shown in Figure 5, the first processing circuit 101 is active, while the second processing circuit 102 and the third processing circuit 103 are inactive. Furthermore, as described above, in non-call states (including standby state), the microphone 131 is capable of receiving audio.

[0108] In standby mode, the sound (audio data) input to microphone 131 is input to the first audio processing unit 181 for prescribed audio processing and then input to the first audio recognition unit 1821 (refer to path A1 in Figure 5). The first audio recognition unit 1821 triggers audio recognition on the sound input to microphone 131 (audio data processed according to the prescribed audio processing by the first audio processing unit 181). Furthermore, since the second processing circuit 102 is inactive in standby mode, the sound (audio data) input to microphone 131 for prescribed audio processing is not received by the second processing circuit 102 (not effectively processed). Also, since the third processing circuit 103 is inactive in standby mode, the sound (audio data) input to microphone 131 is not received by the third processing circuit 103 (not effectively processed).

[0109] When the first voice recognition unit 1821 detects a voice recognition trigger word, the first processing circuit 101 sends a start signal S1 (see Figure 6) to the second processing circuit 102 to activate the second processing circuit 102. This activates the second processing circuit 102.

[0110] When the second processing circuit 102 is active, the sound input to the microphone 131 for prescribed sound processing is input to the second sound recognition unit 1822 (see path A2 in Figure 6). The second sound recognition unit 1822 performs command sound recognition on the input sound. In the standby state of the information terminal 10 (i.e., when activated by the start signal S1 from the first sound recognition unit 1821), the second sound recognition unit 1822 uses the first dictionary D11 to perform command sound recognition. When the second sound recognition unit 1822 recognizes a command word, the control processing unit 183 performs control commands based on the command word recognized by the sound recognition.

[0111] Furthermore, in the information terminal 10, in the standby state, when a call signal S2 (see Figure 7) is received from another terminal via the first communication unit 11 or the third communication unit 19, the second processing circuit 102 is activated. Thus, the second processing circuit 102 becomes operational (call state).

[0112] In call mode, the sound input to microphone 131 for prescribed sound processing is input to second sound recognition unit 1822 without passing through first sound recognition unit 1821 (see path A2 in Figure 7). Second sound recognition unit 1822 performs command sound recognition on the input sound. In call mode (when initiated by another terminal), second sound recognition unit 1822 uses second dictionary D12 to perform command sound recognition. When second sound recognition unit 1822 recognizes a command word, control processing unit 183 performs control commands based on the command word recognized by the sound recognition.

[0113] In call mode, when the second voice recognition unit 1822 recognizes the "answer" command word or the call button 141 is pressed, the second processing circuit 102 sends a start signal S3 to the third processing circuit 103 to activate the third processing circuit 103 (see Figure 8). This activates the third processing circuit 103 (call mode). Alternatively, the start signal S3 can also be sent from the first processing circuit 101 to the third processing circuit 103.

[0114] During a call, the sound input to microphone 131, after undergoing prescribed sound processing, is input to second sound recognition unit 1822 without passing through first sound recognition unit 1821 (see path A2 in Figure 8). Second sound recognition unit 1822 performs command sound recognition on the input sound. During a call (in the case of being initiated by another terminal), second sound recognition unit 1822 uses second dictionary D12 to perform command sound recognition. Furthermore, during a call, the sound input to microphone 131 is input to call processing unit 185 (second sound processing unit 1851), undergoes prescribed sound processing, and is output as call audio data to other terminals in the call (see path A3 in Figure 8). Also, during a call, audio data from other terminals in the call is sent from call processing unit 185 to audio output unit 15 and output as audio from speaker 151 (see path A4 in Figure 8).

[0115] Furthermore, since the processing related to the startup of the second processing circuit 102 when the information terminal 10 is in the mode operation state is essentially the same as when it is in the standby state, the explanation is omitted.

[0116] Thus, in the information terminal 10, the second voice recognition unit 1822 is activated when the trigger word is recognized by the first voice recognition unit 1821. In this way, user convenience can be improved while power consumption can be reduced.

[0117] (4) Variation Example The above-described embodiments are merely one of the various embodiments disclosed herein. Various modifications can be made to the above-described embodiments to achieve the purpose of this disclosure, depending on the design, etc. Furthermore, the same functions as the information terminal 10 in the above-described embodiments can also be embodied by control methods, computer programs, or non-temporary recording media for recording computer programs, etc.

[0118] Specifically, the control method described is the control method for the information terminal 10, which operates as a walkie-talkie device. As shown in Figure 9, the control method includes a first voice recognition step ST1, a startup step ST2, a second voice recognition step ST3, and a control processing step ST4. The first voice recognition step ST1 includes the first voice recognition unit 1821 performing voice recognition processing on the sound input to the microphone 131 to determine whether it contains a trigger word. The startup step ST2 includes activating the second voice recognition unit 1822 when a trigger word is recognized in the first voice recognition step ST1. The second voice recognition step ST3 includes the second voice recognition unit 1822 performing voice recognition processing on the sound input to the microphone 131 to generate control commands. The control processing step ST4 includes performing control based on the control commands identified in the second voice recognition step ST3.

[0119] The following are examples of variations of the above implementation. The variations described below can be combined and applied appropriately.

[0120] The information terminal 10, lobby intercom 20, and entryway handset 40 disclosed herein include a computer system. The computer system is primarily composed of a processor and memory as hardware. The processor executes programs recorded in the computer system's memory to realize the functions of the information terminal 10, lobby intercom 20, and entryway handset 40 as disclosed herein. The programs can be pre-recorded in the computer system's memory, provided via electrical communication lines, or recorded on non-temporary recording media such as memory cards, optical discs, and hard disk drives that can be read by the computer system. The computer system's processor consists of one or more electronic circuits, including integrated circuits (ICs) or large-scale integrated circuits (LSIs). The integrated circuits mentioned here, such as ICs or LSIs, have different names depending on their degree of integration, including system LSIs, VLSIs (Very Large Scale Integration), and ULSIs (Ultra Large Scale Integration). Furthermore, FPGAs (Field-Programmable Gate Arrays) that are programmable after LSI fabrication, or logic devices that can reconfigure the internal connections or circuit partitioning of LSIs, can also be used as processors. Multiple electronic circuits can be integrated onto a single chip or distributed across multiple chips. Multiple chips can be integrated into a single device or distributed across multiple devices. The computer systems mentioned here include microcontrollers with one or more processors and one or more memory units. Therefore, microcontrollers are also composed of one or more electronic circuits, including semiconductor integrated circuits or large-scale integrated circuits.

[0121] Furthermore, it is not necessary for the multiple functions of the information terminal 10, the front hall intercom 20, and the entryway sub-unit 40 to be integrated into a single housing. The components of the information terminal 10, the front hall intercom 20, and the entryway sub-unit 40 can also be distributed across multiple housings. Conversely, the multiple functions of the information terminal 10, the front hall intercom 20, and the entryway sub-unit 40 can also be integrated into a single housing. Moreover, at least some functions of the information terminal 10, the front hall intercom 20, and the entryway sub-unit 40, for example, a portion of the functions of the information terminal 10, can be implemented via the cloud (cloud computing).

[0122] (4.1) Variation Example 1 Referring to Figure 10, the information terminal 10 of Variation Example 1 will be described.

[0123] In the information terminal 10 of this variation example, as shown in FIG10, when in a call state with at least other terminals (front hall intercom 20 or entrance sub-unit 40), the sound input to the microphone 131 is input to the call processing unit 185 (second sound processing unit 1851) (see path A5 in FIG10) and after undergoing specified sound processing, it is input to the sound recognition unit 182 (second sound recognition unit 1822) through the first sound processing unit 181 (see path A6 in FIG10) (see path A7 in FIG10). That is, in the call state with other terminals, the sound processed by the call processing unit 185 is sent to the first sound processing unit 181. Therefore, the sound processed by the second sound processing unit 1851 for echo removal is input to the first sound processing unit 181, and this sound is used for sound recognition by the sound recognition unit 182.

[0124] For example, when a visitor speaks a command word during a conversation with the front hall intercom 20, the sound is output from the speaker 151 and picked up by the microphone 131, which may be used for sound recognition by the sound recognition unit 182. As described in the above embodiment, when the information terminal 10 is in a call state, since the second sound recognition unit 1822 is active, even if no trigger word is given but only a command word is spoken, the second sound recognition unit 1822 may still perform sound recognition of the command word. In the information terminal 10 of this variation, since the sound after echo removal processing is input to the first sound processing unit 181, such accidental sound recognition can be prevented.

[0125] Furthermore, not only in the call state, but also in any operation state of the information terminal 10 (call state, standby state, mode operation state), the sound input to the microphone 131 can be input to the first sound processing unit 181 via the call processing unit 185 (second sound processing unit 1851).

[0126] Alternatively, instead of inputting sound into microphone 131, the sound can be input into first sound processing unit 181 via call processing unit 185 (second sound processing unit 1851), thus enabling first sound processing unit 181 to perform echo removal processing. In this case, for echo removal processing, sound data from other terminals (front hall intercom 20 and entrance handheld unit 40) are also input into first sound processing unit 181.

[0127] (4.2) Variation Example 2 Referring to Figure 11, the information terminal 10A of Variation Example 2 will be described.

[0128] In the information terminal 10A of this variation, the first processing circuit 101A includes circuit components constituting a voice recognition unit 182A (including a first voice recognition unit 1821A and a second voice recognition unit 1822A) and a memory unit 17A, and the second processing circuit 102A includes circuit components constituting a control processing unit 183A. The first processing circuit 101A and the second processing circuit 102A are housed in a single casing. The memory unit 17A stores both a trigger dictionary D0 and an instruction dictionary D1. The voice recognition unit 182A (first processing circuit 101A) is essentially in a constant operating state. On the other hand, the control processing unit 183A (second processing circuit 102A) is in an operating state under specified conditions and in a non-operating state under other conditions. For example, when specified activation conditions are met, the control processing unit 183A is activated and becomes operational. The activation condition may include the voice recognition trigger word of the first voice recognition unit 1821 in standby or mode operation state. Alternatively, the activation condition may include the information terminal 10 receiving a call from another terminal (front hall intercom 20 or entryway sub-unit 40) (i.e., entering a calling state). Furthermore, the activation condition may include the operation unit 14 being operated.

[0129] Thus, the information terminal 10A in this variation operates as an information terminal for a walkie-talkie device. The information terminal 10A includes a voice recognition unit 182A and a control processing unit 183A. The voice recognition unit 182A recognizes whether the sound input to the microphone 131 contains a trigger word and whether it contains a control command. The control processing unit 183A performs control based on the control commands recognized by the voice recognition unit 182A. When a trigger word is recognized by the voice recognition unit 182A, the control processing unit 183A is activated. Furthermore, the control processing unit 183A can also be activated when a control command word is recognized by the voice recognition unit 182A.

[0130] The same functions as the information terminal 10A in this variation example can also be embodied by control methods, computer programs, or non-temporary recording media that record computer programs.

[0131] Specifically, the single-state control method is the control method for the information terminal 10A that operates the walkie-talkie device. As shown in Figure 12, the control method includes a voice recognition step ST11, a startup step ST12, and a control processing step ST13. The voice recognition step ST11 includes the voice recognition unit 182A performing voice recognition processing on the sound input to the microphone 131 to determine whether it contains a trigger word and to perform voice recognition processing on the control command. The startup step ST12 includes activating the control processing unit 183A when the voice recognition step ST11 recognizes a trigger word. The control processing step ST13 includes the control unit 183A performing control based on the control command recognized in the voice recognition step ST11. Alternatively, the startup step ST12 may also include activating the control processing unit 183A when the voice recognition step ST11 recognizes a control command.

[0132] In the information terminal 10A and control method of this variation, it is possible to both improve user convenience and reduce power consumption.

[0133] (4.3) Other variations In one variation, voice recognition can also be performed based on sound input to a microphone on a device different from information terminal 10 (a walkie-talkie or portable terminal located in the same residence E2), or a microphone external to information terminal 10. For example, as an example of a portable terminal, information terminal 10 can also perform voice recognition based on sound input to a microphone on a smartphone carried by the user. In this case, dedicated application software for communicating with information terminal 10 is pre-installed on the smartphone (portable terminal). The portable terminal transmits the sound (data) input to the microphone to information terminal 10 via wireless communication, such as according to standards like Wi-Fi (registered trademark). In other words, even when the user resides in residence E2 and the smartphone is within a constant range of information terminal 10, the user can still use the smartphone and indirectly answer calls or make conversations with information terminal 10 via voice operation.

[0134] In one variation, the command dictionary D1 may have a single dictionary or more than three dictionaries. When the command dictionary D1 has more than three dictionaries, for example, the second dictionary D12 may be divided into a dictionary used in call mode and a dictionary used in call mode. Furthermore, when the command dictionary D1 is a single dictionary, the voice recognition unit 182 can perform command voice recognition using a common command dictionary regardless of the operating state of the information terminal 10.

[0135] In one variation, the information terminal 10 is not limited to being a device that operates as a walkie-talkie. For example, the information terminal 10 can also be a terminal for a lighting control system, an air conditioning control system, an access control system, a disaster prevention system, etc. Here, "terminal" can be, for example, a remote control, a wall-mounted control panel, etc. The information terminal 10 can be applied to residential or non-residential equipment.

[0136] In one variation, during a call from or conversation with the entryway sub-unit 40 (which is another terminal), when the unlock button 143 is pressed or the voice recognition of a command word (e.g., "unlock") is successful, the information terminal 10 can send an unlock signal to unlock the electric lock of the entryway door of the facility (resident E2). The information terminal 10 can also unlock the electric lock of the entryway door via the entryway sub-unit 40 or other devices.

[0137] In one variation, when the intercom system 1 is used in a detached house, during a call from or conversation with the detached house's entryway sub-unit, if the unlock button 143 is pressed or the voice recognition of a command word (e.g., "unlock") is successful, the information terminal 10 can also send an unlock signal to unlock the electric lock of the detached house's entryway door. The information terminal 10 can also unlock the electric lock of the entryway door via the entryway sub-unit or other devices.

[0138] (5) State As explained above, the information terminal (10) of the first state includes a first voice recognition unit (1821), a second voice recognition unit (1822), and a control processing unit (183). The first voice recognition unit (1821) recognizes whether the sound input to the microphone (131) contains a trigger word. The second voice recognition unit (1822) recognizes the sound input to the microphone (131) as a control command. The control processing unit (183) performs control based on the control command recognized by the second voice recognition unit (1822). When the trigger word is recognized by the first voice recognition unit (1821), the second voice recognition unit (1822) is activated.

[0139] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0140] The second-state information terminal (10) is the same as the first-state, and further includes: a call processing unit (185) which performs call processing with other terminals (front hall intercom 20, entrance sub-unit 40).

[0141] Based on this approach, improvements in user convenience can be achieved.

[0142] The third-state information terminal (10) is the same as the second-state, and further includes: a sound processing unit (181) that performs prescribed sound processing on the sound input to the microphone (131). Before the sound recognition trigger word of the first sound recognition unit (1821), the sound processed by the sound processing unit (181) is sent from the sound processing unit (181) to the first sound recognition unit (1821). After the sound recognition trigger word of the first sound recognition unit (1821), the sound processed by the sound processing unit (181) is sent from the sound processing unit (181) to the second sound recognition unit (1822) without passing through the first sound recognition unit (1821).

[0143] Based on this approach, it is possible to reduce the processing power of the voice recognition unit (182) and the power consumption of the information terminal (10).

[0144] In the information terminal (10) of the fourth state, as in the third state, when in a call with another terminal, the sound input to the microphone (131) is sent to the call processing unit (185) without passing through the sound processing unit (181).

[0145] Based on this pattern, sound whose waveform has not been distorted by sound processing can be used for calls.

[0146] In the information terminal (10) of the fifth state, as in the fourth state, when in a call with another terminal, the call processing unit (185) performs specified sound processing on the sound input to the microphone (131). The sound processed by the call processing unit (185) is sent to the sound processing unit (181).

[0147] Based on this pattern, the audio data input to the microphone (131) can be processed into a form suitable for conversation.

[0148] In the information terminal (10) of the sixth state, as in the fifth state, the specified voice processing performed by the call processing unit (185) includes echo removal processing.

[0149] Based on this pattern, sound with suppressed echo components can be used for communication.

[0150] In the information terminal (10) of the 7th state, such as any of the 3rd to 6th states, when in a call with other terminals, the sound input to the microphone (131) is sent to the sound processing unit (181) and the call processing unit (185).

[0151] According to this pattern, even during a call, voice recognition can be performed by the voice recognition unit (182).

[0152] The information terminal (10) of the eighth state, like any of the states 3 to 7, has a first microphone (1311) and a second microphone (1312) located away from the first microphone (1311) as two microphones (131). The sound processing unit (181) performs a prescribed sound processing including beamforming processing, which improves the directivity of the sound reception direction based on the sound input to the first microphone (1311) and the sound input to the second microphone (1312).

[0153] Based on this pattern, it is easy to selectively obtain the user's voice.

[0154] In the information terminal (10) of the 9th state, as in the 8th state, the call processing unit (185) uses only one of the sound input to the first microphone (1311) or the sound input to the second microphone (1312) to perform call processing.

[0155] The information terminal (10) in the 10th state is the same as in the 9th state, and further includes a speaker (151) for making calls with other terminals. The distance (L1) between the first microphone (1311) and the speaker (151) is greater than the distance (L2) between the second microphone (1312) and the speaker (151). The call processing unit (185) performs call processing using only the sound input to the first microphone (1311).

[0156] Based on this pattern, howling can be suppressed.

[0157] In the information terminal (10) of the 11th state, as in any of the states 2 to 10, the second voice recognition unit (1822) is activated in the state of communication with other terminals. In the state of communication with other terminals, the sound input to the microphone (131) is sent to the second voice recognition unit (1822) without passing through the first voice recognition unit (1821).

[0158] Based on this approach, it is possible to reduce the processing power of the voice recognition unit (182) and the power consumption of the information terminal (10).

[0159] In the information terminal (10) of the 12th state, such as any of the 2nd to 11th states, the microphone (131) is in a non-call state when not in a call with other terminals.

[0160] Based on this pattern, the possibility of voice recognition processing failure can be reduced.

[0161] The information terminal (10A) of the 13th type includes a voice recognition unit (182A) and a control processing unit (183A). The voice recognition unit (182A) performs voice recognition on the sound input to the microphone (131) to determine whether it contains a trigger word and a control command. The control processing unit (183A) performs control based on the control commands recognized by the voice recognition unit (182A). The control processing unit (183A) is activated when a trigger word is recognized by the voice recognition unit (182A) or when a control command is recognized by the voice recognition unit (182A).

[0162] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0163] The walkie-talkie system of type 14 (1) has an information terminal (10, 10A) of any of types 1 to 13, and other terminals (front hall walkie-talkie 20, entrance hall sub-unit 40) for communication including talking to the information terminal (10, 10A).

[0164] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0165] The control method of the 15th state is the control method of the information terminal (10). The control method includes a first voice recognition step (ST1), a startup step (ST2), a second voice recognition step (ST3), and a control processing step (ST4). The first voice recognition step (ST1) includes performing voice recognition processing on the sound input to the microphone (131) by the first voice recognition unit (1821) to determine whether the sound contains a trigger word. The startup step (ST2) includes starting the second voice recognition unit (1822) when the trigger word is recognized in the first voice recognition step (ST1). The second voice recognition step (ST3) includes performing voice recognition processing on the sound input to the microphone (131) by the second voice recognition unit (1822) to perform voice recognition of control commands. The control processing step (ST4) includes performing control based on the control commands recognized in the second voice recognition step.

[0166] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0167] The control method of the 16th state is the control method of the information terminal (10A). The control method includes a voice recognition step (ST11), a startup step (ST12), and a control processing step (ST13). The voice recognition step (ST11) includes voice recognition processing by the voice recognition unit (182A) to determine whether the sound input to the microphone (131) contains a trigger word and to perform voice recognition processing for control commands. The startup step (ST12) includes starting the control processing unit (183A) when the voice recognition step (ST11) recognizes a trigger word, or when the voice recognition step (ST11) recognizes a control command. The control processing step (ST13) includes controlling the control commands based on the voice recognition in the voice recognition step (ST11) by the control processing unit (183A).

[0168] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0169] The 17th state program causes one or more processors to execute the control method of the 15th or 16th state.

[0170] Based on this approach, efforts can be made to improve user convenience while simultaneously reducing power consumption.

[0171] 1: Walkie-talkie system 5: Multi-family housing 10,10A: Information Terminal 11: 1st Communications Department 12:Second Communications Department 13: Acquisition section 14: Operations Department 15: Sound output section 16: Display Section 17, 17A: Memory Section 18: Processing Department 19:3rd Communications Department 20: Lobby Intercom (Other Terminals) 21: Ministry of Communications 22: Processing Department 23: Telephone Department 24: Display Section 25: Operations Department 26: Memory Department 27: Camera Department 30: Control device 31: Ministry of Communications 32: Processing Department 33: Memory Department 40: Entryway Sub-unit (Other Terminals) 50: Brancher 61: Main Line 1 62: Main Line 2 63: Branch line 64: Connecting cable 70: Server 100: Casing 101, 101A: First processing circuit 102, 102A: Second processing circuit 103: Third Processing Circuit 131: Microphone 141: Call button 142: End button 143: Unlock button 144: Home button 151: Speaker 171: First Memory Section 172: Second Memory Section 181: First Sound Processing Department 182, 182A: Voice Recognition Unit 183, 183A: Control Processing Unit 184: Display Processing Unit 185: Call Processing Department 200: Entryway door (door) 201: Electric Lock 1311: Microphone 1 1312: Second microphone 1821, 1821A: First Sound Recognition Unit 1822, 1822A: Second Sound Recognition Unit 1851: Second Sound Processing Department A1: Path A2: Path A3: Path A4: Path A5: Path A6: Path A7: Path D0: Trigger dictionary D1: Instruction Dictionary D11: Dictionary No. 1 D12: Dictionary No. 2 E1: Shared entryway (foyer) E2: Residents E3: Management Office L1: Distance L2: Distance NT1: Network S1: Start signal S2: Call signal S3: Start signal ST1: First Sound Recognition Step ST2: Startup Steps ST3: Second Sound Recognition Step ST4: Control Processing Steps ST11: Sound Recognition Steps ST12: Startup Procedure ST13: Control Processing Steps

Claims

1. An information terminal comprising: a sound processing unit that performs prescribed sound processing on sound input to a microphone; a first sound recognition unit that recognizes whether the sound input to the microphone and after the prescribed sound processing by the sound processing unit contains a trigger word; a second sound recognition unit that recognizes the sound input to the microphone and after the prescribed sound processing by the sound processing unit as a control command; a control processing unit that performs control based on the control command recognized by the second sound recognition unit; and a call processing unit that performs call processing with other terminals; and activates the second sound recognition unit when the trigger word is recognized by the first sound recognition unit; and transmits the sound after the prescribed sound processing by the sound processing unit to the first sound recognition unit before the trigger word is recognized by the first sound recognition unit. After the trigger word is identified by the first sound recognition unit, the sound processed by the sound processing unit according to the above-mentioned rules is sent from the sound processing unit to the second sound recognition unit; in the call state with the other terminal, the sound input to the microphone is sent to the call processing unit.

2. As in request item 1, the information terminal, while in a call with the other terminals mentioned above, further sends the sound input to the microphone to the sound processing unit.

3. As in request item 1 or 2, in the context of a call with the other terminal, the call processing unit performs specified sound processing on the sound input to the microphone; sends the sound after the specified sound processing by the call processing unit to the sound processing unit; and the sound processing unit performs the specified sound processing on the sound after the specified sound processing by the call processing unit.

4. As in request item 3, the information terminal wherein the specified voice processing performed by the call processing unit includes echo removal processing.

5. The information terminal of request item 1 or 2 has a first microphone and a second microphone separately provided from the first microphone as two microphones; and the sound processing performed by the sound processing unit includes beamforming processing, which improves the directivity of the sound reception direction based on the sound input to the first microphone and the sound input to the second microphone.

6. The information terminal as requested in item 5, wherein the call processing unit performs the call processing using only one of the sounds input to the first microphone or the sounds input to the second microphone.

7. The information terminal of claim 6 further includes: a speaker for communicating with the other terminals; and the distance between the first microphone and the speaker is greater than the distance between the second microphone and the speaker; the call processing unit performs the call processing using only the sound input to the first microphone.

8. In the information terminal of request item 1 or 2, the second voice recognition unit is activated in the call state with the other terminal; and in the call state with the other terminal, the voice input to the microphone is sent to the second voice recognition unit.

9. An information terminal connected to a machine, comprising: a voice recognition unit that recognizes whether a sound obtained after processing or collecting sound through a microphone contains a trigger word and a control command for controlling the machine; and a control processing unit that controls the machine based on the control command recognized by the voice recognition unit; wherein the control processing unit is activated when the trigger word is recognized by the voice recognition unit, or when the control command is recognized by the voice recognition unit.

10. A walkie-talkie system comprising: an information terminal of any one of claims 1 to 9; and other terminals for conducting communication including speaking with the aforementioned information terminal.

11. A control method for an information terminal comprising a sound processing unit, a first sound recognition unit, a second sound recognition unit, and a call processing unit, comprising: a sound processing step in which the sound processing unit performs prescribed sound processing on sound input to a microphone; a first sound recognition step in which the first sound recognition unit performs sound recognition processing on the sound input to the microphone and after the sound processing unit has performed the prescribed sound processing, to determine whether the sound contains a trigger word; a activation step in which the second sound recognition unit is activated when the trigger word is recognized in the first sound recognition step; and a second sound recognition step in which the second sound recognition unit performs sound recognition processing of a control command on the sound input to the microphone and after the sound processing unit has performed the prescribed sound processing. The control processing step performs control based on the control command identified in the second voice recognition step; and the call processing step performs call processing with other terminals through the call processing unit; and before the trigger word is identified by the first voice recognition unit, the sound processed by the voice processing unit according to the prescribed sound is sent from the voice processing unit to the first voice recognition unit; after the trigger word is identified by the first voice recognition unit, the sound processed by the voice processing unit according to the prescribed sound is sent from the voice processing unit to the second voice recognition unit; and in the call state with the other terminal, the sound input to the microphone is sent to the call processing unit.

12. The control method of claim 11, wherein, in the state of a call with the other terminal, the sound input to the microphone is further sent to the sound processing unit.

13. A control method for an information terminal connected to a machine and having a voice recognition unit and a control processing unit, comprising: a voice recognition step, wherein the voice recognition unit performs voice recognition processing on a sound obtained after processing or collecting a sound via a microphone to determine whether it contains a trigger word and to perform voice recognition processing on a control command for controlling the machine; a startup step, wherein the control processing unit is started when the trigger word is recognized by voice in the voice recognition step, or when the control command is recognized by voice in the voice recognition step; and a control processing step, wherein the control processing unit controls the machine based on the control command recognized by voice in the voice recognition step.

14. A computer program product, comprising a control method for causing one or more processors of the aforementioned information terminal to execute any one of request items 11 to 13.

Images