Information terminal and intercom system

Abstract

To provide an information terminal capable of performing a clear call depending on the user's position, an intercom system, a processing method, and a program.SOLUTION: An information terminal 10 is an information terminal that operates as an intercom device. The information terminal 10 performs voice adjustment processing relevant to at least one of the received and uttered based on at least one of the user's distance and direction to the information terminal 10.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure generally relates to an information terminal and intercom systems More specifically, an information terminal configured to be able to make calls and intercom systems Regarding. [Background technology]

[0002] 2. Description of the Related Art Conventionally, intercom systems for use in apartment buildings and the like have been known (see, for example, Patent Document 1).

[0003] The intercom system of Patent Document 1 includes a lobby intercom installed at the common entrance of an apartment building, an intercom master unit installed in each dwelling unit, and a door phone slave unit installed outside each dwelling unit (at the entrance).

[0004] In such an intercom system, a visitor calls the intercom master unit using the lobby intercom. In response to this call, the resident of the residence performs a specified operation on the intercom master unit, which starts a conversation between the lobby intercom and the intercom master unit. Similarly, when the intercom master unit is called using the door phone slave, the resident of the residence performs a specified operation on the intercom master unit in response to the call, which starts a conversation between the door phone slave and the intercom master unit. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2004-64249 A Summary of the Invention [Problem to be solved by the invention]

[0006] Incidentally, intercom master units (information terminals) are often configured to enable hands-free conversations. In such cases, there is a demand for the ability to talk on the intercom master unit even from a location far away.

[0007] The present disclosure has been made in consideration of the above problems, and provides an information terminal that allows clear calls depending on the user's location. and intercom system The purpose is to provide. [Means for solving the problem]

[0008] An information terminal according to one aspect of the present disclosure is an information terminal that operates as an intercom device. The information terminal includes a sound acquisition unit, a voice processing unit, a voice recognition unit, and a control processing unit. The sound acquisition unit acquires sound including a user's voice. The voice processing unit performs a voice adjustment process on the sound acquired by the sound acquisition unit, with an estimation target being at least one of the distance and direction of the user relative to the information terminal as a predetermined condition. The voice recognition unit performs a voice recognition process on the sound processed by the voice processing unit. The control processing unit performs control based on a result of the voice recognition process on the sound processed by the voice processing unit. The voice processing unit adjusts the sound acquired by the sound acquisition unit, by adjusting the sound adjustment target being at least one of the distance and direction of the user relative to the information terminal as a predetermined condition. The voice recognition ... When a user's voice contains a specific keyword, The voice processing unit estimates the estimation target. Depending on the estimation result, at least one of the received speech and the uttered speech is The above Performs audio adjustment processing. The voice recognition unit sets a call start state when the voice uttered by the user includes the predetermined keyword, and after the call start state, judges whether or not the sound processed by the voice processing unit includes a control word different from the predetermined keyword. When the voice recognition unit judges that the sound processed by the voice processing unit includes the control word, the control processing unit performs control according to the control word. The control word includes a word corresponding to control of unlocking a door.

[0009] An intercom system according to one aspect of the present disclosure includes the information terminal and an intercom entrance device that communicates with the information terminal. Effect of the Invention

[0012] According to the present disclosure, clear calls can be made depending on the user's location. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an information terminal according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a system configuration of an intercom system including the above information terminal. [Diagram 3] FIG. 3 is a diagram for explaining the operation of the information terminal according to the above embodiment. [Figure 4] Fig. 4A is a diagram showing an example of a display mode of an image displayed on the information terminal of the above embodiment when the user is close to the information terminal of the above embodiment, and Fig. 4B is a diagram showing an example of a display mode of an image displayed on the information terminal of the above embodiment when the user is far from the information terminal of the above embodiment. [Diagram 5] FIG. 5 is a block diagram illustrating the configuration of an information terminal according to the first modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The embodiments and modifications described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modifications. Various modifications other than the following embodiments and modifications are possible according to the design, etc., as long as they do not deviate from the technical idea of ​​the present disclosure.

[0015] (Embodiment) Hereinafter, an intercom system 1 including an information terminal 10 that operates as an intercom device according to this embodiment will be described with reference to Figs. 1 to 4B.

[0016] (1) Overview The information terminal 10 according to this embodiment will be described below.

[0017] The information terminal 10 according to the present embodiment is applied to an intercom system 1 as shown in FIG. 2. The intercom system 1 is applied to, for example, an apartment building or other collective housing 5. The intercom system 1 according to the present embodiment includes an information terminal 10. In the present embodiment, the intercom system 1 includes a plurality of (two in FIG. 2) information terminals 10 each operating as an intercom device. The intercom system 1 further includes a lobby intercom 20 (intercom entrance device), a control device 30, and a plurality of (two in FIG. 2) entrance sub-units 40 (intercom entrance device). In the intercom system 1, each of the plurality of information terminals 10 and the lobby intercom 20 are configured to communicate with each other via the control device 30. In the intercom system 1, the plurality of information terminals 10 and the plurality of entrance sub-units 40 correspond one-to-one to each other. The intercom system 1 according to the present embodiment may be applied to a detached house other than the collective housing 5. Alternatively, the intercom system 1 may be applied to a non-residential facility such as an office, a store, a school, or a nursing home.

[0018] Each of the multiple information terminals 10 is, for example, a dwelling unit terminal (intercom master unit) provided in each of the multiple dwelling units E2 included in the apartment building 5. Each information terminal 10 is provided, for example, at the inner entrance of each dwelling unit E2. Each information terminal 10 is connected to the control device 30 via a second trunk line 62, a branch line 63, and a splitter 50. Each information terminal 10 is configured to communicate (for example, make calls and send control signals, etc.) with the lobby intercom 20 via the control device 30. Furthermore, each information terminal 10 is connected to a corresponding entrance slave unit 40 via a connection line 64. Each information terminal 10 is configured to communicate (for example, make calls and send control signals, etc.) with the corresponding entrance slave unit 40.

[0019] The lobby intercom 20 is provided, for example, at the common entrance (lobby) E1 of the apartment building 5. The lobby intercom 20 is connected to the control device 30 via a first trunk line 61. The lobby intercom 20 is configured to communicate (for example, make calls and transmit video signals, etc.) with each information terminal 10 via the control device 30. The lobby intercom 20 is attached, for example, to the wall of the common entrance E1. The lobby intercom 20 transmits a video signal to the information terminal 10, thereby enabling the information terminal 10 to display a video (image).

[0020] The control device 30 is provided, for example, in a management room E3 of an apartment building 5. The control device 30 is connected to the lobby intercom 20 via a first trunk line 61, and is connected to each information terminal 10 via a second trunk line 62. In other words, the control device 30 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

[0021] Each of the multiple front door slave units 40 is provided, for example, at the outer entrance of the dwelling unit E2 of the apartment building 5. Each front door slave unit 40 is connected to a corresponding information terminal 10 via a connection line 64. Each front door slave unit 40 is configured to communicate (for example, make a call, transmit a video signal, etc.) with the corresponding information terminal 10.

[0022] In this embodiment, the first trunk 61, the second trunk 62, the branch 63, and the connection 64 are all twisted pair wires. That is, in reality, the first trunk 61, the second trunk 62, the branch 63, and the connection 64 are each composed of two electric wires, but are shown as one line in the drawing. At least one of the first trunk 61, the second trunk 62, the branch 63, and the connection 64 may be an electric wire other than a twisted pair wire.

[0023] The information terminal 10 according to the present embodiment performs a voice adjustment process for at least one of receiving and speaking, based on at least one of the distance and the direction of the user relative to the information terminal 10. Here, the user is, for example, a resident of the dwelling unit E2. The received voice includes the user's voice received by the information terminal 10. The spoken voice includes the voice output by the information terminal 10 to the user. The sender of the voice output to the user is, for example, a visitor to the apartment building 5, but it may be anyone who calls the user of each dwelling unit E2 from the lobby intercom 20 or the entrance unit 40, or it may be a resident of each dwelling unit E2 who has returned home from outside (a user different from the user to be called), etc.

[0024] The information terminal 10 according to this embodiment performs a sound adjustment process for at least one of receiving and speaking, based on at least one of the distance and the direction of the user relative to the information terminal 10. Therefore, the information terminal 10 can output an appropriate sound to the device with which it is communicating (lobby intercom 20, entrance slave unit 40) or to the user. For example, when the user answers a call from the lobby intercom 20 at a location away from the information terminal 10, even if the sound received by the information terminal 10 from the user is low, the sound can be adjusted to an appropriate volume and output to the lobby intercom 20.

[0025] (2) Composition (2-1) Information terminal As shown in FIG. 1, the information terminal 10 includes a first communication unit 11, a second communication unit 12, a sound acquisition unit 13, an operation unit 14, an output unit 15, a display unit 16, a storage unit 17, and a control unit 18.

[0026] The information terminal 10 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 18. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

[0027] The first communication unit 11 is a communication interface for communicating with the lobby intercom 20 (its communication unit 21). The first communication unit 11 is connected to the control device 30 via the second trunk line 62, the branch line 63, and the splitter 50. The first communication unit 11 transmits audio signals, control signals, etc. to the lobby intercom 20 via the control device 30. Furthermore, the first communication unit 11 receives audio signals, video signals, etc. from the lobby intercom 20 via the control device 30.

[0028] The second communication unit 12 is a communication interface for communicating with the front door sub-unit 40. The second communication unit 12 is connected to the front door sub-unit 40 via a connection line 64. The second communication unit 12 transmits audio signals, control signals, etc. to the front door sub-unit 40, and receives audio signals, video signals, etc. from the front door sub-unit 40.

[0029] The sound acquisition unit 13 acquires sounds including at least the user's voice, and outputs sound information related to the acquired sounds to the control unit 18. The sound acquisition unit 13 has a plurality of microphones. Each of the plurality of microphones is a microphone having directivity. In this embodiment, the sound acquisition unit 13 has two microphones (a first microphone 131 and a second microphone 132) as shown in FIG. 1. The first microphone 131 and the second microphone 132 have directivity in at least one of the horizontal direction (left-right direction) and the vertical direction (up-down direction). The first microphone 131 and the second microphone 132 are arranged side by side along the left-right direction. The first microphone 131 and the second microphone 132 acquire surrounding sounds including the voice (sound) of a user located in front of the information terminal 10, convert the acquired sounds into analog sound signals (sound information), and output the analog sound signals to the control unit 18.

[0030] The operation unit 14 is configured to accept operations by a user (e.g., a resident of each dwelling unit E2, etc.). The operation unit 14 has at least a call button. The call button is a button for starting communication (a call with a visitor, etc.) with the lobby intercom 20 or the front door sub-unit 40 in response to a call from the lobby intercom 20 or the front door sub-unit 40. In other words, when the call button is pressed while the first communication unit 11 is receiving a call signal to call a resident, a voice call becomes possible between the lobby intercom 20 or the front door sub-unit 40 and the information terminal 10.

[0031] The output unit 15 is, for example, a speaker. When the information terminal 10 is in a state where it can communicate with the lobby intercom 20, the output unit 15 outputs a sound (including the voice of a visitor, etc.) based on the sound data transmitted from the lobby intercom 20. When the information terminal 10 is in a state where it can communicate with the front door sub-unit 40, the output unit 15 outputs a sound (including the voice of a visitor, etc.) based on the sound data transmitted from the front door sub-unit 40.

[0032] The display unit 16 is, for example, a liquid crystal display. The display unit 16 is configured to display an image. When the information terminal 10 is in a state where it can make a call (communicate) with the lobby intercom 20, the display unit 16 displays an image captured by the lobby intercom 20, which is the communication target. When the information terminal 10 is in a state where it can make a call (communicate) with the entrance door sub-unit 40, the display unit 16 displays an image captured by the entrance door sub-unit 40, which is the communication target. If the information terminal 10 is equipped with a touch panel display, the touch panel display may serve as both the display unit 16 and the operation unit 14.

[0033] The storage unit 17 is configured with a readable and writable memory. The storage unit 17 is, for example, a flash memory. The storage unit 17 stores, for example, reference information that serves as a reference for estimating the distance between the information terminal 10 and the user. The reference information includes, for example, an input level that represents the strength of a signal when a voice uttered by a user from a stationary position is input to the information terminal 10. The unit representing the input level is, for example, [dBspl] or [dBm].

[0034] As shown in FIG. 1, the control unit 18 has a voice processing unit 181, a voice recognition unit 182, a control processing unit 183, a display processing unit 184, and a sending unit 185.

[0035] The audio processing unit 181 performs audio adjustment processing on the sound acquired by the sound acquisition unit 13 in accordance with predetermined conditions. Here, the predetermined conditions include at least one of the distance and direction of the user relative to the information terminal 10. In this embodiment, the predetermined conditions include both the distance and direction of the user relative to the information terminal 10. A specific example of the audio adjustment processing performed by the audio processing unit 181 will be described below.

[0036] The audio processing unit 181 acquires an analog sound signal output by the sound acquisition unit 13. The audio processing unit 181 converts the acquired analog sound signal into a digital sound signal. The audio processing unit 181 is also configured to perform a predetermined filtering process or the like on the sound signal acquired from the sound acquisition unit 13. The audio processing unit 181 includes, for example, a plurality of echo cancellers (a first echo canceller, a second echo canceller). The first echo canceller suppresses or removes echo from the sound signal output from the first microphone 131. The second echo canceller suppresses or removes echo from the sound signal output from the second microphone.

[0037] When a predetermined keyword uttered by the user is included in the sound acquired by the sound acquisition unit 13, the sound processing unit 181 estimates the distance and direction of the user relative to the information terminal 10. That is, the sound processing unit 181 is triggered by the sound acquisition unit 13 acquiring a predetermined keyword as a voice uttered by the user, and executes acquisition (estimation) of information (distance, direction) as a predetermined condition.

[0038] The sound processing unit 181 estimates the direction of the person emitting the sound based on the sound information related to the sound acquired by the sound acquisition unit 13. Specifically, the sound processing unit 181 estimates the direction of the person emitting the sound based on the phase difference between the first signal and the second signal. Here, the first signal is a digital sound signal corresponding to the analog sound signal output from the first microphone 131. The second signal is a digital sound signal corresponding to the analog sound signal output from the second microphone 132.

[0039] The sound processing unit 181 controls the direction of sound acquisition by the sound acquisition unit 13 based on the estimation result for the direction. Specifically, the sound processing unit 181 performs various calculations on the sound signals input from each of the first microphone 131 and the second microphone 132 to convert them into sound signals with increased sensitivity in the desired direction. This improves the S / N ratio in the desired direction. In other words, the control unit 18 can control the direction of sound acquisition by the sound acquisition unit 13 based on the sound input from each microphone based on the estimation result of the sound processing unit 181.

[0040] The audio processing unit 181 includes, for example, a noise suppressor. The audio processing unit 181 suppresses or removes noise from a sound signal including two gain-adjusted signals.

[0041] The voice processing unit 181 estimates the distance to the user using the reference information stored in the storage unit 17. The voice processing unit 181 measures the signal level (intensity) of the sound signal (sound information) related to the sound acquired by the sound acquisition unit 13. For example, the voice processing unit 181 calculates the average value per unit time of the signal level of the sound signal related to the sound acquired by the sound acquisition unit 13 as the measurement of the signal level (intensity). When the signal level of the sound signal is equal to or higher than the input level included in the reference information, the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is close. When the signal level of the signal (digital sound signal) related to the sound acquired by the sound acquisition unit 13 is lower than the input level included in the reference information, the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is far. In short, the distance includes a result estimated based on the sound acquired by the sound acquisition unit 13. In other words, the distance includes a result estimated based on the sound acquired by the sound acquisition unit 13. In addition, the input level included in the reference information may be different for each user.

[0042] When estimating that the distance between the information terminal 10 and the user is short, the audio processing unit 181 reduces the gain at which the sound is input so that the volume of the user's voice is reduced. For example, the audio processing unit 181 changes the setting so that the gain at which the sound is input is reduced.

[0043] When estimating that the distance between the information terminal 10 and the user is long, the audio processing unit 181 increases the gain at which the sound is input so that the volume of the user's voice increases. For example, the audio processing unit 181 changes the setting so that the gain at which the sound is input increases.

[0044] The sound processor 181 changes the setting so that the signal level of the sound acquired by the sound acquirer 13 becomes the same as the input level included in the reference information.

[0045] The voice recognition unit 182 performs voice recognition processing on the sound processed by the voice processing unit 181. By performing the voice recognition processing, the voice recognition unit 182 determines whether or not a predetermined keyword is included in the sound processed by the voice processing unit 181. When the voice recognition unit 182 determines that the sound processed by the voice processing unit 181 includes a predetermined keyword, it instructs the voice processing unit 181 to estimate the distance and direction of the user relative to the information terminal 10.

[0046] When the voice recognition unit 182 determines that the sound processed by the voice processing unit 181 contains a predetermined keyword, it controls the information terminal 10 to start communication (a call) with the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target.

[0047] The voice recognition unit 182 judges whether or not the sound processed by the voice processing unit 181 includes a keyword (control word) related to control in the intercom system 1.

[0048] The control processing unit 183 performs processing related to control in the intercom system 1 according to the result of the above-mentioned determination by the voice recognition unit 182. Specifically, when the voice recognition unit 182 determines that the sound processed by the voice processing unit 181 includes a control word, the control processing unit 183 performs processing according to the control word included in the sound processed by the voice processing unit 181.

[0049] For example, while the information terminal 10 is communicating with the lobby intercom 20, the information terminal 10 receives a voice including the control word "open the door" from the user. In this case, the voice recognition unit 182 determines that the voice processed by the voice processing unit 181 includes the control word "open the door." The control processing unit 183 controls the unlocking of the door for entering from the shared entrance E1.

[0050] Furthermore, the control processing unit 183 controls the unlocking of the door when the operation unit 14 receives a predetermined operation from the user.

[0051] The display processing unit 184 performs processing for displaying an image captured by an intercom entrance device (lobby intercom 20, entrance slave unit 40) that is a communication target on the display unit 16. More specifically, the display processing unit 184 changes the display mode of an image displayed on the display unit 16 according to a predetermined condition.

[0052] Specifically, when the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is short, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) without changing the magnification. When the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is long, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device at a higher magnification, for example, to enlarge and display the face of a visitor.

[0053] Furthermore, when the voice processing unit 181 estimates that the user is present in the direction of the first microphone 131 with respect to the information terminal 10, the display processing unit 184 controls the display unit 16 so that the visitor's face is displayed in the direction in which the user is estimated to be present, that is, on the first microphone 131 side, rather than the center of the screen of the display unit 16. When the voice processing unit 181 estimates that the user is present in the direction of the second microphone 132 with respect to the information terminal 10, the display processing unit 184 may control the display unit 16 so that the visitor's face is displayed on the second microphone 132 side, rather than the center of the screen of the display unit 16.

[0054] The sending unit 185 outputs sound data (sound information) related to the sound acquired by the sound acquisition unit 13 to a device operated by the person at the other end of the call. Specifically, the sending unit 185 transmits a sound signal from which noise has been suppressed or removed by the voice processing unit 181 to the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target via the first communication unit 11 or the second communication unit 12. For example, when the information terminal 10 is communicating with the lobby intercom 20, the sending unit 185 transmits a sound signal from which noise has been suppressed or removed by the voice processing unit 181 to the lobby intercom 20 via the first communication unit 11.

[0055] (2-2) Lobby intercom As shown in FIG. 2, the lobby intercom 20 includes a communication unit 21, a control unit 22, a call unit 23, a display unit 24, an operation unit 25, a storage unit 26, and an imaging unit 27.

[0056] The lobby intercom 20 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 22. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may also be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

[0057] The communication unit 21 is a communication interface for communicating with the information terminal 10 (its first communication unit 11). The communication unit 21 is connected to the control device 30 (its communication unit 31) via the first trunk line 61. The communication unit 21 transmits audio signals, video signals, etc. to the information terminal 10 via the control device 30. Furthermore, the communication unit 21 receives audio signals, control signals, etc. from the information terminal 10 via the control device 30. Here, the communication signal from the lobby intercom 20 contains information (e.g., address information, etc.) for identifying the information terminal 10. Therefore, only the information terminal 10 to which address information matching the address information contained in this communication signal is assigned can receive the communication signal.

[0058] The control unit 22 is configured to control the communication unit 21, the voice communication unit 23, the imaging unit 27, and the like.

[0059] The communication unit 23 includes a speaker and a microphone, and is configured to be able to communicate with the information terminal 10.

[0060] The display unit 24 is, for example, a liquid crystal display. The display unit 24 is configured to display an image captured by the imaging unit 27. The display unit 24 is also configured to display a message to a visitor or the like. The message is, for example, a message for encouraging the visitor or the like to speak. The display unit 24 displays, for example, a message such as "Please speak." In this case, a similar voice message may be output (announced) from the speaker of the call unit 23 or a speaker provided separately from the speaker of the call unit 23. The display unit 24 and the speaker may be used together. In addition, when the information terminal 10 is equipped with a touch panel display, the touch panel display may serve as both the display unit 24 and the operation unit 25.

[0061] The operation unit 25 is configured to receive operations from a user (for example, a visitor to the apartment building 5, a resident, or the like). The operation unit 25 is, for example, an input interface having a plurality of push button switches, a touch panel, or the like.

[0062] The storage unit 26 is configured with a readable and writable memory. The storage unit 26 is, for example, a flash memory. The storage unit 26 stores video data of a video (image) captured by the imaging unit 27, for example.

[0063] The imaging unit 27 is a camera having an imaging element for capturing an image of a subject (user). In this embodiment, the imaging area (field of view) of the imaging unit 27 is set in front of the information terminal 10. In this embodiment, the imaging unit 27 is a camera for capturing moving images. Furthermore, in this embodiment, the imaging unit 27 is a camera for capturing color images. Note that the imaging unit 27 may be a camera for capturing still images (still camera) or a camera for capturing monochrome images.

[0064] The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 27 forms an image of light from a subject on an imaging surface (light receiving surface) of the imaging element by an optical system such as a lens, and converts the light from the subject into an electrical signal by the imaging element. The imaging unit 27 then outputs an output signal of the imaging element to the control unit 22 as a video signal.

[0065] (2-3) Control device As shown in FIG. 2, the control device 30 includes a communication unit 31, a control unit 32, and a storage unit 33.

[0066] The control device 30 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 32. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

[0067] The communication unit 31 includes a communication interface for communicating with each information terminal 10 and the lobby intercom 20. The communication unit 31 is connected to the lobby intercom 20 via a first trunk line 61, and is connected to each information terminal 10 via a second trunk line 62. In other words, the communication unit 31 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

[0068] The control unit 32 is configured to control the communication unit 31 .

[0069] The storage unit 33 is composed of a readable and writable memory. The storage unit 33 is, for example, a flash memory. The storage unit 33 stores, for example, a correspondence table showing the correspondence between the room number assigned to each dwelling unit E2 and the address information assigned to each information terminal 10. That is, in the control device 30, the control unit 32 refers to the correspondence table to create a signal in which the room number included in the signal from the lobby intercom 20 is replaced with the address information of the corresponding information terminal 10, and causes the communication unit 31 to transmit this signal to each information terminal 10. Then, in each information terminal 10, the control unit 18 acquires the information included in the signal when the address information included in the signal received by the first communication unit 11 matches the address information stored in the storage unit 17. Also, in each information terminal 10, the control unit 18 discards the information included in the signal when the address information included in the signal received by the first communication unit 11 does not match the address information stored in the storage unit 17.

[0070] (2-4) Entrance door unit 2, each front door slave unit 40 is connected to a corresponding information terminal 10 via a connection line 64. The front door slave unit 40 transmits audio signals, video signals, etc. to the information terminal 10. Furthermore, the front door slave unit 40 receives audio signals, control signals, etc. from the information terminal 10.

[0071] (3) Operation Here, the operation of the information terminal 10 will be described with reference to FIG.

[0072] The voice recognition unit 182 uses sound information relating to the sound acquired by the sound acquisition unit 13 to determine whether or not the sound acquired by the sound acquisition unit 13 includes a predetermined keyword uttered by the user (step S1).

[0073] When the voice recognition unit 182 determines that the sound acquired by the sound acquisition unit 13 does not include a predetermined keyword ("No" in step S1), the process repeats this determination.

[0074] When the voice recognition unit 182 determines that the sound acquired by the sound acquisition unit 13 includes a predetermined keyword ("Yes" in step S1), the voice processing unit 181 estimates the direction of the user relative to the information terminal 10 (step S2). Specifically, the voice processing unit 181 estimates the direction of the person making the voice based on the phase difference between the first signal and the second signal.

[0075] The sound processor 181 measures (step S3) a signal level (intensity) of a sound signal (sound information) related to the sound acquired by the sound acquirer 13. The sound processor 181 determines whether or not the signal level of the sound signal is equal to or higher than an input level included in the reference information (step S4).

[0076] When it is determined that the signal level of the sound signal is equal to or higher than the input level included in the reference information ("Yes" in step S4), the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is close, and performs the first sound processing (step S5). Specifically, when the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is close, it reduces the gain at which sound is input so that the volume of the user's voice is reduced. At this time, the sending unit 185 transmits the sound signal, the volume of which has been adjusted to reduce the volume, to the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target.

[0077] Furthermore, the display processing unit 184 performs a first display process (step S6). Specifically, when the voice processing unit 181 estimates that the information terminal 10 and the user are close to each other, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) without changing the magnification. At this time, the display unit 16 displays the image G10 captured of the visitor U1 who performed a calling operation at the lobby intercom 20 without changing the magnification of the image G10 (see FIG. 4A).

[0078] When it is determined that the signal level of the sound signal is not equal to or higher than the input level included in the reference information, that is, the signal level is less than the input level ("No" in step S4), the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is far, and performs the second sound processing (step S7). Specifically, when the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is far, it increases the gain at which sound is input so that the volume of the user's voice becomes louder. At this time, the sending unit 185 transmits the sound signal, the volume of which has been adjusted to increase, to the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target.

[0079] Furthermore, the display processing unit 184 performs a second display process (step S8). Specifically, when the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is far, the display processing unit 184 controls the display unit 16 to increase the magnification of the image captured by the intercom entrance device, for example, to enlarge and display the visitor's face. At this time, the display unit 16 enlarges and displays the face of the visitor U1 included in the image G10 captured of the visitor U1 who made a call operation at the lobby intercom 20 (see FIG. 4B).

[0080] The voice recognition unit 182 performs voice recognition processing on the sound processed by the voice processing unit 181 (step S9). Specifically, the voice recognition unit 182 determines whether or not the sound processed by the voice processing unit 181 includes a keyword (control word) related to control in the intercom system 1.

[0081] The control processing unit 183 judges whether or not control in the intercom system 1 is necessary (step S10). Specifically, the control processing unit 183 judges whether or not control is necessary based on the judgment result of the voice recognition unit 182. The control processing unit 183 judges that control is necessary when it judges that the sound processed by the voice processing unit 181 contains a control word. The control processing unit 183 judges that control is not necessary when it judges that the sound processed by the voice processing unit 181 does not contain a control word.

[0082] When it is determined that control is necessary ("Yes" in step S10), the control processing unit 183 performs processing according to the control word contained in the sound processed by the voice processing unit 181.

[0083] When it is determined that control is not necessary ("No" in step S10), the control processing unit 183 does not execute step S11.

[0084] After the predetermined keyword is detected, if communication is in progress between the information terminal 10 and the intercom entrance apparatus that is the communication target, the information terminal 10 executes the processes from step S5 to step S11.

[0085] (4) Advantages As described above, the information terminal 10 of the present embodiment is an information terminal that operates as an intercom device. The information terminal 10 performs a sound adjustment process for receiving a call, which is a sound (voice) acquired by the sound acquisition unit 13, based on at least one of the distance and the direction of the user relative to the information terminal 10.

[0086] More specifically, the information terminal 10 includes a sound acquisition unit 13, a voice processing unit 181, and a control processing unit 183. The sound acquisition unit 13 acquires a sound including a user's voice. The voice processing unit 181 performs a voice adjustment process on the sound acquired by the sound acquisition unit 13, using at least one of the distance and the direction as a predetermined condition.

[0087] According to this configuration, the sound adjustment process is performed using at least one of the distance and direction of the user relative to the information terminal 10, so that the volume of the sound output from the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target can be made to be an appropriate volume. For example, even if the user is far away from the information terminal 10, the sound can be adjusted to make the visitor feel as if the sound is coming from nearby. Therefore, the information terminal 10 can carry out clear conversations according to the user's position.

[0088] The information terminal 10 further includes a display unit 16 and a display processing unit 184. The display unit 16 displays an image captured by an intercom entrance device (lobby intercom 20, entrance slave unit 40) that is a communication target. The display processing unit 184 causes the display unit 16 to display the image. The display processing unit 184 changes the display mode of the image displayed by the display unit 16 according to a predetermined condition.

[0089] For example, the displayed image is enlarged when the user is far away from the information terminal 10. This allows the user to easily confirm who the visitor is, regardless of the user's location.

[0090] (5) Variations The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved.

[0091] Modifications of the above embodiment are listed below. The modifications described below can be applied in appropriate combinations.

[0092] (5-1) Variation 1 In the above embodiment, the information terminal 10 is configured to estimate the distance and direction of the user relative to the information terminal 10 based on the acquired sound, but the present invention is not limited to this configuration.

[0093] The distance and direction of the user relative to the information terminal 10 may be estimated based on information other than the sound information related to the acquired sound. For example, the information terminal 10 may estimate the distance and direction of the user relative to the information terminal 10 based on a detection result of a human detection unit 19 (see FIG. 5) that detects the presence or absence of a person (user) in the dwelling unit E2.

[0094] The following description will focus on the differences from the embodiment, and the same components as those in the embodiment will be given the same reference numerals as those in the embodiment, and the description thereof will be omitted as appropriate.

[0095] As shown in FIG. 5, the information terminal 10A of this modified example includes a first communication unit 11, a second communication unit 12, a sound acquisition unit 13, an operation unit 14, an output unit 15, a display unit 16, a memory unit 17, a control unit 18A, and a human detection unit 19.

[0096] The information terminal 10A has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 18A. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

[0097] The human detection unit 19 is, for example, a human sensor. The human detection unit 19 outputs microwaves such as infrared rays and receives the reflected waves reflected by an object.

[0098] As shown in FIG. 5, the control unit 18A has a voice processing unit 181A, a voice recognition unit 182, a control processing unit 183, a display processing unit 184, a transmission unit 185, and a detection processing unit 186.

[0099] When the voice recognition unit 182 determines that the sound (voice) acquired by the sound acquisition unit includes a predetermined keyword, the detection processing unit 186 estimates the distance and direction of the user relative to the information terminal 10 based on the detection result of the human detection unit 19. Specifically, the detection processing unit 186 estimates the direction in which the microwave is output as the direction of the user relative to the information terminal 10. The detection processing unit 186 calculates (estimates) the distance to the object (user) from which the microwave is reflected based on the phase difference between the phase of the output microwave and the phase of the received reflected wave. When the calculated distance is equal to or less than a predetermined reference value, the detection processing unit 186 determines that the distance of the user relative to the information terminal 10 is close. When the calculated distance is greater than a predetermined reference value, the detection processing unit 186 determines that the distance of the user relative to the information terminal 10 is far. In short, the distance includes a result estimated based on the result detected by the human detection unit 19 that detects a person. In other words, the distance includes a result estimated based on the result detected by the human detection unit 19 that detects a person.

[0100] The sound processor 181A performs sound adjustment processing on the sound acquired by the sound acquirer 13 in accordance with a predetermined condition (the distance and direction of the user relative to the information terminal 10).

[0101] The audio processing unit 181A acquires the analog audio signal output by the audio acquisition unit 13 and converts it into a digital audio signal. The audio processing unit 181A performs a predetermined filtering process or the like on the audio signal acquired from the audio acquisition unit 13 to suppress or remove echoes from the audio signal.

[0102] The sound processing unit 181A controls the direction of sound acquisition by the sound acquisition unit 13 based on the estimation result of the direction detection processing unit 186. Specifically, the sound processing unit 181A adjusts the sound input from the first microphone 131 and the sound input from the second microphone 132 based on the estimation result.

[0103] The audio processing unit 181A includes, for example, a noise suppressor. The audio processing unit 181A suppresses or removes noise from a sound signal including two gain-adjusted signals.

[0104] The voice processing unit 181 adjusts the volume of the sound output to the intercom entrance device (lobby intercom 20, entrance slave unit 40) with which communication is to be made, based on the estimation result (determination result) of the detection processing unit 186 with respect to the distance. For example, if the detection processing unit 186 determines that the distance between the information terminal 10 and the user is short, the gain at which the sound is input is reduced so that the volume of the user's voice becomes lower. If the detection processing unit 186 determines that the distance between the information terminal 10 and the user is long, the gain at which the sound is input is reduced so that the volume of the user's voice becomes higher.

[0105] As a result, even when the detection result of the human detection unit 19 is used, the information terminal 10A of this modification can carry out clear conversation according to the user's position.

[0106] In this modification, information terminal 10A is configured to include human detection unit 19, but is not limited to this. Human detection unit 19 is not an essential component of information terminal 10A.

[0107] In addition, the human detection unit 19 is configured as a human sensor, but is not limited to this. The human detection unit 19 may be an LPS (Local Positioning System) that detects the position of a person in the dwelling unit E2. In other words, the human detection unit 19 may be configured to detect (estimate) the distance and direction of a person (user) in the dwelling unit E2 relative to the information terminal 10.

[0108] (5-2) Variation 2 In the above embodiment, the predetermined condition is configured to include both the distance and the direction of the user with respect to the information terminal 10, but is not limited to this.

[0109] The predetermined condition may be configured to include one of the distance and the direction of the user with respect to the information terminal 10. In other words, the predetermined condition may be configured to include at least one of the distance and the direction of the user with respect to the information terminal 10. In other words, the audio processing unit 181 may be configured to perform audio adjustment processing based on at least one of the distance and the direction of the user with respect to the information terminal 10.

[0110] (5-3) Variation 3 In the above embodiment, the voice processing unit 181 is configured to adjust the voice based on the distance and direction of the user relative to the information terminal 10 for the sound (user's voice) acquired by the sound acquisition unit 13, i.e., the received voice, but is not limited to this configuration.

[0111] When outputting voice (visitor voice) based on a voice signal received from an intercom entrance device (lobby intercom 20, entrance sub-unit 40), the voice processing unit 181 may adjust the voice based on at least one of the distance and direction of the user relative to the information terminal 10.

[0112] For example, the audio processing unit 181 judges whether the user is far from the information terminal based on the signal level (intensity) of the sound signal (sound information) related to the sound acquired by the sound acquisition unit 13. When the audio processing unit 181 judges that the user is far from the information terminal 10, it performs audio adjustment to increase the volume of the visitor's voice. When the audio processing unit 181 judges that the user is close to the information terminal 10, it performs audio adjustment to maintain or decrease the volume of the visitor's voice. This allows the volume heard by the user to be an appropriate volume.

[0113] In short, the audio processing unit 181 may be configured to perform audio adjustment processing for at least one of receiving and speaking, based on at least one of the distance and direction of the user relative to the information terminal. For example, by performing audio adjustment processing for speaking, the volume of the sound output from the output unit 15 of the information terminal 10 can be adjusted to a volume that is easy for the user to hear depending on the user's position. Also, by performing audio adjustment processing for both receiving and speaking, the volume of the sound output from the intercom entrance device (lobby intercom 20, entrance slave unit 40) can be adjusted to an appropriate volume, and the volume of the sound output from the output unit 15 of the information terminal 10 can be adjusted to a volume that is easy for the user to hear depending on the user's position.

[0114] (5-4) Variation 4 In the above embodiment, the information terminal 10 is configured to adjust the sound (adjust the volume) based on the distance and direction of the user relative to the information terminal 10, but the present invention is not limited to this configuration.

[0115] The intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target with information terminal 10 may adjust the volume. In this case, information terminal 10 transmits the estimation results of the distance and direction of the user relative to information terminal 10 to the intercom entrance device. Based on the estimation results, the intercom entrance device adjusts the volume of the user's voice output from the intercom entrance device.

[0116] (5-5) Variation 5 In the above embodiment, the voice processing unit 181 is configured to acquire (estimate) information (distance, direction) as a predetermined condition, triggered by the sound acquisition unit 13 acquiring a predetermined keyword as a voice uttered by the user. However, the present invention is not limited to this configuration.

[0117] It is not essential for the sound acquisition unit 13 to acquire a predetermined keyword as a condition for starting to acquire (estimate) information (distance, direction) as a predetermined condition for the voice processing unit 181. When the first communication unit 11 or the second communication unit 12 receives a control signal related to a call from the intercom entrance device (lobby intercom 20, entrance slave unit 40), the voice processing unit 181 may acquire (estimate) information (distance, direction) as a predetermined condition.

[0118] (5-6) Variation 6 In the above embodiment, the voice processor 181 may repeatedly estimate the distance and direction of the user relative to the information terminal 10 until communication between the information terminal and the intercom entrance device (lobby intercom 20, entrance slave unit 40) is terminated.

[0119] (5-7) Variation 7 In the above embodiment, the sound acquiring unit 13 has two microphones (the first microphone 131 and the second microphone 132), but is not limited to this configuration.

[0120] The sound acquisition unit 13 may have one microphone or three or more microphones. The sound acquisition unit 13 having one microphone is effective when estimating the distance of the user from the information terminal 10 as a predetermined condition. In addition, when the sound acquisition unit 13 has three or more microphones, the distance and direction of the user from the information terminal 10 can be estimated with higher accuracy.

[0121] (5-8) Variation 8 In the above embodiment, the voice recognition unit 182 is not an essential component of the information terminal 10. The voice recognition unit 182 may be provided in a terminal (e.g., a server) different from the information terminal 10. In this case, the information terminal 10 transmits sound information related to the sound acquired by the sound acquisition unit 13 to the server. The server detects a predetermined keyword and a control word by a voice recognition process. Specifically, the server determines whether the sound acquired by the sound acquisition unit 13 includes a predetermined keyword and whether the sound acquired by the sound acquisition unit 13 includes a control word, based on the sound information.

[0122] Alternatively, the detection of the predetermined keyword may be performed by the voice recognition unit 182, and the detection of the control word may be performed by the server.

[0123] (5-9) Variation 9 In the above embodiment, the information terminal 10 is configured as a dwelling terminal (intercom master unit), but is not limited to this configuration.

[0124] The information terminal 10 may be any terminal configured to be able to communicate with the intercom entrance device (lobby intercom 20, entrance slave unit 40), and may be, for example, a tablet terminal or a smartphone.

[0125] (5-10) Variation 10 The functions relating to the sound adjustment process provided in the information terminal 10 of the above embodiment (sound acquisition unit 13, sound processing unit 181) may be applied to an intercom entrance device (lobby intercom 20, entrance slave unit 40).

[0126] Similarly, the functions relating to the audio adjustment processing provided in the information terminal 10A of the first modified example (sound acquisition unit 13, human detection unit 19, audio processing unit 181A, detection processing unit 186) may be applied to an intercom entrance device (lobby intercom 20, entrance unit 40).

[0127] (5-11) Variation 11 The voice processing unit 181 provided in the information terminal 10 of the above embodiment may be configured to perform processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target from being processed in the voice recognition processing.

[0128] For example, when the sound output by the output unit 15 (speaker) is input to the sound acquisition unit 13, the sound processing unit 181 included in the information terminal 10 may suppress or remove echoes on the sound by using an echo canceller. That is, when the sound output by the output unit 15 is input to the sound acquisition unit 13, the sound processing unit 181 may attenuate the sound by using an echo canceller. Since the sound processing unit 181 performs an attenuation process (attenuation process) on the sound output by the output unit 15, the sound recognition process performed by the sound recognition unit 182 on the sound is suppressed. That is, by the sound processing unit 181 performing an attenuation process on the sound output by the output unit 15, the sound can be excluded from the target of the sound recognition process.

[0129] Alternatively, the voice processing unit 181 may determine whether or not voice is being output from the output unit 15, and when it determines that voice is being output from the output unit 15, control the voice recognition unit 182 to suppress voice recognition processing by the voice recognition unit 182. By performing processing to control the voice recognition unit 182 to suppress voice recognition processing by the voice recognition unit 182, the voice processing unit 181 can exclude the voice output by the output unit 15 from being processed in the voice recognition processing.

[0130] For example, when the information terminal 10 is communicating with the lobby intercom 20, the voice transmitted from the lobby intercom 20 may be input to at least one of the first microphone 131 and the second microphone 132, and voice recognition processing may be performed. In this case, the voice transmitted from the lobby intercom 20 may be used to unlock the door for entering through the shared entrance E1. Control WordsIf the voice includes the above, the control processing unit 183 controls unlocking of the door for entering through the common entrance E1 based on the result of the voice recognition process. That is, the door of the common entrance E1 may be unlocked by a third party (e.g., a visitor) regardless of the intention of the user of the dwelling unit E2.

[0131] Therefore, the information terminal 10 of the 11th modification includes a sound acquisition unit 13, a voice processing unit 181, and a control processing unit 183. The sound acquisition unit 13 acquires sound including the user's voice. The voice processing unit 181 performs a voice adjustment process on the sound acquired by the sound acquisition unit 13. The control processing unit 183 performs control based on the result of a voice recognition process on the sound processed by the voice processing unit 181. The voice processing unit 181 is configured to perform a process of excluding the voice received from the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target from the voice recognition process.

[0132] According to this configuration, the voice processing unit 181 performs processing to exclude the voice received from the intercom entrance device, which is the communication target, from being processed in the voice recognition processing, thereby reducing the possibility that the door will be opened by a third party.

[0133] In addition, in the 11th modification, it is not essential that the sound acquisition unit 13 has multiple microphones (first microphone 131, second microphone 132). The sound acquisition unit 13 may be configured to have one microphone. When the sound acquisition unit 13 has one microphone, it is not essential that the audio processing unit 181 estimates the distance and direction of the user. The audio processing unit 181 may be configured to at least suppress or remove echoes from the sound signal acquired by the sound acquisition unit 13 (one microphone) as an audio adjustment process.

[0134] Moreover, the processing method of the information terminal 10 according to the modified example 11 is a processing method used in an information terminal operating as an intercom device. The processing method includes a sound acquisition step, a voice processing step, and a control processing step. The sound acquisition step acquires sound including the user's voice. The voice processing step performs a voice adjustment process on the sound acquired in the sound acquisition step. The control processing step performs control based on the result of voice recognition processing on the sound processed in the voice processing step. The voice processing step performs processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target from being processed in the voice recognition processing. The program according to one aspect is a program for causing a computer system to function as the information terminal 10 according to the modified example 11 or the processing method of the information terminal 10 according to the modified example 11.

[0135] Moreover, the modification 11 may be applied to the information terminal 10A of the modification 1. In this case, the voice processing unit 181A of the information terminal 10A is configured to perform processing to exclude the voice received from the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target from the processing target in the voice recognition processing.

[0136] (Other variations) The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. In addition, the same function as the information terminal 10 may be embodied in a processing method, a computer program, or a non-transitory recording medium on which a program is recorded. The processing method of the information terminal 10 according to one aspect is a processing method used in an information terminal that operates as an intercom device. The processing method includes processing steps. The processing steps perform a voice adjustment process for at least one of receiving and speaking based on at least one of the distance and the direction of the user relative to the information terminal 10. Here, the processing steps correspond to steps S5 and S7 shown in FIG. 3. The program according to one aspect is a program for causing a computer system to function as the above-mentioned information terminal 10 or the processing method of the information terminal 10.

[0137] The information terminal 10 or the processing method of the information terminal 10 in the present disclosure includes a computer system. The computer system has a processor and a memory as hardware. The processor executes a program recorded in the memory of the computer system, thereby realizing the function of the information terminal 10 or the processing method of the information terminal 10 in the present disclosure. The program may be pre-recorded in the memory of the computer system, or may be provided through an electric communication line. The program may also be recorded in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system and provided. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or reconfigure the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed across multiple chips. The chips may be integrated in one device or distributed across multiple devices.

[0138] Furthermore, it is not essential for the information terminal 10 that multiple functions are integrated into one housing, and the components of the information terminal 10 may be distributed across multiple housings. Furthermore, at least some of the functions of the information terminal 10, for example, some of the functions of the information terminal 10 may be realized by the cloud (cloud computing) or the like.

[0139] (summary) As described above, the information terminal (10, 10A) of the first aspect is an information terminal that operates as an intercom device. The information terminal (10, 10A) performs a sound adjustment process for at least one of receiving and speaking, based on at least one of the distance and the direction of the user relative to the information terminal (10, 10A).

[0140] This configuration allows clear conversation depending on the user's location.

[0141] The information terminal (10, 10A) of the second aspect is the same as that of the first aspect and includes a sound acquisition unit (13), a voice processing unit (181, 181A), and a control processing unit (183). The sound acquisition unit (13) acquires sound including the user's voice. The voice processing unit (181) performs a voice adjustment process on the sound acquired by the sound acquisition unit (13) using at least one of the distance and the direction as a predetermined condition. The control processing unit (183) performs control based on a result of a voice recognition process on the sound processed by the voice processing unit (181).

[0142] According to this configuration, clear communication can be performed according to the user's location, and control can be performed according to the voice uttered by the user.

[0143] In the information terminal (10, 10A) of the third aspect, in the second aspect, the predetermined condition includes a distance of the user from the information terminal (10). The sound processing unit (181, 181A) changes the volume of the user's voice acquired by the sound acquisition unit (13) according to the distance.

[0144] According to this configuration, it is possible to set an appropriate volume according to the distance of the user from the information terminal (10, 10A).

[0145] In the information terminal (10, 10A) of the fourth aspect, in the second or third aspect, the distance includes a result estimated based on the sound acquired by the sound acquisition unit (13).

[0146] According to this configuration, clear conversation can be carried out based on the result estimated from the sound acquired by the sound acquisition unit (13).

[0147] In the information terminal (10, 10A) of the fifth aspect, in the second or third aspect, the distance includes a result estimated based on a result of detection by a human detection unit (19) that detects a person.

[0148] According to this configuration, clear conversation can be carried out based on the result estimated from the result detected by the human detection unit (19).

[0149] In the information terminal (10, 10A) of the sixth aspect, in any of the second to fifth aspects, the voice processing unit (181) executes acquisition of information as a predetermined condition, triggered by the sound acquisition unit (13) acquiring a predetermined keyword as a voice uttered by the user.

[0150] According to this configuration, it is possible to set the timing for executing the acquisition of information as the predetermined condition.

[0151] The information terminal (10, 10A) of the seventh aspect is in any one of the second to sixth aspects, and further includes a voice recognition unit (182). The voice recognition unit (182) performs voice recognition processing on the sound processed by the voice processing unit (181).

[0152] According to this configuration, it is possible to perform voice recognition on the voice uttered by the user. Specifically, the voice recognition unit 182 of the information terminal 10, 10A performs voice recognition on the sound processed by the voice processing unit 181, and therefore, more appropriate voice recognition can be performed.

[0153] The information terminal (10, 10A) of the eighth aspect is in any one of the second to seventh aspects and further includes a display unit (16) and a display processing unit (184). The display unit (16) displays an image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target. The display processing unit (184) causes the display unit (16) to display the image. The display processing unit (184) changes the display mode of the image displayed by the display unit (16) in accordance with a predetermined condition.

[0154] According to this configuration, the user can easily confirm who the visitor is, regardless of the user's location.

[0155] In the information terminal (10, 10A) of the ninth aspect, in any one of the second to eighth aspects, the voice processing unit (181, 181A) performs processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target from being processed in the voice recognition processing.

[0156] This configuration reduces the possibility that the door will be unlocked by a third party.

[0157] The intercom system (1) of the tenth aspect includes an information terminal (10, 10A) of any one of the first to ninth aspects, and an intercom entrance device (lobby intercom 20, entrance slave unit 40) that communicates with the information terminal (10, 10A).

[0158] This configuration allows clear conversation depending on the user's location.

[0159] The processing method of the eleventh aspect is a processing method used in an information terminal (10, 10A) that operates as an intercom device. The processing method includes processing steps. The processing steps perform a sound adjustment process for at least one of receiving and speaking, based on at least one of a distance and a direction of a user with respect to the information terminal (10, 10A).

[0160] This processing method allows clear calls depending on the user's location.

[0161] A program according to a twelfth aspect is a program for causing a computer to execute the processing method according to the eleventh aspect.

[0162] This program allows clear calls depending on the user's location.

[0163] The information terminal (10, 10A) of the thirteenth aspect includes a sound acquisition unit (13), a voice processing unit (181, 181A), and a control processing unit (183). The sound acquisition unit (13) acquires sound including the user's voice. The voice processing unit (181) performs a voice adjustment process on the sound acquired by the sound acquisition unit (13). The control processing unit (183) performs control based on the result of a voice recognition process on the sound processed by the voice processing unit (181). The voice processing unit (181) is configured to perform a process of excluding a voice received from a communication target, that is, an intercom entrance device (lobby intercom 20, entrance slave unit 40), from the target of the voice recognition process.

[0164] According to this configuration, the voice processing unit (181, 181A) performs processing to exclude the voice received from the intercom entrance device, which is the communication target, from being processed in the voice recognition processing, thereby reducing the possibility that the door will be opened by a third party.

[0165] The intercom system (1) of the fourteenth aspect includes the information terminal (10, 10A) of the thirteenth aspect, and an intercom entrance device (lobby intercom 20, entrance slave unit 40) that communicates with the information terminal (10, 10A).

[0166] This configuration reduces the possibility that the door will be unlocked by a third party.

[0167] The processing method of the fifteenth aspect is a processing method used in an information terminal that operates as an intercom device. The processing method includes a sound acquisition step, a voice processing step, and a control processing step. The sound acquisition step acquires sound including the user's voice. The voice processing step performs a voice adjustment process on the sound acquired in the sound acquisition step. The control processing step performs control based on the result of voice recognition processing on the sound processed in the voice processing step. The voice processing step performs processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target from being processed in the voice recognition processing.

[0168] This processing method can reduce the possibility of the door being unlocked by a third party.

[0169] A program according to a sixteenth aspect is a program for causing a computer to execute the processing method according to the fifteenth aspect.

[0170] This processing method can reduce the possibility of the door being unlocked by a third party. [Explanation of symbols]

[0171] 1. Intercom System 10,10A Information terminal 13 Sound acquisition section 16 Display section 19 Human detection unit 20 Lobby intercom (entrance intercom device) 40 Entrance intercom unit (entrance intercom device) 181,181A Audio processing unit 182 Voice Recognition Unit 183 Control processing section 184 Display Processing Unit

Claims

1. An information terminal that operates as an intercom device, A sound acquisition unit that acquires a sound including a user's voice; a sound processing unit that performs sound adjustment processing on the sound acquired by the sound acquisition unit, using at least one of a distance and a direction of the user relative to the information terminal as a predetermined condition to be estimated; a voice recognition unit that performs voice recognition processing on the sound processed by the voice processing unit; a control processing unit that performs control based on a result of the voice recognition processing for the sound processed by the voice processing unit, The audio processing unit includes: When a predetermined keyword is included in the voice uttered by the user, the estimation target is estimated; According to the estimation result, the voice adjustment process is performed for at least one of the speech reception and the speech generation. the voice recognition unit sets a call start state when the voice uttered by the user includes the predetermined keyword, and after setting the call start state, determines whether or not a control word different from the predetermined keyword is included in the sound processed by the voice processing unit; when the voice recognition unit determines that the sound processed by the voice processing unit includes the control word, the control processing unit performs control according to the control word; The control word includes a word corresponding to the control of unlocking a door. Information terminal.

2. The predetermined condition includes the distance of the user to the information terminal, The voice processing unit changes a volume of the voice of the user acquired by the sound acquisition unit according to the distance.

2. An information terminal according to claim 1.

3. The distance includes a result estimated based on the sound acquired by the sound acquisition unit.

3. An information terminal according to claim 1 or 2.

4. The distance includes a result estimated based on a result detected by a human detection unit that detects a person.

3. An information terminal according to claim 1 or 2.

5. The voice processing unit is triggered by the acquisition of the predetermined keyword by the sound acquisition unit, and executes estimation of information as the predetermined condition. An information terminal according to any one of claims 1 to 4.

6. A display unit that displays an image captured by an intercom entrance device that is a communication target; A display processing unit for displaying the image on the display unit, the display processing unit changes a display mode of the image displayed by the display unit in accordance with the predetermined condition. An information terminal according to any one of claims 1 to 5.

7. The voice processing unit performs processing to exclude voice received from an intercom entrance device that is a communication target from being processed in the voice recognition processing. An information terminal according to any one of claims 1 to 6.

8. An information terminal according to any one of claims 1 to 7, and an intercom entrance device that communicates with the information terminal. Intercom system.

Images