Door phone base unit and registration method

Abstract

To provide a door phone master unit capable of reducing the inconvenience that the authenticating person suffers when registering authentication data.SOLUTION: A door phone master unit in an embodiment capable of unlocking a front door includes: a receiving unit that receives an image of a person taken by a camera of the wireless mobile terminal from a wireless mobile terminal; an extraction unit that extracts biometric data for authentication of the person used to unlock the front door from the image; and a registration unit that registers the biometric data for authentication.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a door phone master unit and a registration method. [Background technology]

[0002] Conventionally, doorphone systems (or intercom systems) have been known that have the function of authenticating visitors by comparing video data received from a camera-equipped doorphone slave with pre-stored (registered) facial data (see, for example, Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-295603 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-120521 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, the pre-stored facial data is acquired by capturing a photograph (image) of the visitor's face with a camera in a camera-equipped intercom slave unit, for example, when the visitor visits for the first time. The camera-equipped intercom slave unit that captures the visitor's face in this way is generally installed outside the building (near the front door, nameplate, or mailbox, etc.) or at the entrance of an apartment building.

[0005] Therefore, in order to acquire and register the facial data of a person (person to be authenticated), not limited to a visitor (including, for example, a resident), the person must go out of his / her way to the outside of the building or to the entrance of the apartment complex and wait for a certain period of time. Depending on the season, the person may have to wait outside the building in the cold, or may have to wait among other people. As such, the person to be authenticated may suffer inconvenience in registering authentication data such as facial data.

[0006] Non-limiting examples of the present disclosure contribute to providing an indoor phone master unit and a registration method that can reduce the inconvenience that an authenticatee experiences when registering authentication data. [Means for solving the problem]

[0007] A door phone master unit according to one embodiment of the present disclosure is capable of unlocking a front door and includes a receiving unit that receives from a wireless mobile terminal an image of a person captured by a camera possessed by the wireless mobile terminal, an extracting unit that extracts from the image biometric data of the person for authentication used to unlock the front door, and a registering unit that registers the biometric data for authentication.

[0008] A registration method according to one embodiment of the present disclosure is executed by a door phone master unit capable of unlocking a front door, receives an image of a person taken by a camera possessed by a wireless mobile terminal from the wireless mobile terminal, extracts from the image authentication biometric data of the person to be used to unlock the front door, and registers the authentication biometric data.

[0009] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. [Effects of the Invention]

[0010] According to one embodiment of the present disclosure, authentication data is registered based on an image of a person captured using a camera possessed by a wireless mobile terminal, without using a camera possessed by a door phone sub-unit, thereby reducing the inconvenience that the person to be authenticated experiences when registering authentication data.

[0011] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and / or benefits may be provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of them may be provided to obtain one or more identical features. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a system configuration diagram illustrating an example of a configuration of a door phone system according to an embodiment of the present disclosure. [Figure 2] A simplified example of the door phone system. [Figure 3] FIG. 1 is a block diagram illustrating an example of a configuration of a door phone master unit according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a block diagram illustrating an example of a configuration of a front door slave unit according to an embodiment of the present disclosure. [Figure 5] 1 is a flowchart illustrating an example of an operation of a wireless terminal according to an embodiment of the present disclosure. [Figure 6] 1 is a flowchart illustrating an example of an operation of a door phone master unit according to an embodiment of the present disclosure. [Figure 7] 1 is a flowchart illustrating an example of an operation of a wireless terminal according to an embodiment of the present disclosure. [Figure 8] 1 is a flowchart illustrating an example of an operation of a door phone master unit according to an embodiment of the present disclosure. [Figure 9A] 1 is a sequence diagram illustrating an example of an operation of a door phone system according to an embodiment of the present disclosure. [Figure 9B] 1 is a sequence diagram illustrating an example of an operation of a door phone system according to an embodiment of the present disclosure. [Figure 10A] FIG. 10 is a diagram illustrating an example of a display screen of a wireless terminal according to an embodiment of the present disclosure. [Figure 10B] FIG. 10 is a diagram illustrating an example of a display screen of a wireless terminal according to an embodiment of the present disclosure. [Figure 10C] FIG. 10 is a diagram illustrating an example of a display screen of a wireless terminal according to an embodiment of the present disclosure. [Figure 10D]FIG. 10 is a diagram illustrating an example of a display screen of a wireless terminal according to an embodiment of the present disclosure. [Figure 11A] 1 is a flowchart illustrating an example of an operation of a front door slave unit according to an embodiment of the present disclosure. [Figure 11B] 1 is a flowchart illustrating an example of an operation of a front door slave unit according to an embodiment of the present disclosure. [Figure 12A] 1 is a flowchart illustrating an example of an operation of a door phone master unit according to an embodiment of the present disclosure. [Figure 12B] 1 is a flowchart illustrating an example of an operation of a door phone master unit according to an embodiment of the present disclosure. [Figure 12C] 1 is a flowchart illustrating an example of an operation of a door phone master unit according to an embodiment of the present disclosure. [Figure 13] FIG. 1 is a diagram illustrating an example of the operation of a wireless terminal according to an embodiment of the present disclosure. [Figure 14] FIG. 10 is a diagram illustrating an example of a display screen of a wireless terminal according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or redundant explanation of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0014] The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] (Embodiment) <Door phone system> First, a door phone system according to an embodiment of the present disclosure will be described.

[0016] 1 is a system configuration diagram showing an example of the configuration of a door phone system 10 according to the present embodiment. In FIG. 1, the surrounding environment of the system configuration is also shown.

[0017] As shown in FIG. 1, the door phone system 10 includes, for example, a door phone master unit 100 placed inside a building 30 which is the home of a user 20, a front door slave unit (which may also be called a door phone slave unit) 200 placed near the front door 31 (or nameplate or mailbox) of the building 30, and an electric lock 300 provided on the front door 31.

[0018] Intercom master unit 100 includes, for example, a speaker, a display, a monitor button, a call button, a microphone, and a lock / unlock button. Intercom master unit 100 is initially set up to pre-register front door slave unit 200 and electric lock 300. In addition to the function of responding to calls (starting a call), intercom master unit 100 also has the function of displaying video of the area around the front door transmitted from front door slave unit 200, the function of accepting operations to lock / unlock electric lock 300 of front door 31, the function of registering faces for authentication, and the function of authenticating visitors by face.

[0019] The speaker outputs audio from the front door slave unit 200 to the outside of the front door unit 100, for example, when the front door unit 100 and the front door slave unit 200 are in a call state. The display displays, for example, an image captured by a camera of the front door slave unit 200. For example, when the monitor button is pressed, the camera of the front door slave unit 200 is activated and the image captured by the camera of the front door slave unit 200 begins to be displayed on the display. For example, when the call button is pressed, the front door unit 100 and the front door slave unit 200 are in a call state. The microphone collects sounds around the front door unit 100, for example. For example, when the lock / unlock button is pressed, the electric lock 300 of the front door 31 is locked / unlocked.

[0020] Doorway slave unit 200 includes an infrared sensor (motion sensor), a call button, a speaker, a microphone, and a camera. A two-wire cable 201, for example, consisting of a pair of copper wires, is laid between doorway slave unit 200 and indoor apparatus 100. In addition to the calling and conversation functions, doorway slave unit 200 has a function of activating a camera when a person is detected by the infrared sensor, capturing an image of the area around the entrance and transmitting the image to indoor apparatus 100. Doorway slave unit 200 and indoor apparatus 100 may communicate wirelessly according to, for example, the DECT (Digital Enhanced Cordless Telecommunications) protocol.

[0021] The infrared sensor detects, for example, a person standing in front of the front door slave unit. When the call button is pressed, for example, it sends a visitor notification to the indoor phone base unit 100. The speaker outputs audio from the indoor phone base unit 100 to the outside of the front door slave unit 200 when, for example, the front door slave unit 200 and the front door slave unit 100 are in a call state. The microphone collects, for example, sounds around the front door slave unit 200. The camera captures, for example, video of the area around the front door.

[0022] Electric lock 300 is a key device that unlocks / locks front door 31 in response to an unlock request (instruction) / lock request (instruction), which is an electric signal, in addition to normal key operation (operation using a physical key) into a keyhole. An electric lock code 301, which is, for example, a JEM-A standard code, is laid between electric lock 300 and indoor phone master unit 100. Electric lock 300 unlocks / locks under the control of indoor phone master unit 100.

[0023] The door phone system 10 also includes a communication router 400 placed inside the building 30, a server 500 connected to a public network 510 such as the Internet, and a wireless terminal (which may also be referred to as a wireless mobile terminal) 600 such as a smartphone or tablet that can be taken outside the building 30. The wireless terminal 600 includes a wireless terminal carried by the user 20 and a wireless terminal carried by a person other than the user 20 (for example, a relative of the user 20). In the following, an example in which the wireless terminal 600 is mainly a smartphone will be described.

[0024] Communication router 400 connects to indoor apparatus 100, wireless terminal 600, and public network 510 via wireless communication lines 401, 402, and 403, respectively, and relays communications between indoor apparatus 100 and wireless terminal 600 and public network 510, and relays communications between indoor apparatus 100 and wireless terminal 600. Wireless communication lines 401 and 402 may be, for example, Wi-Fi (registered trademark; hereinafter omitted) lines, and wireless communication line 403 may be, for example, a cellular (mobile) line such as an LTE (Long Term Evolution) line or an NR (New Radio) line. Alternatively, indoor apparatus 100 and wireless terminal 600 may be directly connected via a wireless communication line (e.g., using Wi-Fi Direct or Bluetooth (registered trademark)) without going through communication router 400, and communication router 400 may be connected to public network 510 via a cable line, optical fiber line, or the like instead of wireless communication line 403.

[0025] When the power of the intercom master unit 100 is turned on, the server 500 connects to the intercom master unit 100 by connecting to the communication router 400 via the public network 510 or the like, and registers the intercom master unit 100. Thereafter, the server 500 remains constantly connected to the intercom master unit 100 via the public network 510 or the like, and exchanges various information with the intercom master unit 100. An encrypted communication path may be established between the server 500 and the intercom master unit 100, and the server 500 may perform encrypted communication with the intercom master unit 100. In addition, the server 500 receives a request from the wireless terminal 600 of the user 20 to register the face of the user of the remote wireless terminal 600 (not shown), and performs pairing between the intercom master unit 100 and the remote wireless terminal 600. The server 500 may be referred to as an authentication server.

[0026] For example, when wireless terminal 600 is located inside building 30, wireless terminal 600 connects to communication router 400 via wireless communication line 402 to access intercom master unit 100. When wireless terminal 600 is located outside building 30, wireless terminal 600 connects to public network 510 via wireless communication line 601 and accesses intercom master unit 100 via server 500. Wireless communication line 601 may be, for example, a cellular (mobile) line such as an LTE line or an NR line. Wireless terminal 600 may perform encrypted communication with intercom master unit 100 from inside and outside building 30.

[0027] The wireless terminal 600 also includes a speaker, a touch panel display, a microphone, a (terminal) monitor button, a (terminal) call button, a (terminal) hang-up button, a (terminal) unlock button, and a (terminal) lock button. The (terminal) monitor button, the (terminal) call button, the (terminal) hang-up button, the (terminal) unlock button, and the (terminal) lock button may be, for example, image buttons (icons) displayed on a touch panel display that can be used on an application for using the functions of the door phone system 10, which will be described later.

[0028] The speaker outputs audio from the indoor phone base unit 100 to the outside of the wireless terminal 600, for example, when the wireless terminal 600 and the indoor phone base unit 100 are in a call state. The touch panel display displays, for example, an image captured by a camera of the front door slave unit 200, a (terminal) monitor button, a (terminal) call button, a (terminal) disconnect button, a (terminal) unlock button, a (terminal) lock button, etc. When the (terminal) monitor button is pressed (tapped), for example, it starts outputting an image of the area around the front door sent from the front door slave unit 200 via the front door mobile unit 100. When the (terminal) call button is pressed (tapped), for example, it starts a call between the wireless terminal 600 and the front door slave unit 200 via the front door mobile unit 100. When the (terminal) disconnect button is pressed (tapped), for example, it disconnects the connection (communication, call) between the wireless terminal 600 and the front door slave unit 100. For example, when the (terminal) unlock button is pressed (tapped), it unlocks the electric lock 300 of the front door 31 via the intercom master unit 100. For example, when the (terminal) lock button is pressed (tapped), it locks the electric lock 300 of the front door 31 via the intercom master unit 100.

[0029] In response to a request from a wireless terminal 600 located within building 30 and connected to parent unit 100 via communication router 400 or directly, parent unit 100 registers the wireless terminal 600. Parent unit 100 appropriately connects to wireless terminal 600 and exchanges various information with wireless terminal 600.

[0030] As shown in FIG. 2, which illustrates a simplified example of the intercom system 10, the intercom master unit 100 transfers video, audio, and various control information between the front door slave unit 200 and the wireless terminal 600. Furthermore, the intercom master unit 100 receives an unlock / lock instruction (operation of the (terminal) unlock button / lock button) from the wireless terminal 600 and unlocks / locks the electric lock 300. Therefore, the intercom master unit 100 has the function of responding to a call (starting a call), displaying an image of the area around the front door, and enabling the wireless terminal 600 to perform the operation of unlocking / locking the electric lock 300. Although FIG. 2 illustrates a plurality of front door slave units 200, the number of front door slave units 200 may be any number equal to or greater than one.

[0031] In such doorphone system 10, user 20 can be notified when there is a visitor at his / her home not only when he / she is inside building 30 but also when he / she is outside building 30. Furthermore, in such doorphone system 10, user 20 can talk to the visitor while checking the doorphone video and can remotely unlock front door 31.

[0032] As described above, doorphone systems with the function of authenticating visitors using facial data are known, but there is room for improvement in terms of convenience when registering facial data. Therefore, for example, when user 20 is inside building 30, doorphone master unit 100 registers user 20's face by receiving a photograph of user 20's face taken by user 20's wireless terminal 600 from user 20's wireless terminal 600. Also, when a person, such as a relative of user 20, is remotely located, doorphone master unit 100 registers the person's face by receiving a photograph of the person's face taken by that person's wireless terminal 600 from that person's wireless terminal 600 via public network 510, server 500, etc. In this way, by registering the faces of user 20 and other people without using a camera installed in entrance slave unit 200, it is possible to minimize inconvenience to user 20 and other people.

[0033] <Configuration of each device> Next, the configuration of the main devices of the door phone system 10 will be described. Each device constituting the door phone system 10 includes, for example, a central processing unit (CPU), a storage medium such as a read-only memory (ROM) that stores a control program, a working memory such as a random access memory (RAM), and a communication circuit (not shown). In this case, the functions of each functional unit (block) described below are realized by the CPU executing the control program. Alternatively, each functional unit may be realized by a dedicated device or circuit rather than a general-purpose processing device (such as a CPU), or may be realized by a combination of a general-purpose processing device and a dedicated device or circuit.

[0034] <Configuration of the door phone master unit> FIG. 3 is a block diagram showing an example of the configuration of indoor apparatus 100 according to the embodiment of the present disclosure.

[0035] Indoor phone master unit 100 includes video processing unit 110, display output unit 120, audio processing unit 130, audio output unit 140, audio input unit 150, call control unit 160, network control unit 170, storage unit 180, facility equipment control unit 190, and one-time password generation unit 195. As described above, indoor phone master unit 100 may be a computer including, for example, a CPU, ROM, RAM, etc. The CPU, for example, reads a program corresponding to the processing content from ROM, loads it into RAM, and controls the operation of indoor phone master unit 100 in cooperation with the loaded program.

[0036] The video processing unit 110 processes the input video data and generates an image to be displayed by the display output unit 120. The video processing unit 110 includes a video data input unit 112, a video data decoding unit 114, a face authentication storage unit 116, and a face authentication processing unit 118.

[0037] Video data input unit 112 inputs streaming video data from front door slave unit 200. The video data may be digital or analog data. Video data input unit 112 outputs the streaming video data input from front door slave unit 200 to video data decoding unit 114.

[0038] The video data decoding unit 114 converts the streaming video data input from the video data input unit 112 into image data. If the image data is used for face authentication, the video data decoding unit 114 outputs the image data to the face authentication processing unit 118. If the image data is not used for face authentication, the video data decoding unit 114 outputs the image data to the display output unit 120 via the call control unit 160. The images are, for example, still images. In one example, the video data is converted into still image data for 15 still images per second.

[0039] The face authentication storage unit 116 stores a registration database in which a face image or facial feature values ​​(also referred to as face data or simply faces) of a person (person to be authenticated) to be authenticated by the face authentication processing unit 118 is registered in association with identification information such as the person's name. The facial feature values ​​are any values ​​used by the face authentication processing unit 118 for face authentication, such as a cascade classifier used by the face authentication processing unit 118 for face detection, parameters of a neural network used for face matching, facial expression data, LBPH (Local Binary Patterns Histograms), SURF (Speeded Up Robust Features) features, etc. Registering at least one of a face image and facial feature values ​​is simply referred to as registering a face. The registration database may be stored in the storage unit 180.

[0040] The face authentication processing unit 118 detects and extracts the face of a person included in the image data input from the video data decoding unit 114, and performs face authentication (identification) by comparing the detected and extracted face with face data stored in the registration database of the face authentication storage unit 116. The person to be authenticated may be, for example, a visitor. If face authentication is successful, the face authentication processing unit 118 outputs a signal (information) indicating success of face authentication to the electric lock control unit 192 via the network control unit 170. Although not shown in FIG. 3 , if face authentication is unsuccessful, the face authentication processing unit 118 transmits a signal (information) indicating failure of face authentication via the network control unit 170 to a predetermined wireless terminal 600 among the wireless terminals 600 registered in the indoor phone master unit 100 (for example, the wireless terminal 600 of user 20, who is a resident of building 30).

[0041] Furthermore, as will be described later, in response to a request from the wireless terminal 600 of the user 20, for example, the face authentication processing unit 118 extracts the face (biometric data for authentication) of the user 20 or another person, which will be used for face authentication later, from a video or image received from the same or a different wireless terminal 600 via the network control unit 170. Then, the face authentication processing unit 118 registers (stores) the extracted face in a registration database in the face authentication storage unit 116 together with identification information, such as the name of the user 20 or another person, input by the user 20.

[0042] The face authentication processing unit 118 is an example of an extraction unit according to the present disclosure, an example of a registration unit according to the present disclosure, and an example of an authentication unit according to the present disclosure.

[0043] The display output unit 120 displays the image input from the video processing unit 110. The display output unit is, for example, a display such as an LCD display device or an OLED display device.

[0044] Voice processing unit 130 processes a linear electrical signal representing voice input from voice input unit 150 via call control unit 160, and outputs voice data. Voice processing unit 130 also processes voice data input from front door slave unit 200, and outputs a linear electrical signal representing voice. Voice processing unit 130 includes a voice data input unit 132, a voice data decoding unit 134, a voice data encoding unit 136, and a voice data output unit 138.

[0045] The audio data input unit 132 inputs streaming audio data from the front door slave unit 200. The audio data represents, for example, the voice of a visitor speaking to the front door slave unit 200. The audio data input unit 132 outputs the streaming audio data input from the front door slave unit 200 to the audio data decoding unit 134.

[0046] The audio data decoding unit 134 decodes the streaming audio data input from the audio data decoding unit 134, and generates a linear electrical signal representing the audio. In this embodiment, the decoding is digital-to-analog conversion. The decoding method corresponds to the encoding method used by the audio data encoding unit 236 (see FIG. 4) of the front door slave unit 200. The audio data decoding unit 134 outputs the generated linear electrical signal representing the audio to the audio output unit 140 via the call control unit 160.

[0047] The audio data encoding unit 136 encodes a linear electrical signal representing audio input from the audio input unit 150 via the call control unit 160 to generate streaming audio data. In this embodiment, the encoding is analog-to-digital conversion. The encoding method corresponds to the decoding method used by the audio data decoding unit 234 (see FIG. 4 ) of the front door slave unit 200. The audio data encoding unit 136 outputs the generated streaming audio data to the audio data output unit 138.

[0048] The audio data output unit 138 outputs the streaming audio data input from the audio data encoding unit 136 to the front door slave unit 200 .

[0049] Audio output unit 140 converts a linear electrical signal representing audio input from audio data decoding unit 134 via call control unit 160 into audio, and outputs the audio to the outside of indoor apparatus 100. In this embodiment, audio output unit 140 is a speaker.

[0050] Audio input unit 150 converts audio around indoor apparatus 100 into a linear electrical signal. In this embodiment, audio input unit 150 is a microphone.

[0051] The call control unit 160 controls calls from the front door slave unit 200. The call control unit 160 includes an incoming call processing unit 162, a timer processing unit 164, and a call processing unit 166.

[0052] The incoming call processing unit 162 processes an incoming call from the front door slave unit 200. In this embodiment, in response to notification of an incoming call from the front door slave unit 200, the incoming call processing unit 162 notifies the timer processing unit 164 of the incoming call.

[0053] Timer processing unit 164 performs timer processing from the reception of an incoming call from front door unit 200 to the start of a call between indoor apparatus 100 and front door unit 200. In this embodiment, in response to a notification of an incoming call from incoming call processing unit 162, timer processing unit 164 starts outputting a linear electrical signal representing a ring tone to audio output unit 140, and starts communication of video data between indoor apparatus 100 and front door unit 200. Also in this embodiment, in response to detecting that an answer button (not shown) provided on indoor apparatus 100 has been pressed, timer processing unit 164 stops outputting the linear electrical signal representing the ring tone to audio output unit 140 and notifies call processing unit 166 of the answer. For example, the time from the start to the end of output of the linear electrical signal representing the ring tone is three seconds.

[0054] Call processing unit 166 processes calls between indoor apparatus 100 and front door slave unit 200. In this embodiment, call processing unit 166 starts communication of audio data between indoor apparatus 100 and front door slave unit 200 in response to a response notification from timer processing unit 164. Also, in this embodiment, call processing unit 166 disconnects video and audio communication between indoor apparatus 100 and front door slave unit 200 in response to detecting the end of the call.

[0055] Network control unit 170 controls communication in accordance with a communication protocol that corresponds to the type of network through which indoor apparatus 100 communicates. Network control unit 170 includes a communication processing unit 172.

[0056] Communication processing unit 172 performs communication (transmission and reception) between indoor phone master unit 100 and a communication partner of indoor phone master unit 100 in accordance with a communication protocol followed by indoor phone master unit 100 and the communication partner of indoor phone master unit 100. Communication processing unit 172 is an example of a receiving unit according to the present disclosure.

[0057] 3, when indoor apparatus 100 and a device such as wireless terminal 600 communicate via server 500, video, audio, and various control information are communicated via network control unit 170 (communication processing unit 172). When indoor apparatus 100 is the transmitting side, video, audio, and various control information are transmitted via call control unit 160 and network control unit 170 (communication processing unit 172) as appropriate. When indoor apparatus 100 is the receiving side, video, audio, and various control information are received via network control unit 170 (communication processing unit 172) and are stored in storage unit 180, output to display output unit 120, or output to audio output unit 140 as appropriate via call control unit 160.

[0058] Storage unit 180 stores data necessary for operation of indoor apparatus 100, programs executed by the CPU, data received from devices such as wireless terminal 600 of user 20 via network control unit 170, data generated by functional units of indoor apparatus 100, etc. Storage unit 180 may also store the registration database described above.

[0059] The facility equipment control unit 190 communicates signals with the electric lock 300 of the entrance door 31 and controls the locking and unlocking of the electric lock 300. The facility equipment control unit 190 includes an electric lock control unit 192 and an electric lock communication unit 194.

[0060] The electric lock control unit 192 outputs a signal (unlock instruction) instructing the electric lock 300 to be unlocked to the electric lock communication unit 194 in response to a signal (information) input via the network control unit 170 from the face authentication processing unit 118 or the wireless terminal 600. The electric lock control unit 192 also inputs a signal (information) from the electric lock communication unit 194 indicating that the electric lock 300 has been locked.

[0061] The electric lock communication unit 194 transmits an unlock request input from the electric lock control unit 192 to the electric lock 300. The electric lock communication unit 194 also inputs a signal (information) from the electric lock 300 indicating that the electric lock 300 has been locked. The electric lock communication unit 194 is an example of a transmission unit according to the present disclosure.

[0062] The one-time password generation unit 195 generates a one-time password when, for example, a request to register the face of the user of the remote wireless terminal 600 is received from the wireless terminal 600 of the user 20 via the network control unit 170. The one-time password generation unit 195 transmits the generated one-time password via the network control unit 170 to the wireless terminal 600 that sent the request to register the face and to the server 500.

[0063] A control unit (not shown) of indoor apparatus 100 may control at least some of the functional units of indoor apparatus 100 described above, and may execute functions other than those of these functional units.

[0064] <Configuration of the entrance unit> FIG. 4 is a block diagram showing an example of the configuration of the front door slave unit 200 according to the embodiment of the present disclosure.

[0065] Doorway slave unit 200 includes infrared sensor 210, video generation unit 220, audio processing unit 230, audio output unit 240, audio input unit 250, and control unit 260. As described above, doorway slave unit 200 may be a computer including, for example, a CPU, ROM, RAM, etc. The CPU, for example, reads out a program corresponding to the processing content from ROM, loads it into RAM, and controls the operation of doorway slave unit 200 in cooperation with the loaded program.

[0066] Infrared sensor 210 detects a visitor present in front of front door slave unit 200. Infrared sensor 210 is, for example, a PIR (Passive Infrared Ray) sensor, which is a human detection sensor. When infrared sensor 210 detects a visitor, it activates imaging unit 222 of image generation unit 220, which will be described later.

[0067] Video generation unit 220 generates video data of a subject. The subject is, for example, a visitor (person to be authenticated) standing in front of the front door slave unit. When infrared sensor 210 activates imaging unit 222, video generation unit 220 first generates video data of the subject for authentication, and thereafter continues to generate video data of the subject speaking to, for example, front door slave unit 200. Video generation unit 220 includes imaging unit 222, video data encoding unit 224, and video data output unit 226.

[0068] The imaging unit 222 captures an image of the subject. The imaging unit 222 is, for example, a CMOS camera or a CCD camera. The imaging unit 222 outputs the captured image data of the subject to the image data encoding unit 224.

[0069] The video data encoding unit 224 encodes the video data of the subject input from the imaging unit 222 into a streaming format. In this embodiment, the encoding method may be a digital format such as MPEG-2 format, H.264 format, H.265 format, or H.266 format, or an analog format. The video data encoding unit 224 outputs the encoded video data in streaming format to the video data output unit 226.

[0070] Video data output unit 226 outputs the streaming format video data input from video data encoding unit 224 to indoor apparatus 100 (see FIG. 3).

[0071] Audio processing unit 230 processes a linear electrical signal representing audio input from audio input unit 250 and outputs audio data. Audio processing unit 230 also processes audio data input from indoor apparatus 100 and outputs a linear electrical signal representing audio. Audio processing unit 230 includes an audio data input unit 232, an audio data decoding unit 234, an audio data encoding unit 236, and an audio data output unit 238. Audio data input unit 232, audio data decoding unit 234, audio data encoding unit 236, and audio data output unit 238 have the same functions as audio data input unit 132, audio data decoding unit 134, audio data encoding unit 136, and audio data output unit 138 of indoor apparatus 100 (see FIG. 3), respectively, and therefore description thereof will be omitted.

[0072] The audio output unit 240 is a speaker that converts the linear electrical signal representing the audio input from the audio data decoding unit 234 into audio and outputs the audio to the outside of the front door slave unit 200 .

[0073] The audio input unit 250 is a microphone that converts audio around the entrance slave unit 200 into a linear electrical signal.

[0074] Control unit 260 controls the operation of video generation unit 220 and audio processing unit 230. For example, control unit 260 causes video generation unit 220 to start outputting video data in response to infrared sensor 210 detecting a visitor and activating imaging unit 222. Furthermore, for example, control unit 260 notifies master unit 100 of an incoming call in response to pressing a call button (not shown) provided on front door slave unit 200, and causes video generation unit 220 to start outputting video data and audio processing unit 230 to start outputting audio data. Furthermore, for example, control unit 260 causes video generation unit 220 to stop outputting video data and audio processing unit 230 to stop outputting audio data in response to detecting the end of the call.

[0075] <Configuration of electric lock> A known electric lock configuration can be adopted as the configuration of the electric lock 300. For example, the electric lock 300 includes a JEM-A adapter equipped with a JEM-A standard HA terminal-A to which one end of the electric lock code 301 is connected, and is configured to switch between unlocked and locked states according to an input signal to the terminal.

[0076] With this configuration, electric lock 300 can lock / unlock front door 31 under the control of indoor apparatus 100.

[0077] <Communication router configuration> The communication router 400 may have the configuration of a known communication router that relays communications.

[0078] <Server configuration> The configuration of the server 500 can be a known server configuration.

[0079] Server 500 includes, for example, an authentication processing unit (not shown) that performs authentication processing on a wireless terminal (e.g., wireless terminal 600) that has requested access to indoor apparatus 100. Server 500 further includes a communication unit (not shown) that establishes a connection with wireless terminal 600 and relays communication between wireless terminal 600 and indoor apparatus 100 (via communication router 400, etc.) on the condition that authentication of wireless terminal 600 is successful.

[0080] On the other hand, when the intercom master unit 100 requests access to a wireless terminal (e.g., wireless terminal 600), the server 500 establishes a connection with the wireless terminal 600 via the communication unit without performing authentication processing, and relays communication between the wireless terminal 600 and the intercom master unit 100 (via the communication router 400, etc.).

[0081] <Wireless terminal configuration> The wireless terminal 600 may have the configuration of a known wireless terminal.

[0082] <Operation of each device> Next, examples of the operation of the main devices that make up the door phone system 10 in several phases will be described.

[0083] [Registering a wireless device to the door phone base unit] 5 and 6 are flowcharts showing an example of the operation of registering wireless terminal (smartphone) 600 with indoor phone master unit 100 according to an embodiment of the present disclosure. Fig. 5 is a flowchart showing an example of the operation of smartphone 600, and Fig. 6 is a flowchart showing an example of the operation of indoor phone master unit 100. In the following description, it is assumed that smartphone 600 to be registered is a smartphone owned by user 20 who is a resident of building 30.

[0084] First, an example of the operation of the smartphone 600 will be described with reference to FIG.

[0085] In step S501, the smartphone 600 connects to the communication router 400 (connects to the Wi-Fi network).

[0086] In step S502, smartphone 600 downloads an application for utilizing the functions of intercom system 10 in response to, for example, a user operation (such as pressing (tapping) an icon for downloading an application).

[0087] In step S503, the smartphone 600 installs the downloaded application in response to, for example, a user operation (such as pressing (tapping) an icon for installing the application).

[0088] Note that steps S502 and S503 may be executed before the processing shown in FIG. 5 is executed, in which case steps S502 and S503 are omitted.

[0089] In step S504, the smartphone 600 starts the application that was installed in step S503 or that was previously installed, in response to, for example, a user operation (such as pressing (tapping) an icon to start the application).

[0090] In step S505, in response to, for example, a user operation (such as pressing (tapping) an icon to enter the registration mode), smartphone 600 causes the application to enter (transition to) a registration mode for registering smartphone 600 with indoor phone master unit 100. As a result, smartphone 600 transmits, via the application, to indoor phone master unit 100 a message indicating that smartphone 600 is requesting registration from indoor phone master unit 100.

[0091] In step S506, the smartphone 600 starts a timer set to a predetermined time, for example, 60 seconds.

[0092] In step S507, smartphone 600 waits for a message from indoor apparatus 100 indicating that smartphone 600 has been registered with indoor apparatus 100.

[0093] In step S508, smartphone 600 determines whether a message from indoor apparatus 100 has been received.

[0094] If smartphone 600 receives the message (step S508: YES), smartphone 600 has successfully paired with indoor phone master unit 100, and, for example, displays information indicating that smartphone 600 has been registered to indoor phone master unit 100 via an application, and the flow ends. For example, smartphone 600 has successfully paired with indoor phone master unit 100 by storing (registering) identification information of indoor phone master unit 100 in a storage area of ​​the storage unit of smartphone 600 that is associated with the application.

[0095] On the other hand, if the smartphone 600 has not received a message (step S508: NO), in step S509, the smartphone 600 determines whether the timer has expired.

[0096] If the timer has not expired (step S509: NO), the flow returns to step S507, and the above-described processing is repeated.

[0097] On the other hand, if the timer has expired (step S509: YES), smartphone 600 displays, for example, through an application, information indicating that registration of smartphone 600 with indoor apparatus 100 has failed due to a timeout, and the flow ends.

[0098] Next, an example of the operation of indoor apparatus 100 will be described with reference to FIG.

[0099] In step S601, indoor apparatus 100 (control unit, communication processing unit 172) connects to communication router 400 (connects to the Wi-Fi network).

[0100] In step S602, the door phone master unit 100 (control unit) enters (transitions) from a normal mode in which no operation is performed to a registration mode for registering the smartphone 600, for example, in response to a user operation (such as selecting a menu to enter registration mode).

[0101] In step S603, indoor apparatus 100 (control unit) starts a timer set to a predetermined time. The predetermined time is, for example, 60 seconds.

[0102] In step S604, indoor phone master unit 100 (control unit, communication processing unit 172) waits for a message from smartphone 600 indicating that smartphone 600 is requesting registration from indoor phone master unit 100 (the message sent in step S505 of FIG. 5).

[0103] In step S605, indoor apparatus 100 (control unit, communication processing unit 172) determines whether a message from smartphone 600 has been received.

[0104] If intercom master unit 100 receives the message (step S605: YES), in step S607, intercom master unit 100 (control unit) registers smartphone 600 (pairing is successful). At this time, intercom master unit 100 (display output unit 120) may display information to intercom master unit 100 indicating that smartphone 600 has been registered. For example, intercom master unit 100 (control unit) stores (registers) identification information of smartphone 600 in a storage area of ​​storage unit 180 that stores a pairing partner, thereby achieving successful pairing.

[0105] In step S608, indoor apparatus 100 (control unit, communication processing unit 172) transmits a message indicating that smartphone 600 has been registered (the message that smartphone 600 waits for in step S507 of FIG. 5 ) to smartphone 600. Then, indoor apparatus 100 (control unit) enters (transitions to) the steady mode, and the flow ends.

[0106] On the other hand, if indoor apparatus 100 has not received a message (step S605: NO), indoor apparatus 100 (controller) determines in step S606 whether the timer has expired.

[0107] If the timer has not expired (step S606: NO), the flow returns to step S604, and the above-described processing is repeated.

[0108] On the other hand, if the timer expires (step S606: YES), the door phone base unit 100 (display output unit 120) displays information indicating that registration of the smartphone 600 to the door phone base unit 100 failed due to a timeout, and the door phone base unit 100 (control unit) enters (transitions to) normal mode, and the flow ends.

[0109] [Registering the face of the person to be authenticated to the door phone base unit] 7 and 8 are flowcharts illustrating an example of a face registration operation for indoor phone master unit 100 according to an embodiment of the present disclosure. FIG. 7 is a flowchart illustrating an example of an operation of smartphone 600, and FIG. 8 is a flowchart illustrating an example of an operation of indoor phone master unit 100. The face registration operation illustrated in FIGS. 7 and 8 is an example performed by user 20, a resident of building 30, using smartphone 600 carried by user 20 within building 30 (in front of indoor phone master unit 100). However, the person to be registered and smartphone 600 are not limited to user 20 and the smartphone carried by user 20, respectively. Note that in FIGS. 7 and 8, it is assumed that smartphone 600 and indoor phone master unit 100 are already connected. It is also assumed that no communication error occurs between smartphone 600 and indoor phone master unit 100 due to a timeout or the like in FIGS. 7 and 8.

[0110] First, an example of the operation of the smartphone 600 will be described with reference to FIG.

[0111] In step S701, the smartphone 600 starts the application installed in or before S503 in FIG. 5 in response to, for example, a user operation (such as pressing (tapping) an icon to start the application).

[0112] In step S702, in response to, for example, a user operation (such as pressing (tapping) an icon for entering the face authentication registration mode), smartphone 600 causes the application to enter (transition to) a face authentication registration mode for registering the face of the person to be authenticated in indoor phone base unit 100. As a result, smartphone 600 transmits, via the application, to indoor phone base unit 100 a message indicating that smartphone 600 is requesting indoor phone base unit 100 to register the face.

[0113] In step S703, smartphone 600 waits for a message from indoor apparatus 100 indicating that indoor apparatus 100 has entered (transitioned to) face authentication registration mode (a message transmitted in step S803 in FIG. 8, which will be described later).

[0114] In step S704, smartphone 600 determines whether a message from indoor apparatus 100 has been received.

[0115] If the smartphone 600 has not received the message (step S704: NO), the flow returns to step S703, and the above-described processing is repeated.

[0116] On the other hand, if the smartphone 600 receives the message (step S704: YES), in step S705, the smartphone 600 activates the front camera via the application and causes the front camera to capture an image.

[0117] In step S706, smartphone 600 transmits the video data to indoor apparatus 100 through the application.

[0118] In step S707, the smartphone 600 presents a guidance for face authentication registration through the application. For example, the smartphone 600 plays a voice guidance registered in the application requesting that the face of the user 20 be photographed from various directions.

[0119] In step S708, smartphone 600 performs face authentication registration (capturing video data including a face and transmitting it to indoor apparatus 100) through the application in accordance with the guidance. Then, the flow ends.

[0120] Next, an example of the operation of indoor apparatus 100 will be described with reference to FIG.

[0121] In step S801, indoor phone master unit 100 (control unit, communication processing unit 172) waits for a message from smartphone 600 indicating that smartphone 600 is requesting indoor phone master unit 100 to register a face (the message sent in step S702 of FIG. 7).

[0122] In step S802, indoor apparatus 100 (control unit, communication processing unit 172) determines whether a message from smartphone 600 has been received.

[0123] If indoor apparatus 100 has not received the message (step S802: NO), the flow returns to step S801, and the above-described processing is repeated.

[0124] On the other hand, if intercom master unit 100 receives the message (step S802: YES), in step S803 intercom master unit 100 (control unit) enters (transitions) from the normal mode to a face authentication registration mode for registering the face of the person to be authenticated. As a result, intercom master unit 100 (control unit, communication processing unit 172) transmits a message to smartphone 600 indicating that intercom master unit 100 has entered (transitioned) to the face authentication registration mode.

[0125] In step S804, indoor apparatus 100 (control unit, communication processing unit 172) waits for video data from smartphone 600 (video data transmitted in step S706 in FIG. 7).

[0126] In step S805, indoor apparatus 100 (control unit, communication processing unit 172) determines whether video data from smartphone 600 has been received.

[0127] If indoor apparatus 100 has not received video data (step S805: NO), the flow returns to step S804, and the above-described processing is repeated.

[0128] On the other hand, if indoor apparatus 100 has received the video data (step S805: YES), in step S806, indoor apparatus 100 (display output unit 120) displays a video based on the received video data.

[0129] In step S807, indoor apparatus 100 (display output unit 120, audio output unit 140) presents guidance for face authentication registration. For example, indoor apparatus 100 plays audio guidance registered in indoor apparatus 100 requesting that images of user 20's face be taken from various directions.

[0130] In step S808, indoor apparatus 100 (communication processing unit 172, face authentication processing unit 118) performs face authentication registration (receives video including a face, and detects, extracts, and registers the face) in accordance with the guidance. Then, indoor apparatus 100 (control unit) enters (transitions to) the normal mode, and the flow ends.

[0131] [Remote registration of wireless devices to the door phone base unit] 9A and 9B are sequence diagrams illustrating an example of the operation of remotely registering a wireless terminal (smartphone) 600′ to indoor phone master 100 according to an embodiment of the present disclosure. In one example, smartphone 600′ to be registered (hereinafter referred to as remote smartphone 600′) is a smartphone owned by the mother of user 20, who is a resident of building 30, but is not limited thereto. Note that the resident smartphone 600 illustrated in FIGS. 9A and 9B will be described as a smartphone owned by user 20.

[0132] In step S901, indoor apparatus 100 is powered on.

[0133] In step S902, indoor apparatus 100 (control unit, communication processing unit 172) is constantly connected to server 500 via communication router 400, public network 510, and the like.

[0134] In step S903, the resident smartphone 600 launches the application that was installed in or before S503 in FIG.

[0135] In step S904, resident smartphone 600 selects application sharing to share the application in response to, for example, a user operation (such as pressing (tapping) an icon for sharing the application). As a result, resident smartphone 600 transmits a message to intercom master unit 100 via the application indicating the presence of a remote wireless terminal 600 (smartphone 600′) that is requesting registration with intercom master unit 100.

[0136] When the intercom master unit 100 (control unit, communication processing unit 172) receives a message from the resident smartphone 600, in step S905, the intercom master unit 100 (control unit) enters (transitions) from the steady-state mode to the remote registration mode for registering the remote smartphone 600'.

[0137] In step S906, indoor apparatus 100 (controller) acquires its own apparatus ID from the internal information stored in storage unit 180.

[0138] In step S907, indoor apparatus 100 (one-time password generating unit 195) generates a one-time password.

[0139] In step S908, indoor apparatus 100 (control unit, communication processing unit 172) transmits the device ID and the one-time password to resident smartphone 600 and server 500.

[0140] When the resident smartphone 600 receives the device ID and one-time password from the door phone master unit 100 via the application, in step S909, the resident smartphone 600 launches an arbitrary messaging application, for example, in response to a user operation (such as pressing (tapping) an icon to launch a messaging application).

[0141] In step S910, the resident smartphone 600 transmits the application download URL, device ID, and one-time password entered by, for example, the user 20 to the remote smartphone 600' via a messaging application in response to, for example, a user operation (such as pressing (tapping) an icon to send a message).

[0142] When the remote smartphone 600' receives the application download URL, device ID, and one-time password from the resident smartphone 600 via the messaging application, in step S911, the remote smartphone 600' downloads the application from the download URL, for example, in response to a user operation (such as pressing (tapping) the download URL link).

[0143] In step S912, the remote smartphone 600' installs the downloaded application in response to, for example, a user operation (such as pressing (tapping) an icon for installing the application).

[0144] In step S913, the remote smartphone 600′ starts the installed application in response to, for example, a user operation (such as pressing (tapping) an icon to start the application).

[0145] In step S914, the remote smartphone 600' causes the application to enter (transition to) a remote registration mode for registering the remote smartphone 600' with the door phone master unit 100, for example, in response to a user operation (such as pressing (tapping) an icon to enter the remote registration mode).

[0146] In step S915, the remote smartphone 600' transmits the device ID and the one-time password entered by the user of the remote smartphone 600' to the server 500 through the application.

[0147] In step S916, server 500 checks whether the device ID and one-time password received from remote smartphone 600' match the device ID and one-time password sent and received from indoor phone master unit 100 in step S908, respectively.

[0148] If they match, in step S917, server 500 associates and registers indoor apparatus master unit 100 and remote smartphone 600'. (If they do not match, server 500 transmits an error message to remote smartphone 600'.)

[0149] In step S918, server 500 transmits a registration success message to indoor apparatus 100 and remote smartphone 600', indicating that indoor apparatus 100 and remote smartphone 600' have been associated and registered.

[0150] When indoor apparatus 100 (control unit, communication processing unit 172) receives a registration success message from server 500, in step S919, indoor apparatus 100 (control unit) successfully pairs with remote smartphone 600'. Similarly, when remote smartphone 600' receives a registration success message from server 500 via the application, in step S920, remote smartphone 600' successfully pairs with indoor apparatus 100.

[0151] [Remote face registration to the door phone base unit] 9B, after the pairing between indoor phone master unit 100 and remote smartphone 600′ is successful, remote smartphone 600′ can connect to (access) indoor phone master unit 100 via server 500. After the pairing and connection, indoor phone master unit 100 can register the face of a person via server 500 based on the video of the person captured by the front camera of remote smartphone 600′, as described with reference to FIGS.

[0152] 10A to 10D are diagrams showing examples of display screens of wireless terminals (smartphones) 600 and 600′ according to an embodiment of the present disclosure.

[0153] The display screen shown in Fig. 10A is displayed when application sharing is selected in step S904 of Fig. 9A. User 20 of resident smartphone 600 can cause indoor apparatus 100 to enter remote registration mode by pressing (tapping) icon 1001 for sharing the application on the application.

[0154] The display screen shown in Fig. 10B is displayed when the download URL and the like are transmitted in step S910 of Fig. 9A. The user 20 of the resident smartphone 600 can notify the user of the remote smartphone 600' of the download URL, device ID, and one-time password by inputting and transmitting them on the messaging application.

[0155] The display screen shown in Fig. 10C is displayed when the application is placed into the remote registration mode in step S914 of Fig. 9B. The user of the remote smartphone 600' can place the application into the remote registration mode by pressing (tapping) an icon 1002 for entering the remote registration mode on the application.

[0156] The display screen shown in Fig. 10D is displayed when transmitting the device ID and one-time password in step S915 of Fig. 9B. The user of the remote smartphone 600' can transmit the device ID and one-time password to the server 500 by entering the device ID and one-time password in the device ID input field 1003 and one-time password input field 1004, respectively, and pressing (tapping) the icon 1005 on the application.

[0157] As a result, the user of the remote smartphone 600' can unlock the electric lock 300 without using a physical key.

[0158] [Actions involving facial recognition when visiting] 11A, 11B, 12A to 12C, and 13 are flowcharts showing an example of an operation involving face authentication when a visitor arrives, according to an embodiment of the present disclosure. 11A and 11B are flowcharts showing an example of an operation of front door slave unit 200, 12A to 12C are flowcharts showing an example of an operation of indoor apparatus master unit 100, and 13 is a flowchart showing an example of an operation of smartphone 600. The operations shown in FIGS. 11A, 11B, 12A to 12C, and 13 are examples performed using smartphone 600 carried by user 20, who is a resident of building 30, when user 20 is outside (going out) of building 30.

[0159] First, an example of the operation of the front door slave unit 200 will be described with reference to FIGS. 11A and 11B.

[0160] In step S1101, the front door slave unit 200 (infrared sensor 210) waits for a person (visitor) to stand in front of the front door slave unit 200.

[0161] In step S1102, front door slave unit 200 (infrared sensor 210) determines whether or not a person standing in front of front door slave unit 200 has been detected.

[0162] If the front door slave unit 200 (infrared sensor 210) does not detect a person (step S1102: NO), the flow returns to step S1101, and the above-described processing is repeated.

[0163] On the other hand, if the front door slave unit 200 (infrared sensor 210) detects a person (step S1102: YES), the front door slave unit 200 (infrared sensor 210) activates the camera (imaging unit) 222 in step S1103.

[0164] In step S1104, front door slave unit 200 (control unit 260) instructs master unit 100 to enter the face authentication mode (transmits an instruction to master unit 100 to enter the face authentication mode).

[0165] In step S1105, the front door slave unit 200 (control unit 260) starts a timer that is set to a predetermined time, for example, 60 seconds.

[0166] In step S1106, front door slave unit 200 (camera 222) captures an image of the surrounding area and transmits the image to indoor apparatus 100.

[0167] In step S1107, the front door slave unit 200 (control unit 260) determines whether or not the call button has been pressed within a predetermined time (for example, 15 seconds) after step S1104.

[0168] If the call button has been pressed (step S1107: YES), in step S1108, front door slave unit 200 (control unit 260) transmits a signal (information) (visitor notification) indicating that the call button has been pressed to indoor apparatus master unit 100. Then, the flow proceeds to step S1111.

[0169] On the other hand, if the call button is not pressed (step S1107: NO), in step S1109, the front door sub-unit 200 (control unit 260) receives an instruction from the door phone master unit 100 to sound an error message (an instruction sent in step S1210 of Figure 12B described later).

[0170] In step S1110, front door slave unit 200 (audio output unit 240) sounds an error message indicating that the resident is being called. For example, the error message may be a message such as "Authentication failed, so a call is being made."

[0171] In step S1111, the front door sub-unit 200 (control unit 260) waits for a message from the indoor phone master unit 100 indicating that the front door sub-unit 200 and the smartphone 600 of the user 20 registered in the indoor phone master unit 100 will be placed into a call state (a message sent in step S1216 of Figure 12C described later).

[0172] In step S1112, front door slave unit 200 (control unit 260) determines whether a message from indoor apparatus master unit 100 has been received.

[0173] If front door slave unit 200 (control unit 260) receives the message (step S1112: YES), in step S1113, front door slave unit 200 (control unit 260, etc.) makes a call (communicates) with smartphone 600 via indoor apparatus 100, and exchanges video and audio with smartphone 600 (however, does not receive video). Then, when the connection between indoor apparatus 100 and smartphone 600 is disconnected, the flow ends.

[0174] On the other hand, if the front door slave unit 200 (control unit 260) has not received a message (step S1112: NO), in step S1114, the front door slave unit 200 (control unit 260) determines whether the timer has expired.

[0175] If the timer has not expired (step S1114: NO), the flow returns to step S1111, and the above-described processing is repeated.

[0176] On the other hand, if the timer has expired (step S1114: YES), the flow ends.

[0177] Next, an example of the operation of indoor apparatus 100 will be described with reference to FIGS. 12A to 12C.

[0178] In step S1201, indoor apparatus 100 (control unit, communication processing unit 172) waits for an instruction from front door apparatus 200 to enter the face authentication mode (the instruction transmitted in step S1104 in FIG. 11A).

[0179] In step S1202, indoor apparatus 100 (control unit, communication processing unit 172) determines whether an instruction from front door apparatus 200 has been received.

[0180] If indoor apparatus 100 has not received the instruction (step S1202: NO), the flow returns to step S1201, and the above-described processing is repeated.

[0181] On the other hand, if the door phone master unit 100 receives an instruction message (step S1202: YES), in step S1203, the door phone master unit 100 (control unit) enters (transitions) from the normal mode to a face authentication mode for performing face authentication using a face captured by the camera 222 of the front door slave unit 200.

[0182] In step S1204, indoor apparatus 100 (control unit, video data input unit 112) receives from front door apparatus 200 the video captured by camera 222 (the video transmitted in step S1106 in FIG. 11A).

[0183] In step S1205, indoor apparatus 100 (face authentication processing unit 118) performs face authentication processing by comparing the face included in the received video with the faces registered in the registration database of face authentication storage unit 116.

[0184] In step S1206, indoor apparatus 100 (face authentication processing unit 118) determines whether authentication has been successful as a result of the face authentication process.

[0185] If the authentication is successful (step S1206: YES), in step S1207, the indoor phone base unit 100 (face authentication processing unit 118, communication processing unit 172, electric lock control unit 192, electric lock communication unit 194) instructs the electric lock 300 to be unlocked (sends an unlock instruction to the electric lock 300). After that, the electric lock 300 is unlocked, the indoor phone base unit 100 (control unit) enters (transitions to) the normal mode, and the flow ends. After instructing the electric lock 300 to be unlocked or after the electric lock 300 is unlocked, the indoor phone base unit 100 (control unit, communication processing unit 172) may notify a predetermined smartphone 600 registered in the indoor phone base unit 100 that the electric lock 300 has been unlocked. At this time, the indoor phone base unit 100 (control unit, communication processing unit 172) may send to the smartphone 600 an image including the face of the person captured by the camera 222 of the front door slave unit 200.

[0186] On the other hand, if the authentication is not successful (step S1206: NO), in step S1208, master unit 100 (controller) determines whether the call button on front door slave unit 200 has been pressed. Master unit 100 (controller) makes this determination based on whether the visitor notification transmitted by front door slave unit 200 in step S1108 of FIG. 11B has been received within a predetermined time (e.g., 15 seconds) after step S1203.

[0187] If the call button on the front door sub-unit 200 is pressed (step S1208: YES), in step S1209, the door phone master unit 100 (control unit, communication processing unit 172) notifies a specific smartphone 600 registered in the door phone master unit 100 that the call button has been pressed (a signal indicating that the call button has been pressed is sent to the smartphone 600).

[0188] On the other hand, if the call button on the front door sub-unit 200 is not pressed (step S1208: NO), in step S1210, the door phone master unit 100 (control unit) instructs the front door sub-unit 200 to sound an error message (sends an instruction to the front door sub-unit 200 to sound an error message).

[0189] In step S1211, the door phone base unit 100 (control unit, communication processing unit 172) notifies a specific smartphone 600 registered in the door phone base unit 100 that facial authentication has failed (sends a signal to the smartphone 600 indicating that facial authentication has failed).

[0190] In step S1212, indoor apparatus 100 (controller) starts a timer set to a predetermined time, which may be, for example, 10 seconds.

[0191] In step S1213, indoor apparatus 100 (control unit, communication processing unit 172) waits for a message from smartphone 600 indicating that a call (communication) with front door slave 200 will be made (a message transmitted in step S1303 in FIG. 13, which will be described later).

[0192] In step S1214, indoor apparatus 100 (control unit, communication processing unit 172) determines whether a message from smartphone 600 has been received.

[0193] If indoor apparatus 100 receives the message (step S1214: YES), the flow proceeds to step S1216.

[0194] On the other hand, if indoor apparatus 100 has not received a message (step S1214: NO), indoor apparatus 100 (controller) determines in step S1215 whether the timer has expired.

[0195] If the timer has not expired (step S1215: NO), the flow returns to step S1213, and the above-described processing is repeated.

[0196] On the other hand, if the timer has expired (step S1215: YES), indoor apparatus 100 (controller) enters (transitions to) the steady mode, and the flow ends.

[0197] In step S1216, indoor apparatus 100 (control unit) transmits to front door sub-unit 200 a message indicating that front door sub-unit 200 and smartphone 600 are to be put into a call state, and front door sub-unit 200 and smartphone 600 are to be put into a call state.

[0198] In step S1217, indoor apparatus 100 (control unit, communication processing unit 172) receives from smartphone 600 a signal indicating a user operation by the user of smartphone 600 on smartphone 600. The user operation may be a selection (instruction) to unlock electric lock 300, a selection (instruction) to lock electric lock 300, or a selection (instruction) to disconnect the call with indoor apparatus 100 (and therefore front door slave 200).

[0199] In step S1218, indoor apparatus 100 (controller) determines the user operation.

[0200] If the user operation is to select unlocking of electric lock 300, in step S1219, indoor apparatus 100 (control unit, communication processing unit 172, electric lock control unit 192, electric lock communication unit 194) issues an instruction to unlock electric lock 300 (sends an unlock instruction to electric lock 300). After that, electric lock 300 unlocks, and the flow returns to step S1217.

[0201] If the user operation is to select locking of electric lock 300, in step S1220, indoor apparatus 100 (control unit, communication processing unit 172, electric lock control unit 192, electric lock communication unit 194) instructs electric lock 300 to lock (transmits a lock instruction to electric lock 300). After that, electric lock 300 locks, and the flow returns to step S1217.

[0202] If the user operation is to select disconnection of the call with indoor apparatus 100, in step S1221, indoor apparatus 100 (control unit, communication processing unit 172) disconnects the call with smartphone 600. Then, indoor apparatus 100 (control unit) enters (transitions to) the steady mode, and the flow ends.

[0203] Next, an example of the operation of the smartphone 600 will be described with reference to FIG.

[0204] In step S1301, smartphone 600 receives a notification from indoor apparatus 100 through an application installed in or before S503 of Fig. 5. This notification may be the notification in step S1209 of Fig. 12B or the notification in step S1211 of Fig. 12B.

[0205] In step S1302, the smartphone 600 determines whether or not the user of the smartphone 600 will respond to the notification. For example, the smartphone 600 determines that the user will respond if the user selects to respond by pressing (tapping) an icon for responding to the notification, which is valid for a predetermined time (for example, 5 seconds) after receiving the notification.

[0206] If the user does not respond (step S1302: NO), the flow ends.

[0207] On the other hand, if the user responds (step S1302: YES), in step S1303, smartphone 600 transmits a message indicating that a call (communication) with front door slave unit 200 will be made to indoor apparatus 100 via the application.

[0208] When communication with indoor apparatus 100 (and therefore front door slave 200) becomes possible, in step S1304, smartphone 600 starts communication with front door slave 200 via the application via indoor apparatus 100. Thereafter, smartphone 600 can exchange video and audio with front door slave 200 (however, video does not have to be transmitted).

[0209] In step S1305, in addition to the image, the smartphone 600 displays on the application an icon for instructing the unlocking of the electric lock 300, an icon for instructing the locking of the electric lock 300, and an icon for instructing the disconnection of the call with the door phone master unit 100.

[0210] In step S1306, the smartphone 600 determines a user operation on the smartphone 600 by the user of the smartphone 600.

[0211] If the user operation is selection of an icon for instructing to unlock electric lock 300, in step S1307, smartphone 600 transmits a signal (information) indicating that unlocking of electric lock 300 has been selected (instructed) to indoor apparatus 100. Then, the flow returns to step S1305.

[0212] If the user operation is selection of an icon for instructing to lock electric lock 300, in step S1308, smartphone 600 transmits a signal (information) indicating that locking of electric lock 300 has been selected (instructed) to indoor apparatus 100. Then, the flow returns to step S1305.

[0213] If the user operation is the selection of an icon to instruct the disconnection of the call with the intercom master unit 100, in step S1309, the smartphone 600 sends a signal to the intercom master unit 100 indicating that the disconnection of the call with the intercom master unit 100 has been selected (instructed).

[0214] In step S1310, smartphone 600 disconnects the call with indoor apparatus 100. Then, the flow ends.

[0215] 14 is a diagram showing an example of a display screen of the wireless terminal (smartphone) 600 according to an embodiment of the present disclosure. This display screen is displayed, for example, in step S1305 of FIG.

[0216] As shown in Figure 14, this display screen includes an image 1201 captured by the camera 222 of the front door sub-unit 200, an icon 1202 for instructing the unlocking of the electric lock 300, an icon 1203 for instructing the locking of the electric lock 300, and an icon 1204 for instructing the disconnection of the call with the main door phone unit 100.

[0217] User 20 of smartphone 600 can use the microphone of smartphone 600 to talk to a person in video 1201 who is in front of front door sub-unit 200 via indoor phone base unit 100. Such people include people whose faces are not registered in indoor phone base unit 100, such as a delivery person or the mother of user 20 of smartphone 600, and people whose faces are registered in indoor phone base unit 100.

[0218] Furthermore, user 20 of smartphone 600 can unlock electric lock 300 by pressing (tapping) icon 1202 and selecting to unlock electric lock 300 (steps S1306 to S1307 in FIG. 13, and steps S1218 to S1219 in FIG. 12C). For example, if the person in video 1201 standing in front of entrance slave unit 200 is the mother of user 20 of smartphone 600, the user can unlock electric lock 300 even if user 20 is out and the mother does not have the physical key. Furthermore, even if the person's face is registered in indoor phone master unit 100, authentication may fail due to reasons such as wearing a mask. In such a case, user 20 can still unlock electric lock 300.

[0219] Furthermore, the user 20 of the smartphone 600 can lock the electric lock 300 by pressing (tapping) the icon 1203 and selecting to lock the electric lock 300 (steps S1306 to S1308 in FIG. 13, steps S1218 to S1220 in FIG. 12C).

[0220] In addition, user 20 of smartphone 600 can disconnect the call with door phone base unit 100 by pressing (tapping) icon 1204 and selecting to disconnect the call with door phone base unit 100 (steps S1306 → S1309 → S1310 in Figure 13, steps S1218 → S1221 in Figure 12C).

[0221] <Modification of the embodiment> At least some of the functions of intercom master unit 100 (functional units shown in FIG. 3 ) may be provided in server 500 or another server. In this case, intercom master unit 100 does not need to perform processing corresponding to the function, but simply transfers various data to server 500 or another server, and server 500 or another server performs the processing corresponding to the function. This reduces the cost of intercom master unit 100 and the processing load on intercom master unit 100.

[0222] Although the above description has been given taking authentication using a person's face as an example, other biometric authentication methods may also be applied. For example, a contactless authentication method such as authentication using the iris, voice, or gait may be applied, or a non-contactless biometric authentication method such as authentication using veins or fingerprints may also be applied. Therefore, instead of a face as authentication (biometric) data, the extraction unit according to the present disclosure may extract an iris or the like from a video or image transmitted from the wireless terminal 600, and the extraction unit according to the present disclosure may register the iris or the like.

[0223] The above-mentioned functional units may be divided into further functional units, or two or more functional units may be integrated into one functional unit. For example, the face authentication processing unit 118 may be divided into a registration unit that registers authentication data and a functional unit that performs actual authentication processing based on the video captured by the camera of the front door slave unit 200 and the registered authentication data, and this functional unit may be further divided into sub-functional units according to the functions to be executed.

[0224] Intercom master unit 100 may be realized as a single device having all of the above-mentioned functional units, or as multiple devices in which the above-mentioned functional units are distributed. When intercom master unit 100 is realized as multiple devices, the functions of intercom master unit 100 can be realized by cooperation via a network using communication units provided in the multiple devices.

[0225] <Effects of the embodiment> As described above, according to the present embodiment, indoor phone master unit 100 capable of unlocking front door 31 receives, via communication processing unit 172 (receiving unit), an image of a person captured by the in-camera of wireless terminal 600 from wireless terminal 600. In addition, indoor phone master unit 100 extracts, via face recognition processing unit 118 (extraction unit), the person's face, iris, etc. (biometric data for authentication) to be used to unlock front door 31 from the captured image of the person, and registers, via face recognition processing unit 118 (registration unit), the extracted face, iris, etc. in a registration database in face recognition storage unit 116.

[0226] Therefore, according to this embodiment, the authentication data of a person is registered using the in-camera of the wireless terminal 600 without using the camera provided in the entrance sub-unit 200, thereby minimizing any disadvantages to the person's convenience.

[0227] <Summary of the embodiment> The door phone master unit (door phone master unit 100) according to one embodiment of the present disclosure is capable of unlocking the front door (front door 31), and includes a receiving unit (communication processing unit 172) that receives from a wireless mobile terminal (wireless terminal 600, 600') an image of a person captured by a camera possessed by the wireless mobile terminal, an extraction unit (face recognition processing unit 118) that extracts from the image biometric data (face, iris, etc.) of the person for authentication used to unlock the front door, and a registration unit (face recognition processing unit 118) that registers the biometric data for authentication.

[0228] With the above configuration, the authentication biometric data of a person is registered using the camera of the wireless mobile terminal without using the camera of the door phone sub-unit, thereby minimizing any disadvantages to the person's convenience.

[0229] In this indoor apparatus, when the receiving unit receives the image of the person, the indoor apparatus and the wireless mobile terminal belong to the same wireless network via a communication router (communication router 400).

[0230] With the above configuration, a person photographed by the camera of a wireless mobile terminal can register their biometric data for authentication while they are, for example, inside a building where the door phone master unit is located, thereby minimizing any inconvenience to that person.

[0231] In this indoor apparatus, when the receiving unit receives the image of the person, the indoor apparatus and the wireless mobile terminal are directly connected to each other.

[0232] With the above configuration, a person photographed by the camera of a wireless mobile terminal can register their biometric data for authentication while they are, for example, inside a building where the door phone master unit is located, thereby minimizing any inconvenience to that person.

[0233] In this door phone base unit, when the receiving unit receives the image of the person, the door phone base unit and the wireless mobile terminal are connected via a server (server 500) connected to a public network (public network 510).

[0234] With the above configuration, a person photographed by the camera of a wireless mobile terminal can register their biometric data for authentication even if they are away from the building where the door phone master unit is located, thereby minimizing any inconvenience to that person.

[0235] The door phone master unit further includes an authentication unit (face authentication processing unit 118) that authenticates the person by comparing biometric data (face, iris, etc.) based on an image of the person taken by a camera (camera 222) of the door phone slave unit (front door slave unit 200) with the authentication biometric data, and a transmission unit (electric lock communication unit 194) that, if authentication is successful, transmits a signal to the electric lock (300) of the front door instructing it to unlock the electric lock.

[0236] With the above configuration, if authentication is successful, the electric lock (front door) is unlocked, ensuring security. In addition, since the electric lock (front door) is unlocked even without a physical key, convenience for the person can be improved.

[0237] A registration method according to one embodiment of the present disclosure is executed by a door phone base unit (door phone base unit 100) capable of unlocking a front door (front door 31), and receives an image of a person taken by a camera possessed by a wireless mobile terminal (wireless terminal 600, 600') from the wireless mobile terminal, extracts from the image biometric data (face, iris, etc.) of the person for authentication used to unlock the front door, and registers the biometric data for authentication.

[0238] With the above configuration, the authentication biometric data of a person is registered using the camera of the wireless mobile terminal without using the camera of the door phone sub-unit, thereby minimizing any disadvantages to the person's convenience. [Industrial Applicability]

[0239] An embodiment of the present disclosure is useful as a door phone master unit and a registration method used in a door phone system. [Explanation of symbols]

[0240] 10 Doorphone System 20 users 30 Buildings 31 Entrance door 100 Door phone base unit 110 Video Processing Unit 112 Video data input section 114 Video data decoding unit 116 Face Recognition Memory Unit 118 Face recognition processing unit 120 Display output section 130 Audio processing unit 132 Voice data input section 134 Audio data decoding unit 136 Audio data encoding unit 138 Audio data output section 140 Audio output section 150 Audio input section 160 Call Control Unit 162 Incoming call processing unit 164 Timer processing unit 166 Call Processing Unit 170 Network Control Unit 172 Communication processing unit 180 Storage section 190 Equipment Control Unit 192 Electric lock control unit 194 Electric Lock Communication Department 200 Entrance door unit 210 Infrared Sensor 220 Image Generation Unit 222 Imaging unit 224 Video data encoding unit 226 Video data output unit 230 Audio Processing Unit 232 Voice data input section 234 Audio data decoding unit 236 Audio Data Encoding Unit 238 Audio data output unit 240 Audio output section 250 Audio input section 260 Control Unit 300 Electric Lock 301 Electric Lock Code 400 Communication Router 500 servers 510 Public Network 401 Wireless communication lines 402 Wireless communication lines 403 Wireless communication lines 600 Wireless Terminal 600' Wireless Terminal 601 Wireless communication lines

Claims

1. A door phone master unit capable of unlocking a front door, a receiving unit that receives an image of a person taken by a camera included in the wireless mobile terminal from the wireless mobile terminal; an extraction unit that extracts, from the image, biometric data for authentication of the person that is used to unlock the front door; a registration unit that registers the authentication biometric data; a network processing unit that controls communication with the wireless mobile terminal; Equipped with When the network processing unit receives a message from the wireless mobile terminal indicating that the authentication biometric data has been registered, the indoor phone master unit transitions from a normal mode to a face authentication registration mode, the network processing unit transmits a message indicating that the indoor apparatus has transitioned to the face authentication registration mode to the wireless mobile terminal; the receiving unit receives the image from a camera that is activated after the wireless mobile terminal receives the message; the extraction unit extracts the authentication biometric data from the image. Door phone main unit.

2. When the receiving unit receives the image of the person, the indoor phone master unit and the wireless mobile terminal belong to the same wireless network via a communication router. The door phone master unit according to claim 1.

3. When the receiving unit receives the image of the person, the indoor phone master unit and the wireless mobile terminal are directly connected. The door phone master unit according to claim 1.

4. When the receiving unit receives the image of the person, the indoor phone master unit and the wireless mobile terminal are connected via a server connected to a public network. The door phone master unit according to claim 1.

5. an authentication unit that authenticates the person by comparing biometric data based on an image of the person taken by a camera included in the intercom slave unit with the authentication biometric data; a transmitter that transmits a signal to the electric lock of the entrance door instructing the electric lock to unlock the electric lock if the authentication is successful; The indoor phone master unit according to claim 1 , further comprising:

6. A registration method executed by a door phone master unit capable of unlocking a front door, receiving, from the wireless mobile terminal, an image of a person photographed by a camera included in the wireless mobile terminal; extracting biometric data from the image for authentication of the person to be used to unlock the front door; registering the biometric data for authentication; Controlling communication with the wireless mobile terminal; When a message indicating that the authentication biometric data has been registered is received from the wireless mobile terminal, the mode transitions from the normal mode to the face authentication registration mode, transmitting a message indicating that the mode has been transitioned to the face authentication registration mode to the wireless mobile terminal; receiving the image from a camera activated after the wireless mobile terminal receives the message; extracting the authentication biometric data from the image; How to register.

Images