Server device, server device control method, and program

Abstract

To provide a server device for preventing a fraudulent act or the like by a person permitted to enter an apartment building or the like.SOLUTION: A server device includes storage means, database control means, and detection means. The storage means stores biometric information of residents in a resident management database. The storage means stores biometric information of permitted entry persons in association with their permitted stay time periods in a temporary entry person management database. The biometric information of the permitted entry persons whose permitted stay time periods have elapsed is deleted from the temporary entry person management database. The detection means acquires first image data from a first camera device. When two matching processes using the biometric information stored in the two databases fail, the detection means detects a subject captured in the first image data as a suspicious person.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a server device, a control method for a server device, and a program. [Background technology]

[0002] There is technology for authenticating visitors to apartment complexes and other collective housing.

[0003] For example, Patent Document 1 describes that the system efficiently controls the smooth entry and exit of visitors. In the system of Patent Document 1, a camera installed in the collective entrance machine captures an image of a visitor. When the visitor inputs a house number and presses a call button on the collective entrance machine, a call is made to the intercom terminal. The intercom terminal starts a call when a resident makes a call, and transmits a registration request to the server when a resident makes a registration. The server constantly acquires images captured by the collective entrance machine, and when it receives a registration request from the intercom terminal, it extracts an image of the visitor from the image captured by the camera of the collective entrance machine. The server registers the extracted image in a database as a registered person image. For registered visitors, the door is unlocked by authentication by the server. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-020062 A Summary of the Invention [Problem to be solved by the invention]

[0005] As disclosed in Patent Document 1, in apartment buildings and other facilities that support biometric authentication, it is necessary for visitors' biometric information to be registered in the system. However, Patent Document 1 does not mention the deletion of registered visitors' biometric information, so visitors whose biometric information is registered can virtually move about the apartment building without restrictions. As a result, there is a large margin for visitors to commit fraudulent acts.

[0006] A primary object of the present invention is to provide a server device, a control method for a server device, and a program that contribute to preventing fraudulent activities by people who are permitted to enter an apartment building or the like. [Means for solving the problem]

[0007] According to a first aspect of the present invention, there is provided a server device comprising: a storage means for storing biometric information of residents of an apartment building in a resident management database, and for storing in a temporary visitor management database, in association with the biometric information of an authorized entrant who is permitted to enter the apartment building, and an permitted stay time, which is the time that the authorized entrant is permitted to stay in the apartment building; a database control means for deleting from the temporary visitor management database at least the biometric information of the authorized entrant whose permitted stay time has elapsed since the biometric information of the authorized entrant was registered in the temporary visitor management database; and a detection means for acquiring first image data from a first camera device installed inside the apartment building, and, when a matching process using the biometric information of the photographed person obtained from the acquired first image data and the biometric information stored in the resident management database fails and also a matching process using the biometric information of the photographed person obtained from the acquired first image data and the biometric information stored in the temporary visitor management database fails, detecting the photographed person appearing in the first image data as a suspicious person.

[0008] According to a second aspect of the present invention, there is provided a control method for a server device, comprising: a storage process for storing biometric information of residents of an apartment building in a resident management database, and for storing in a temporary visitor management database, in association with the biometric information of an authorized visitor who is permitted to enter the apartment building, and an permitted stay time, which is the time during which the authorized visitor is permitted to stay in the apartment building; a database control process for deleting from the temporary visitor management database at least the biometric information of the authorized visitor whose permitted stay time has elapsed since the biometric information of the authorized visitor was registered in the temporary visitor management database; and a detection process for acquiring first image data from a first camera device installed inside the apartment building, and, when a matching process using the biometric information of the photographed person obtained from the acquired first image data and the biometric information stored in the resident management database fails and also a matching process using the biometric information of the photographed person obtained from the acquired first image data and the biometric information stored in the temporary visitor management database fails, detecting the photographed person appearing in the first image data as a suspicious person.

[0009] According to a third aspect of the present invention, there is provided a program for causing a computer mounted on a server device to execute the following steps: a storage process for storing biometric information of residents of an apartment building in a resident management database, and for correlating the biometric information of an admitted person who has been permitted to enter the apartment building with an permitted stay time, which is the time during which the admitted person is permitted to stay in the apartment building, and storing them in a temporary visitor management database; a database control process for deleting from the temporary visitor management database at least the biometric information of the admitted person whose permitted stay time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, when the permitted stay time has elapsed; and a detection process for acquiring first image data from a first camera device installed inside the apartment building, and, when a matching process using the biometric information of the person photographed obtained from the acquired first image data and the biometric information stored in the resident management database has failed and also a matching process using the biometric information of the person photographed obtained from the acquired first image data and the biometric information stored in the temporary visitor management database has failed, detecting the person photographed in the first image data as a suspicious person. Effect of the Invention

[0010] According to each aspect of the present invention, a server device, a control method for a server device, and a program are provided that contribute to preventing fraudulent acts by a person permitted to enter an apartment building or the like. Note that the effects of the present invention are not limited to the above. The present invention may achieve other effects instead of or in addition to the above effects. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram for explaining an overview of an embodiment. [Diagram 2] FIG. 2 is a flowchart for explaining an outline of the operation of one embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. [Figure 4]FIG. 4 is a diagram illustrating an example of a schematic configuration of an apartment building according to an embodiment of the present disclosure. [Diagram 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram illustrating an example of a resident management database according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating an example of a temporary visitor management database according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart illustrating an example of the operation of the authentication unit according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a flowchart illustrating an example of the operation of the authentication unit according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a flowchart illustrating an example of the operation of the tracking control unit according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a sequence diagram illustrating an example of the operation of the information processing system according to the embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating an example of an internal intercom display according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a sequence diagram illustrating an example of the operation of the information processing system according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a diagram illustrating an example of a display of a registration terminal according to an embodiment of the present disclosure. [Figure 18] FIG. 18 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] First, an outline of one embodiment will be described. The reference numerals in the drawings are added to each element for convenience as an example to aid in understanding, and the description of the outline is not intended to be limiting. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units rather than hardware units. The connection lines between the blocks in each drawing include both bidirectional and unidirectional. The unidirectional arrows are used to diagrammatically indicate the flow of the main signal (data) and do not exclude bidirectionality. In this specification and the drawings, elements that can be similarly described may be given the same reference numerals to avoid redundant description.

[0013] The server device 100 according to an embodiment includes a storage means 101, a database control means 102, and a detection means 103 (see FIG. 1). The storage means 101 stores biometric information of residents of an apartment building in a resident management database (step S1 in FIG. 2). The storage means 101 stores biometric information of an admitted person who is permitted to enter the apartment building in association with a permitted stay time, which is the time during which the admitted person is permitted to stay in the apartment building, in a temporary visitor management database (step S2). When the permitted stay time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, the database control means 102 deletes the biometric information of the admitted person whose permitted stay time has elapsed from the temporary visitor management database (step S3). The detection means 103 acquires first image data from a first camera device installed inside the apartment building (step S4). When the two matching processes fail, the detection means 103 detects the person captured in the first image data as a suspicious person (step S5). The first matching process is a process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database. The second matching process is a process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database.

[0014] The server device 100 includes a database that stores the biometric information of residents and a database that stores the biometric information of persons permitted to enter. If the biometric information of a person captured in image data obtained from a camera device installed inside the apartment complex is not stored in either of the two databases, the server device 100 sets the person as a suspicious person. The presence of the suspicious person is immediately notified to a security guard or the like. As a result, fraudulent acts by persons permitted to enter an apartment complex or other such complex are prevented.

[0015] Specific embodiments will be described in more detail below with reference to the drawings.

[0016] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0017] [System configuration] 3 is a diagram showing an example of a schematic configuration of an information processing system (authentication system) according to an embodiment of the present disclosure. As shown in FIG. 3, the information processing system includes a server device 10 and an apartment building 20.

[0018] The server device 10 is a device that provides a biometric authentication service to residents (inhabitants) of an apartment building. In the first embodiment, the configuration and operation of an information processing system will be described by taking an apartment building 20 as an example of an apartment building.

[0019] The server device 10 stores the name, date of birth, address (room number), vital information, contact information, etc. of the apartment resident. The server device 10 provides a biometric authentication service using the registered information. Specifically, the server device 10 controls when the apartment resident enters the apartment 20 or their home using biometric authentication.

[0020] The server device 10 is operated by a management company or the like of the condominium 20. The server device 10 may be installed inside the condominium 20, or may be installed on a network (on the cloud).

[0021] As shown in FIG. 4, an apartment building 20 is equipped with an external intercom 21, an internal intercom 22, a registration terminal 30, a camera device 40, and a plurality of camera devices 41.

[0022] The external interphone 21 is an interphone installed at the entrance of the apartment building 20. The external interphone 21 is installed outside the apartment building 20. An internal interphone 22 is installed in each residence in the apartment building 20.

[0023] 4, for ease of understanding, one house is shown, but in reality, a plurality of houses are included inside the condominium 20. The internal intercom 22 is installed in each of the plurality of houses.

[0024] The registration terminal 30 is installed at the entrance of the apartment building 20. The registration terminal 30 is a device or apparatus used when a person other than an apartment building resident enters the apartment building 20. The operation of the registration terminal 30 will be described in detail later.

[0025] The camera device 40 is installed so as to be able to capture an image of a person passing through the entrance door 50 and entering the apartment building 20. The entrance door 50 opens in response to an instruction from the server device 10. The entrance door 50 is an automatic door that closes a predetermined time after it opens.

[0026] The multiple camera devices 41 are installed in various locations in the apartment building 20. The camera devices 41 are installed so as to be able to capture images of people walking in the corridors of each floor, people using the elevators, and the like.

[0027] 3, an apartment resident has a terminal 60. The apartment resident uses the terminal 60 to access the server device 10 and the like.

[0028] The server device 10 and the devices and apparatuses (external interphone 21, internal interphone 22, registration terminal 30, camera device 40, camera device 41) installed in the apartment building 20 are configured to be able to communicate with each other via a network. For example, the server device 10 and the external interphone 21 are connected by a wired or wireless communication means.

[0029] 3 and 4 are merely examples and are not intended to limit the configuration of the information processing system disclosed in the present application. For example, the information processing system may include two or more server devices 10. Also, FIG. 4 is merely an example and is not intended to limit the configuration of the condominium 20 disclosed in the present application. Furthermore, in FIG. 4, the house is shown on the same floor as the entrance for ease of understanding, but typically the house is located on a floor above the entrance.

[0030] [General operation] Next, an outline of the operation of the information processing system according to the first embodiment will be described.

[0031] <User registration> Residents of the apartment building 20 are required to register as users in order to enter the apartment building 20 or their own homes using biometric authentication. The user registration is performed for each resident of each household. For example, in the case of a family of four, each of the four members is required to register as a user.

[0032] A resident operates the terminal 60 to access a website provided by the server device 10. The resident performs user registration on the website.

[0033] The resident inputs login information, name, sex, date of birth, address (room number), contact information (telephone number, email address), biometric information, and the like, into the server device 10.

[0034] Examples of biometric information include data (feature amounts) calculated from physical features unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, or iris pattern. Alternatively, the user's biometric information may be image data such as a face image or fingerprint image. The user's biometric information may include information on the user's physical features. In the first embodiment, the biometric information is a person's face image or feature amounts generated from a face image.

[0035] The server device 10 stores the acquired information on the residents (hereinafter referred to as resident information) in a resident management database. The details of the resident management database will be described later.

[0036] <Residents entering the apartment> As mentioned above, when a resident enters apartment building 20, the resident is required to undergo biometric authentication.

[0037] Specifically, the camera device 40 periodically or at a predetermined timing captures an image of a person attempting to enter the condominium 20. The camera device 40 transmits image data showing the person to be authenticated and a camera ID to the server device 10 (see FIG. 5).

[0038] The camera ID is an ID for identifying each camera (camera device 40, camera device 41) installed in the apartment building. The camera ID may be a MAC (Media Access Control) address or an IP (Internet Protocol) address of camera device 40 or camera device 41.

[0039] The server device 10 recognizes that the image data received based on the camera ID was sent from the camera device 40 installed at the entrance. The server device 10 also extracts biometric information (face image) from the received image data. The server device 10 performs biometric authentication using the extracted biometric information and the biometric information stored in the resident management database.

[0040] If the biometric authentication is successful, the server device 10 instructs the entrance door 50 to open the door. The resident of the condominium 20 passes through the entrance door 50 and enters the condominium 20.

[0041] If biometric authentication using the biometric information stored in the resident management database fails, the server device 10 performs biometric authentication using the biometric information stored in the temporary visitor management database. Details of the temporary visitor management database and biometric authentication using the biometric information stored in the database will be described later.

[0042] <Visitor registration and visitor entry into the apartment> A visitor to the apartment building who is not registered as a user, such as a delivery person or a friend of an apartment resident, operates the external intercom 21 to request permission from the resident he or she is visiting to enter the apartment building 20. The visitor to the apartment building 20 designates the room number of the resident he or she has business with and rings the external intercom 21 installed at the entrance.

[0043] At that time, the external interphone 21 acquires biometric information of the visitor who pressed the call button. The external interphone 21 photographs the visitor and acquires a facial image.

[0044] The external interphone 21 transmits a "visitor notification" including the acquired biometric information (face image) and room number to the server device 10 (see FIG. 6).

[0045] The server device 10 relays voice data and image data transmitted and received between the internal interphone 22 of a specified room number and the external interphone 21. The server device 10 controls so that visitors and residents can converse with each other via the interphone.

[0046] After checking the visitor's purpose and face, the resident who allows the visitor to enter the apartment building inputs that fact into the internal intercom 22. For example, the resident presses the "Entry Permitted" button shown on the display of the internal intercom 22.

[0047] Furthermore, the resident inputs into the internal intercom 22 the amount of time (duration) that the visitor will be allowed to stay in the apartment building 20. For example, the resident inputs into the internal intercom 22 "10 minutes" if the visitor is a delivery person, or "3 hours" if the visitor is a friend.

[0048] When the resident allows the visitor to enter the apartment building, the internal interphone 22 transmits to the server device 10 an "entrance permission notice" including the permitted stay time that the resident has allowed the visitor.

[0049] In response to receiving the entry permission notification, the server device 10 stores the visitor's biometric information obtained from the external intercom 21, information about the resident who permitted the visitor to enter the apartment building (e.g., room number), and the permitted stay time allowed for the visitor in a temporary visitor management database.

[0050] The information (entries) stored in the temporary visitor management database are deleted after the permitted stay time set by the resident has elapsed.

[0051] A visitor who has been permitted to enter the apartment by a resident heads to the entrance door 50. The camera device 40 transmits image data of the visitor and a camera ID to the server device 10. The server device 10 extracts biometric information (face image) from the acquired image data and executes authentication processing using the extracted face image.

[0052] First, the server device 10 executes an authentication process using the extracted face image and the biometric information registered in the resident management database. Since the visitor's biometric information is not registered in the resident management database, the authentication process fails.

[0053] If the initial authentication process fails, the server device 10 executes another authentication process using the extracted biometric information and the biometric information registered in the temporary visitor management database. The biometric information of the visitor allowed to enter the apartment by the apartment resident is registered in the temporary visitor management database, so the authentication process is successful.

[0054] If the authentication process is successful, the server device 10 instructs the entrance door 50 to open the door. The visitor (a person who has been temporarily permitted to enter the condominium) passes through the entrance door 50 and enters the condominium 20.

[0055] <Companion registration and admission of companions to the apartment> When a resident of the apartment building 20 and a friend of the resident enter the apartment building together, the resident is not in his / her room. Therefore, the biometric information of the accompanying person is not temporarily registered (temporarily registered) in the visitor management database via the intercom.

[0056] In this case, the biometric information of the accompanying person is temporarily registered in the visitor management database via the registration terminal 30. Specifically, the condominium resident operates the registration terminal 30 to register the accompanying person.

[0057] The registration terminal 30 acquires biometric information of a resident who wishes to enter the apartment building together with an accompanying person. For example, the registration terminal 30 photographs the apartment building resident and acquires biometric information (face image).

[0058] The registration terminal 30 transmits a "resident authentication request" including the acquired biometric information to the server device 10 (step S01 in FIG. 7).

[0059] The server device 10 executes authentication processing using the biometric information included in the resident authentication request and the biometric information stored in the resident management database. If the authentication processing is successful, the server device 10 notifies the registration terminal 30 of the success (step S02).

[0060] When the successful authentication is notified, the registration terminal 30 acquires the permitted stay time for the resident's companion (the time the resident permits the companion to stay in the apartment building 20). The registration terminal 30 acquires the permitted stay time for the companion using a GUI (Graphical User Interface) or the like.

[0061] When the permitted stay time is acquired, the registration terminal 30 acquires biometric information of the accompanying person (such as a friend who enters the apartment building 20 with the resident). For example, the registration terminal 30 photographs the accompanying person to acquire biometric information (a face image).

[0062] The registration terminal 30 transmits a "companion registration request" including the acquired biometric information and the permitted stay time to the server device 10 (step S03).

[0063] When the server device 10 receives the companion registration request, it stores the biometric information (facial image), information about the resident (e.g., the resident's room number), permitted stay time, etc., included in the companion registration request in a temporary visitor management database. When the biometric information, etc., is successfully registered in the temporary visitor management database, the server device 10 transmits an affirmative response to the registration terminal 30 indicating that companion registration has been completed (registration completed; step S04).

[0064] Upon receiving the positive response (accompanying person registration completion), the registration terminal 30 notifies the condominium resident and the accompanying person that the accompanying person may also enter the condominium 20. The condominium resident and the accompanying person both head toward the entrance door 50.

[0065] The camera device 40 transmits image data of the condominium resident and the accompanying person and the camera ID to the server device 10. The server device 10 extracts biometric information of each of the condominium resident and the accompanying person from the acquired image data.

[0066] The server device 10 executes authentication processing for each piece of extracted biometric information. For the apartment resident, authentication is determined to be successful in the authentication processing using the biometric information stored in the resident management database. For the accompanying person, authentication is determined to be successful in the authentication processing using the biometric information stored in the temporary visitor management database.

[0067] When it is determined that authentication has been successful for each of the multiple persons to be authenticated who appear in one image data, the server device 10 instructs the entrance door 50 to open the door. The condominium resident and his / her companion pass through the entrance door 50 to enter the condominium 20.

[0068] <Tracking of permitted visitors> The server device 10 tracks permitted persons (visitors, companions) who are permitted to enter the condominium 20. The server device 10 starts the tracking at the time when the permitted person enters the condominium 20.

[0069] The camera device 41 installed in the apartment building 20 transmits image data to the server device 10 periodically or at a predetermined timing. Specifically, the camera device 41 transmits the image data to the server device 10 together with a camera ID.

[0070] The server device 10 identifies the location where the image data was captured based on the camera ID notified from the camera device 41. Furthermore, if a person is captured in the acquired image data, the server device 10 identifies the person being photographed (the person photographed by the camera device 41) using the person's biometric information.

[0071] Specifically, the server device 10 attempts to identify the person appearing in the image data by performing a matching process using the biometric information of the photographed person extracted from the image data and the biometric information registered in the resident management database and the temporary visitor management database.

[0072] If the person to be photographed is a resident of the condominium 20 (if the biometric information of the person to be photographed is stored in the resident management database), the server device 10 does not perform any particular process.

[0073] If the person being photographed is a person permitted to enter (if the biometric information of the person being photographed is stored in the temporary visitor management database), the server device 10 stores the detection date and time, detection location, and image data depicting the person permitted to enter in the temporary visitor management database.

[0074] In this way, the server device 10 tracks people (those permitted to enter) other than the apartment building residents, and grasps their whereabouts in real time.

[0075] If the person being photographed is neither a resident of the apartment building nor a person permitted to enter (if the person's biometric information is not stored in either of the two databases), the server device 10 sets the person being photographed as a suspicious person.

[0076] In this case, the server device 10 notifies employees of the condominium management company, security guards, etc. of the biometric information of the suspicious person (person being photographed), the location where the suspicious person was detected, etc. For example, the server device 10 transmits the face image of the suspicious person and the location where the suspicious person was detected, etc. to a security guard terminal (not shown in FIG. 3, etc.) carried by the security guard.

[0077] In this way, when a person not registered in the database of the server device 10 (for example, a person who entered the building due to an illegal tailgating) is detected as a suspicious person, the server device 10 notifies a security guard or the like of the presence of the suspicious person. Note that an admitted person who remains in the apartment building 20 beyond the permitted stay time is also detected as a suspicious person. This is because information about a visitor or the like is deleted from the temporary visitor management database when the permitted stay time is exceeded.

[0078] <Suspicious person detected> The server device 10 periodically or at a predetermined timing judges whether or not an admitted person is behaving suspiciously. For example, when image data is stored in the temporary visitor management database, the server device 10 analyzes the detection location of the corresponding admitted person and the stored image data to judge whether or not the person is behaving suspiciously. In other words, the server device 10 detects an admitted person who is behaving suspiciously as a suspicious person even if the permitted stay time has not elapsed.

[0079] For example, if a person permitted to enter an apartment building as an employee of a delivery company is detected on a floor other than the intended floor of the residence, the employee (person permitted to enter) is detected as a suspicious person. When a suspicious person is detected from among the persons permitted to enter, the server device 10 notifies a security guard or the like of the biometric information of the suspicious person (person photographed) and the location where the suspicious person was detected. The server device 10 transmits the face image of the suspicious person and the detection location, etc. to a security guard terminal carried by the security guard.

[0080] Next, each device included in the information processing system according to the first embodiment will be described in detail.

[0081] [Server device] Fig. 8 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to an embodiment of the present disclosure. Referring to Fig. 8, the server device 10 includes a communication control unit 201, a resident management unit 202, an interphone control unit 203, and a registration terminal control unit 204. Furthermore, the server device 10 includes a database control unit 205, an authentication unit 206, a tracking control unit 207, a suspicious person detection unit 208, and a storage unit 209.

[0082] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the terminal 60. The communication control unit 201 also transmits data to the terminal 60. The communication control unit 201 passes the data received from the other devices to the other processing modules. The communication control unit 201 transmits data acquired from the other processing modules to the other devices. In this way, the other processing modules transmit and receive data to and from the other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from the other devices and a function as a transmitting unit that transmits data to the other devices.

[0083] The resident management unit 202 is a means for controlling and managing the residents of the apartment building.

[0084] When a user (apartment resident) operates the terminal 60 to access a specific website, the resident management unit 202 acquires resident information of the apartment resident from the website.

[0085] Specifically, the resident management unit 202 acquires from the terminal 60 login information (ID, password), name, sex, date of birth, address (room number), contact information (telephone number, email address), biometric information, and the like.

[0086] When the resident management unit 202 acquires biometric information (face image), it generates feature amounts from the face image. Since existing technology can be used for the feature amount generation process by the resident management unit 202, detailed explanations are omitted. For example, the resident management unit 202 extracts the eyes, nose, mouth, etc. as feature points from the face image. After that, the resident management unit 202 calculates the positions of each feature point and the distance between each feature point as feature amounts (generating a feature vector consisting of multiple feature amounts).

[0087] After generating the feature amount, the resident management unit 202 generates a resident ID for identifying the resident. The resident ID may be any information that can uniquely identify the condominium resident. For example, the resident management unit 202 may assign a unique value each time resident information is acquired and use the unique value as the resident ID.

[0088] When the resident ID is generated, the resident management unit 202 adds a new entry to the resident management database and generates an account for the resident. The resident management unit 202 stores the resident ID, login information, name, biometric information (feature amount), etc. in the added entry (see FIG. 9).

[0089] 9 is merely an example and is not intended to limit the items stored in the resident management database, etc. For example, a "face image" may be registered in the resident management database as biometric information.

[0090] The interphone control unit 203 is a means for controlling the interphones (external interphone 21, internal interphone 22) installed in the apartment building 20.

[0091] The interphone control unit 203 receives a visitor notification from the external interphone 21. Upon receiving the visitor notification, the interphone control unit 203 calls the internal interphone 22 corresponding to the room number included in the notification.

[0092] The interphone control unit 203 refers to table information that associates and stores room numbers with the IP addresses, etc., of the corresponding internal interphones 22. The interphone control unit 203 obtains the IP address of the internal interphone 22 that corresponds to the room number included in the visitor notification, and calls the internal interphone 22 having the obtained IP address.

[0093] If there is no response from the internal interphone 22 within a predetermined period of time (if the resident is not at home), the interphone control unit 203 will send a message to the visitor via the external interphone 21 indicating that the resident is not at home.

[0094] If there is a response from the internal interphone 22, the interphone control unit 203 performs control so that the visitor and the resident can converse via the external interphone 21 and the internal interphone 22. Specifically, the interphone control unit 203 transmits multimedia data (audio data, image data) acquired from each of the external interphone 21 and the internal interphone 22 to the interphone on the other side.

[0095] The interphone control unit 203 receives the admission permission notification from the internal interphone 22. Upon receiving the admission permission notification, the interphone control unit 203 generates a feature amount from the biometric information acquired from the external interphone 21 (the visitor's facial image included in the visitor notification).

[0096] When the feature is generated, the interphone control unit 203 adds an entry to the temporary visitor management database. In the added entry, the interphone control unit 203 stores the visitor's biometric information (feature), information about the resident who allowed the visitor to enter (for example, the room number specified by the visitor), the registration date and time of the visitor, the permitted stay time, etc. (see FIG. 10).

[0097] In this way, the interphone control unit 203 acquires biometric information of a visitor visiting a resident of the apartment complex from the external interphone 21 installed at the entrance of the apartment complex. When a resident of the apartment complex allows a visitor to enter the apartment complex, the interphone control unit 203 acquires the permitted stay time for the visitor who has been permitted to enter the apartment complex from the internal interphone 22 installed in the resident's house. The interphone control unit 203 stores the acquired biometric information of the visitor and the acquired permitted stay time in the temporary visitor management database.

[0098] The registration terminal control unit 204 is a unit that performs control related to the registration terminal 30 .

[0099] The registration terminal control unit 204 receives a resident authentication request from the registration terminal 30. The registration terminal control unit 204 executes a matching process (1:N matching; N is a positive integer, the same applies below) using the biometric information included in the resident authentication request and the biometric information stored in the resident management database.

[0100] A detailed description of the matching process (authentication process) by the registration terminal control unit 204 will be omitted. A detailed description of the matching process will be given in the description of the authentication unit 206. The matching process of the registration terminal control unit 204 and the matching process of the authentication unit 206 can be the same.

[0101] If the matching process is successful, the enrollment terminal control unit 204 determines that the authentication is successful. If the matching process is unsuccessful, the enrollment terminal control unit 204 determines that the authentication is unsuccessful.

[0102] The registration terminal control unit 204 transmits the authentication result (authentication success, authentication failure) to the registration terminal 30. If the authentication is successful, the registration terminal control unit 204 transmits an affirmative response indicating that to the registration terminal 30. If the authentication is unsuccessful, the registration terminal control unit 204 transmits a negative response indicating that to the registration terminal 30.

[0103] The registration terminal control unit 204 receives a companion registration request from the registration terminal 30. Upon receiving the companion registration request, the registration terminal control unit 204 generates a feature amount from the biometric information (companion's facial image) included in the companion registration request.

[0104] When the feature is generated, the registration terminal control unit 204 adds an entry to the temporary visitor management database. In the added entry, the registration terminal control unit 204 stores the biometric information (feature) of the accompanying person, information about the resident who will enter the apartment building 20 with the accompanying person (e.g., room number), the registration date and time of the person permitted to enter, the permitted stay time, etc.

[0105] The registration terminal control unit 204 acquires the room number of the resident who will enter the condominium 20 together with the accompanying person from the entry identified by the matching process when processing the resident authentication request. The registration terminal control unit 204 sets the acquired room number in the permitted resident field of the temporary visitor management database.

[0106] The registration terminal control unit 204 transmits the processing result of the companion registration request (registration completed, registration incomplete) to the registration terminal 30. If the companion registration is successful, the registration terminal control unit 204 transmits an affirmative response to that effect to the registration terminal 30. If the companion registration fails, the registration terminal control unit 204 transmits a negative response to that effect to the registration terminal 30.

[0107] For example, if an appropriate feature amount (a feature amount suitable for biometric authentication) cannot be generated from the facial image of the accompanying person, a negative response is transmitted to the registration terminal 30.

[0108] In this way, the registration terminal control unit 204 acquires biometric information of an accompanying resident of the apartment complex from the registration terminal 30 installed at the entrance of the apartment complex. When the biometric authentication using the acquired biometric information and the biometric information stored in the resident management database is successful, the registration terminal control unit 204 notifies the registration terminal 30 that the biometric authentication of the accompanying resident of the apartment complex was successful. The registration terminal control unit 204 acquires the accompanying person's biometric information and the permitted stay time for the accompanying person from the registration terminal 30. The registration terminal control unit 204 stores the acquired biometric information of the accompanying person and the acquired permitted stay time in the temporary visitor management database.

[0109] The database control unit 205 is a means for controlling the database of the server device 10 (particularly, the temporary visitor management database).

[0110] The database control unit 205 accesses the temporary visitor management database periodically or at a predetermined timing. The database control unit 205 identifies entries whose permitted stay time has passed based on the set values ​​in the registration date and time field and permitted stay time field of each entry. The database control unit 205 deletes the identified entries.

[0111] In this way, when the permitted stay time has elapsed since the biometric information of an admitted person was registered in the temporary visitor management database, the database control unit 205 deletes from the temporary visitor management database the biometric information of the admitted person whose permitted stay time has elapsed at least.

[0112] The authentication unit 206 is a means for authenticating a person (person to be authenticated) who is attempting to enter the condominium 20.

[0113] The authentication unit 206 processes image data received from a camera device 40 that is installed so as to be able to capture an image of a person to be authenticated approaching the entrance door 50 .

[0114] 11 and 12 are flowcharts showing an example of the operation of the authentication unit 206 according to an embodiment of the present disclosure. The operation of the authentication unit 206 will be described with reference to FIGS.

[0115] When image data is received from the camera device 40, the authentication unit 206 attempts to extract a face image from the image data (extraction of face image; step S101).

[0116] Since the authentication unit 206 can use existing technology for the facial image extraction process, detailed description will be omitted. For example, the authentication unit 206 may extract a facial image (facial region) from image data using a learning model learned by a CNN (Convolutional Neural Network). Alternatively, the authentication unit 206 may extract a facial image using a method such as template matching.

[0117] If a face image is not extracted (step S102, No branch), the authentication unit 206 ends the process.

[0118] If at least one face image is extracted (step S102, Yes branch), the authentication unit 206 executes a matching process using biometric information stored in the resident management database (step S103).

[0119] Specifically, authentication unit 206 generates features from the extracted face image. Authentication unit 206 executes a matching process using the generated features and features stored in the resident management database. More specifically, authentication unit 206 sets the generated features as a matching target and performs 1:N matching between the features registered in the resident management database.

[0120] The authentication unit 206 calculates the similarity between the feature to be matched and each of the multiple feature on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, etc. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0121] If there is no feature among the multiple features registered in the resident management database that has a similarity to the feature to be matched that is equal to or greater than a predetermined value, the authentication unit 206 determines that the matching process (authentication process) has failed.

[0122] The authentication unit 206 determines that the matching process is successful if there is a feature among the multiple features registered in the resident management database that has a similarity with the feature to be matched that is equal to or greater than a predetermined value. If the matching process is successful, the resident corresponding to the entry having the feature with the highest similarity is identified as the person to be authenticated.

[0123] If the matching process is successful (step S104, Yes branch), the authentication unit 206 sets the authentication success for the person to be authenticated (the resident corresponding to the face image extracted from the image data) (step S105).

[0124] If the matching process fails (step S104, No branch), the authentication unit 206 executes matching authentication using the biometric information stored in the temporary visitor management database (step S106).

[0125] Specifically, the authentication unit 206 executes a matching process using features generated from a face image extracted from the image data and features registered in the temporary visitor management database. Note that this matching process can be substantially the same as the matching process in step S103, so a detailed description of the matching process in step S106 will be omitted.

[0126] If the second matching process is successful (step S107, Yes branch), the authentication unit 206 sets authentication success for the person to be authenticated (the person permitted to enter corresponding to the face image extracted from the image data) (step S105).

[0127] If the second matching process fails (step S107, No branch), the authentication unit 206 sets the authentication failure for the person to be authenticated (a person who is neither a resident nor an admitted person) (step S108).

[0128] The authentication unit 206 repeats the above two matching processes for each face image (person to be authenticated) extracted from the image data.

[0129] Specifically, if there is any person to be authenticated who has not yet undergone authentication processing (step S109, Yes branch), authentication unit 206 repeats the processes from step S103 onward. If there is no person to be authenticated who has not yet undergone authentication processing (step S109, No branch), authentication unit 206 executes the processes from step S110 onward shown in FIG.

[0130] The authentication unit 206 determines whether or not there is a person to be authenticated who has been set as unsuccessful in authentication (person who has failed authentication) (determining whether or not there is a person who has failed authentication; step S110 in FIG. 12).

[0131] If there is no authenticatee set as having failed authentication (step S111, No branch), authentication unit 206 instructs entrance door 50 to open the door (door open instruction; step S112).

[0132] If there is a person to be authenticated whose authentication has been set as unsuccessful (step S111, Yes branch), authentication unit 206 ends the process.

[0133] As explained above, the authentication process (matching process) for residents of the condominium 20 is successful the first time through matching using the biometric information stored in the resident management database. Also, the authentication process for visitors permitted to enter the condominium by a resident and accompanying persons entering the condominium 20 with the resident is successful the second time through matching using the biometric information stored in the temporary visitor management database. In other words, a person to be authenticated who does not have the proper authority to enter the condominium 20 will not be determined to have been successful in any authentication process. If a person who does not have the proper authority to enter the condominium is captured in the image data captured by the camera device 41, the server device 10 will not open the entrance door 50.

[0134] In this manner, the authentication unit 206 acquires the second image data from the camera device 40 (second camera device) installed so as to be able to capture an image of the person to be authenticated attempting to enter the apartment building through the entrance of the apartment building. The authentication unit 206 executes a first biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the resident management database. If the first biometric authentication fails, the authentication unit 206 executes a second biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the temporary visitor management database. If either the first biometric authentication or the second biometric authentication is successful, the authentication unit 206 permits the person to be authenticated to enter the apartment building.

[0135] The tracking control unit 207 is a means for executing control relating to tracking of persons permitted to enter.

[0136] The tracking control unit 207 has a function as a detection means and a function as a tracking means.

[0137] The detection means acquires first image data from a camera device 41 (first camera device) installed inside the apartment building. If two matching processes fail, the detection means detects the subject captured in the first image data as a suspicious person. The first matching process is a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database. The second matching process is a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database.

[0138] If the first of the two matching processes fails but the second is successful, the tracking means determines that the person photographed in the first image data is a person permitted to enter. The tracking means stores the location where the person photographed who has been determined to be a person permitted to enter was detected and the first image data in which the person photographed appears in the temporary visitor management database.

[0139] The tracking control unit 207 processes image data received from a camera device 41 that is installed so as to be able to capture images of the inside of the condominium 20 .

[0140] 13 is a flowchart showing an example of the operation of the tracking control unit 207 according to the embodiment of the present disclosure. The operation of the tracking control unit 207 will be described with reference to FIG.

[0141] When image data is received from the camera device 41, the tracking control unit 207 attempts to extract a face image from the image data (extraction of face image; step S201).

[0142] If a face image is not extracted (step S202, No branch), the tracking control unit 207 ends the process.

[0143] When at least one face image is extracted (step S202, Yes branch), the tracking control unit 207 specifies the location where the image was taken based on the camera ID received from the camera device 41. For example, the tracking control unit 207 refers to table information that stores the camera ID and the installation location of the camera device 41 in association with each other, and specifies the location where the image was taken.

[0144] Thereafter, the tracking control unit 207 executes a matching process using the biometric information extracted from the image data and the biometric information stored in the resident management database (step S203).

[0145] If the matching process is successful (step S204, Yes branch), the tracking control unit 207 does not perform any special process on the photographed person (the resident corresponding to the face image extracted from the image data).

[0146] If the matching process fails (step S204, No branch), the tracking control unit 207 executes a matching process using the biometric information extracted from the image data and the biometric information stored in the temporary visitor management database (step S205).

[0147] If the second matching process is successful (step S206, Yes branch), the tracking control unit 207 executes tracking processing for the photographed person (the admitted person corresponding to the face image extracted from the image data) (step S207).

[0148] Specifically, the tracking control unit 207 stores in the temporary visitor management database the location (detected location) where the photographed person (admitted person) was photographed and the image data (image data showing the admitted person) received from the camera device 41. More specifically, the tracking control unit 207 stores the detection date and time, detection location and image data of the admitted person in the action history field of the entry of the temporary visitor specified by the matching process (entry in the temporary visitor management database).

[0149] If the second matching process fails (step S206, No branch), the tracking control unit 207 sets the photographed person (the person corresponding to the facial image extracted from the image data) as a suspicious person and notifies a security guard or the like of the presence of the suspicious person (Notify suspicious person; step S208).

[0150] Specifically, the tracking control unit 207 transmits biometric information of a suspicious person (person to be photographed), a location where the suspicious person was detected, and the like to a security guard terminal carried by the security guard.

[0151] The tracking control unit 207 repeats the above two matching processes for each face image (person to be photographed) extracted from the image data.

[0152] Specifically, if there is a person to be photographed who has not yet undergone the matching process (step S209, Yes branch), the tracking control unit 207 repeats the processes from step S203 onwards. If there is no person to be photographed who has not yet undergone the matching process (step S209, No branch), the tracking control unit 207 ends the process.

[0153] The suspicious person detection unit 208 is a means for detecting a suspicious person from among those permitted to enter the condominium 20 temporarily.

[0154] The suspicious person detection unit 208 accesses the temporary visitor management database periodically or at a predetermined timing, and judges whether or not an admitted person is behaving suspiciously. For example, the suspicious person detection unit 208 judges whether or not an admitted person is behaving suspiciously at the timing when the detection location and image data of the admitted person are stored in the temporary visitor management database.

[0155] For example, if an individual who has been granted entry is detected for a predetermined period of time (e.g., 10 minutes or more) on a floor other than the floor on which the residence of the resident who permitted the individual to enter is located, the suspicious individual detection unit 208 determines that the individual's behavior is "suspicious."

[0156] Alternatively, the suspicious person detection unit 208 may detect suspicious behavior of an admitted individual by inputting at least one image data relating to the admitted individual who is the subject of suspicious person detection into a learning model obtained by machine learning.

[0157] For example, the behavior of an individual permitted to enter who has stored image data of the individual touching a doorknob of a house may be determined to be "suspicious."

[0158] The learning model is obtained by machine learning using a large amount of training data in which labels (suspicious behavior, non-suspicious behavior) are added to image data (image data showing suspicious behavior, image data not showing suspicious behavior). Any algorithm such as a support vector machine, boosting, or neural network can be used to generate the learning model. Note that known techniques can be used for the algorithms such as the support vector machine, and therefore the description thereof will be omitted.

[0159] If a suspicious person is detected among those permitted to enter, the suspicious person detection unit 208 transmits the face image of the suspicious person, the detection location, and the like to a security guard terminal carried by the security guard.

[0160] In this way, the suspicious person detection unit 208 detects whether the photographed person determined to be permitted entry is behaving suspiciously based on the location where the photographed person was detected or the first image data in which the photographed person appears, which are stored in the temporary visitor management database. The suspicious person detection unit 208, like the tracking control unit 207, transmits the biometric information of the detected suspicious person and the location where the suspicious person was detected to a terminal carried by a security guard who guards the apartment complex.

[0161] The storage unit 209 is a means for storing information necessary for the operation of the server device 10. The storage unit 209 stores biometric information of residents of the apartment complex in a resident management database. The storage unit 209 stores, in the temporary visitor management database, biometric information of an admitted person who is permitted to enter the apartment complex and an permitted stay time, which is the time during which the admitted person is permitted to stay in the apartment complex, in association with each other.

[0162] [External intercom and internal intercom] The external interphone 21 and the internal interphone 22 can be realized by an information processing terminal equipped with a camera, a touch panel, etc. The configurations of the external interphone 21 and the internal interphone 22 are clear to those skilled in the art, so detailed explanations will be omitted.

[0163] [Registered device] The registration terminal 30 can be realized by a signage or tablet device equipped with a camera. The registration terminal 30 can be any equipment or device that can accept user operations and communicate with the server device 10. In addition, the configuration of the registration terminal 30 is clear to those skilled in the art, so detailed explanations will be omitted.

[0164] [Camera equipment] The configuration of the camera devices 40 and 41 will be clear to those skilled in the art, and detailed description thereof will be omitted. The camera devices 40 and 41 photograph a predetermined area periodically or at a predetermined timing, and transmit the obtained image data together with the camera ID to the server device 10.

[0165] [Entrance door] The structure of the entrance door 50 will be clear to those skilled in the art, and detailed description thereof will be omitted. The entrance door 50 opens the door in response to an instruction from the server device 10, and closes the door after a predetermined time has elapsed.

[0166] [Device] Examples of the terminal 60 include a mobile terminal device such as a smartphone, a mobile phone, a game machine, a tablet, or a computer (personal computer, notebook computer), etc. The terminal 60 can be any equipment or device that can accept user operations and communicate with the server device 10, etc. Also, since the configuration of the terminal 60 is clear to those skilled in the art, detailed explanations will be omitted.

[0167] [System Operation] Next, the operation of the information processing system according to the first embodiment will be described.

[0168] 14 is a sequence diagram showing an example of an operation of the information processing system according to the embodiment of the present disclosure. The operation of the information processing system according to the embodiment of the present disclosure regarding visitor registration will be described with reference to FIG.

[0169] The visitor inputs the room number of the visitor to the external interphone 21. In response to the input, the external interphone 21 acquires biometric information of the visitor. The external interphone 21 transmits a visitor notification including the acquired biometric information and the room number to the server device 10 (step S11).

[0170] When the visitor notification is received, the server device 10 calls the internal interphone 22 corresponding to the room number specified by the visitor. When the internal interphone 22 answers, the server device 10 relays data such as voice and images transmitted and received between the external interphone 21 and the internal interphone 22 (step S12).

[0171] When a resident allows a visitor to enter the apartment building, the internal interphone 22 acquires the time (period) for which the resident allows the visitor to stay in the apartment building. For example, the internal interphone 22 acquires the permitted stay time using a GUI as shown in FIG.

[0172] The internal interphone 22 transmits an admission permission notice including the acquired permitted stay time to the server device 10 (step S13).

[0173] In response to receiving the admission permission notice, the server device 10 stores the visitor's biometric information, resident information (room number), permitted stay time, etc. in a temporary visitor management database (visitor registration; step S14).

[0174] 16 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment of the present disclosure, with reference to which the operation of the information processing system according to the embodiment of the present disclosure regarding companion registration will be described.

[0175] The registration terminal 30 acquires biometric information of the accompanying resident, and then transmits a resident authentication request including the acquired biometric information to the server device 10 (step S21).

[0176] The server device 10 executes authentication processing using the biometric information included in the resident authentication request and the biometric information stored in the resident management database (step S22).

[0177] If the authentication is successful, the server device 10 notifies the registration terminal 30 of the success of the authentication (step S23).

[0178] If the authentication is successful, the registration terminal 30 acquires the time (period) that the resident allows the accompanying person to stay in the apartment building. For example, the registration terminal 30 acquires the permitted stay time using a GUI as shown in Fig. 17. After acquiring the permitted stay time, the registration terminal 30 acquires the biometric information of the accompanying person.

[0179] The registration terminal 30 transmits a companion registration request including the acquired biometric information of the companion and the permitted stay time to the server device 10 (step S24).

[0180] In response to receiving the companion registration request, the server device 10 stores the companion's biometric information, resident information (room number), permitted stay time, etc. in the temporary visitor management database (companion registration; step S25).

[0181] When the companion registration is normally completed, the server device 10 notifies the registration terminal 30 of the completion of the registration (step S26).

[0182] As described above, the information processing system according to the first embodiment stores the biometric information and permitted stay time of visitors who are permitted to enter the apartment building 20 by residents. When the permitted stay time of the person has elapsed, the server device 10 deletes the biometric information of the person permitted to enter from the temporary visitor management database. As a result, a person who remains in the apartment building 20 beyond the permitted stay time is detected as a suspicious person. Information about the suspicious person is immediately notified to a security guard or the like, so the safety of the apartment building 20 is maintained.

[0183] In addition, the server device 10 monitors the behavior of individuals permitted to stay in the condominium 20. If the individual is behaving suspiciously, the server device 10 treats the individual as a suspicious person and notifies a security guard or the like of the presence of a suspicious person. This also helps to ensure the safety of the condominium 20.

[0184] Furthermore, the server device 10 performs biometric authentication on people who visit the auto-lock apartment building. The server device 10 uses the biometric authentication to determine whether or not the person has the authority to enter the apartment building 20, and opens the entrance door 50 if the person has legitimate authority. In other words, the server device 10 controls the passage of people who are attempting to enter the apartment building 20 without using a clear gate. As a result, the burden on residents and visitors (burden related to unlocking the door) is reduced.

[0185] Furthermore, the server device 10 can prevent suspicious people from entering the apartment building 20 by registering the biometric information of each person who visits the apartment building 20 and making the above-mentioned judgments. As a result, crime prevention for the apartment building 20 is improved. The biometric information of visitors can be collected through an intercom installed in the apartment building 20, and the biometric information of people accompanying residents can be collected through the registration terminal 30.

[0186] Next, the hardware of each device constituting the information processing system will be described. Fig. 18 is a diagram showing an example of the hardware configuration of the server device 10.

[0187] The server device 10 can be configured by an information processing device (so-called a computer), and has the configuration exemplified in Fig. 18. For example, the server device 10 has a processor 311, a memory 312, an input / output interface 313, a communication interface 314, etc. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0188] However, the configuration shown in Fig. 18 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. In addition, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 18, and for example, the server device 10 may include multiple processors 311.

[0189] The processor 311 is, for example, a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0190] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0191] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display, etc. The input device is, for example, a keyboard, a mouse, a touch panel, etc. that accepts user operations.

[0192] The communication interface 314 is a circuit, a module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0193] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded in a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules may also be realized by a semiconductor chip.

[0194] The registration terminal 30, terminal 60, etc. can also be configured from an information processing device like the server device 10, and the basic hardware configuration is no different from that of the server device 10, so a description thereof will be omitted.

[0195] The server device 10 is equipped with a computer, and the computer executes a program to realize the functions of the server device 10. The server device 10 also executes a control method for the server device 10 by the program.

[0196] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the system configuration, etc.

[0197] In the above embodiment, it has been described that visitor registration is performed via the internal intercom 22 installed in the residence of the target resident. The visitor registration may also be performed via the terminal 60 carried by the resident. In this case, the server device 10 notifies the terminal 60 (the resident's email address) carried by the resident of the room number specified by the visitor that there is a visitor. In response to the notification, the terminal 60 displays a message or the like on the display to inform the resident of the visitor's arrival. When the resident indicates his / her intention to respond, the terminal 60 notifies the server device 10 of the intention. The server device 10 relays data communication between the external intercom 21 and the terminal 60. A resident who has permitted the visitor to enter the apartment inputs the permitted stay time into the terminal 60. The terminal 60 transmits an entry permission notification including the permitted stay time to the server device 10.

[0198] Similarly, a companion who will enter the apartment building 20 together with a resident may also be registered via the terminal 60. The companion inputs the room number of the resident into the external intercom 21. The server device 10 may obtain the permitted stay time of the companion from the terminal 60 of the resident who is going to enter the apartment building 20 together with the companion.

[0199] In the above embodiment, a case has been described in which biometric authentication is performed at the entrance (entrance door 50). However, biometric authentication may also be performed at other locations. For example, authentication of residents or temporary visitors may be performed in an elevator hall. If there is an unsuccessful authentication individual who has been determined to have failed authentication, the server device 10 may prohibit the unsuccessful authentication individual from operating the elevator. In this case, the server device 10 may instruct a device that controls the elevator to prohibit the operation of the elevator.

[0200] Alternatively, biometric authentication may be performed on temporary visitors as well as residents in each residence within an apartment building.

[0201] The server device 10 may provide the condominium resident with an interface that enables the resident to change (extend) the permitted stay time that the resident has set. For example, the database control unit 205 of the server device 10 determines whether or not the room number of the resident who has logged in to their account is set in the permitted resident field of the temporary visitor management database. If the room number is set, the database control unit 205 acquires the permitted stay time to be extended by a GUI or the like while displaying the current permitted stay time (or the remaining time that can be stayed). The database control unit 205 stores the acquired permitted stay time in the temporary visitor management database.

[0202] The server device 10 may register a face image as biometric information instead of the feature amount in the resident management database or the temporary visitor management database. In this case, the server device 10 may generate a feature amount and authenticate the person to be authenticated every time an authentication process occurs.

[0203] In the above embodiment, a case has been described in which the resident management database and temporary visitor management database are configured inside the server device 10, but these databases may be constructed in an external database server or the like. That is, some of the functions of the server device 10 may be implemented in another device. More specifically, it is sufficient that the above-described "authentication unit (authentication means)" and the like are implemented in any of the devices included in the system.

[0204] Although the form of data transmission and reception between each device (e.g., server device 10, registration terminal 30, terminal 60, etc.) is not particularly limited, data transmitted and received between these devices may be encrypted. Biometric information and the like is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.

[0205] In the flow charts (flow charts, sequence diagrams) used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the figures can be changed to a degree that does not interfere with the content, such as executing each process in parallel.

[0206] The above-mentioned embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the configurations described above are necessary. In addition, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace a part of the configuration of an embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of an embodiment. Furthermore, it is possible to add, delete, or replace a part of the configuration of an embodiment with another configuration.

[0207] From the above explanation, the industrial applicability of the present invention is clear, and the present invention can be suitably applied to an information processing system that realizes biometric authentication for apartment residents and the like.

[0208] A part or all of the above-described embodiments may be described as, but is not limited to, the following supplementary notes. [Appendix 1] a storage means for storing biometric information of residents of an apartment complex in a resident management database, and for storing in a temporary visitor management database biometric information of an admitted person who is permitted to enter the apartment complex and a permitted stay time, which is the time that the admitted person is permitted to stay in the apartment complex; a database control means for deleting, when the permitted stay time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose permitted stay time has elapsed from the temporary visitor management database; a detection means for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the resident management database fails and when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A server device comprising: [Appendix 2] The server device described in Appendix 1, wherein the detection means transmits biometric information of the detected suspicious person and the location where the suspicious person was detected to a terminal carried by a security guard who guards the apartment complex. [Appendix 3] The server device described in Appendix 2 further comprises a tracking means for, if the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails, but the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database is successful, determining that the subject appearing in the first image data is the person permitted to enter, and storing in the temporary visitor management database the location where the subject determined to be the person permitted to enter was detected and the first image data in which the subject appears. [Appendix 4] The server device described in Appendix 3, further comprising a suspicious person detection means for detecting whether the person photographed who has been determined to be permitted entry is behaving suspiciously based on the location where the person photographed was detected or the first image data in which the person photographed appears, which are stored in the temporary visitor management database. [Appendix 5] acquiring second image data from a second camera device installed so as to be able to capture an image of a person to be authenticated attempting to enter the apartment building through an entrance of the apartment building; performing a first biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the resident management database; if the first biometric authentication fails, a second biometric authentication is performed using biometric information obtained from the acquired second image data and the biometric information stored in the temporary visitor management database; A server device as described in any one of appendix 1 to 4, further comprising an authentication means for allowing the person to be authenticated to enter the apartment building if either the first biometric authentication or the second biometric authentication is successful. [Appendix 6] Acquire biometric information of a visitor to a resident of the apartment building from an external intercom installed at an entrance of the apartment building; When a resident of the apartment complex permits the visitor to enter the apartment complex, the residence permit time is obtained from an internal intercom installed in the residence of the resident of the apartment complex for the visitor who has been permitted to enter the apartment complex; The server device according to any one of appendix 1 to 4, further comprising an intercom control means for storing the acquired biometric information of the visitor and the acquired permitted stay time in the temporary visitor management database. [Appendix 7] acquire biometric information of a resident of the apartment complex who is accompanied by a person from a registration terminal installed at an entrance of the apartment complex, and when biometric authentication using the acquired biometric information and the biometric information stored in the resident management database is successful, notify the registration terminal of the success of the biometric authentication of the resident of the apartment complex who is accompanied by a person; Acquire the biometric information of the accompanying person and the permitted stay time for the accompanying person from the registration terminal; The server device according to any one of claims 1 to 4, further comprising a registration terminal control means for storing the acquired biometric information of the accompanying person and the acquired permitted stay time in the temporary visitor management database. [Appendix 8] a storage process for storing biometric information of residents of an apartment building in a resident management database, and for correlating the biometric information of an admitted person who is permitted to enter the apartment building with an permitted stay time, which is the time that the admitted person is permitted to stay in the apartment building, in a temporary visitor management database; a database control step of deleting, when the stay permission time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose stay permission time has elapsed from the temporary visitor management database; a detection process for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the resident management database fails and a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A method for controlling a server device comprising: [Appendix 9] A control method for a server device as described in Appendix 8, wherein the detection process includes transmitting biometric information of the detected suspicious person and the location where the suspicious person was detected to a terminal carried by a security guard who guards the apartment complex. [Appendix 10] The control method for a server device described in Appendix 9, further comprising a tracking step of determining, if the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails, and if the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database is successful, determining that the subject appearing in the first image data is the person permitted to enter, and storing in the temporary visitor management database the location where the subject determined to be the person permitted to enter was detected and the first image data in which the subject appears. [Appendix 11] The server device control method described in Appendix 10, further comprising a suspicious person detection step of detecting whether the person photographed who has been determined to be permitted entry is behaving suspiciously based on the location where the person photographed was detected or the first image data in which the person photographed appears, which are stored in the temporary visitor management database. [Appendix 12] acquiring second image data from a second camera device installed so as to be able to capture an image of a person to be authenticated attempting to enter the apartment building through an entrance of the apartment building; performing a first biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the resident management database; if the first biometric authentication fails, a second biometric authentication is performed using biometric information obtained from the acquired second image data and the biometric information stored in the temporary visitor management database; A method for controlling a server device as described in any one of appendixes 8 to 11, further comprising an authentication step of permitting the person to enter the apartment building if either the first biometric authentication or the second biometric authentication is successful. [Appendix 13] Acquire biometric information of a visitor to a resident of the apartment building from an external intercom installed at an entrance of the apartment building; When a resident of the apartment complex permits the visitor to enter the apartment complex, the residence permit time is obtained from an internal intercom installed in the residence of the resident of the apartment complex for the visitor who has been permitted to enter the apartment complex; 12. The method for controlling a server device according to any one of claims 8 to 11, further comprising an intercom control step of storing the acquired biometric information of the visitor and the acquired permitted stay time in the temporary visitor management database. [Appendix 14] acquire biometric information of a resident of the apartment complex who is accompanied by a person from a registration terminal installed at an entrance of the apartment complex, and when biometric authentication using the acquired biometric information and the biometric information stored in the resident management database is successful, notify the registration terminal of the success of the biometric authentication of the resident of the apartment complex who is accompanied by a person; Acquire the biometric information of the accompanying person and the permitted stay time for the accompanying person from the registration terminal; A method for controlling a server device as described in any one of appendix 8 to 11, further comprising a registration terminal control step of storing the acquired biometric information of the accompanying person and the acquired permitted stay time in the temporary visitor management database. [Appendix 15] A computer installed in the server device a storage process for storing biometric information of residents of an apartment building in a resident management database, and for correlating the biometric information of an admitted person who is permitted to enter the apartment building with an admitted stay time, which is the time that the admitted person is permitted to stay in the apartment building, in a temporary visitor management database; a database control process for deleting, when the stay permission time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose stay permission time has elapsed from the temporary visitor management database; a detection process for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the resident management database fails and when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A program for executing. [Appendix 16] The program described in Appendix 15, wherein the detection process transmits biometric information of the detected suspicious individual and the location where the suspicious individual was detected to a terminal carried by a security guard who guards the apartment complex. [Appendix 17] The program described in Appendix 16 further executes a tracking process in which, if the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails, but the matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database is successful, the subject appearing in the first image data is determined to be the person permitted to enter, and the location where the subject determined to be the person permitted to enter was detected and the first image data in which the subject appears are stored in the temporary visitor management database. [Appendix 18] The program described in Appendix 17 further executes a suspicious person detection process to detect whether the subject who has been determined to be allowed entry is behaving suspiciously based on the location where the subject was detected or the first image data in which the subject appears, which are stored in the temporary visitor management database. [Appendix 19] acquiring second image data from a second camera device installed so as to be able to capture an image of a person to be authenticated attempting to enter the apartment building through an entrance of the apartment building; performing a first biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the resident management database; if the first biometric authentication fails, a second biometric authentication is performed using biometric information obtained from the acquired second image data and the biometric information stored in the temporary visitor management database; A program as described in any one of appendices 15 to 18, further executing an authentication process to allow the authenticated person to enter the apartment building if either the first biometric authentication or the second biometric authentication is successful. [Appendix 20] Acquire biometric information of a visitor to a resident of the apartment building from an external intercom installed at an entrance of the apartment building; When a resident of the apartment complex permits the visitor to enter the apartment complex, the residence permit time is obtained from an internal intercom installed in the residence of the resident of the apartment complex for the visitor who has been permitted to enter the apartment complex; 19. The program according to any one of appendix 15 to 18, further executing an intercom control process to store the acquired biometric information of the visitor and the acquired permitted stay time in the temporary visitor management database. [Appendix 21] acquire biometric information of a resident of the apartment complex who is accompanied by a person from a registration terminal installed at an entrance of the apartment complex, and when biometric authentication using the acquired biometric information and the biometric information stored in the resident management database is successful, notify the registration terminal of the success of the biometric authentication of the resident of the apartment complex who is accompanied by a person; Acquire the biometric information of the accompanying person and the permitted stay time for the accompanying person from the registration terminal; The program described in any one of appendices 15 to 18, further executing a registration terminal control process to store the acquired biometric information of the accompanying person and the acquired permitted stay time in the temporary visitor management database.

[0209] In addition, some or all of the configurations described in Supplementary Notes 2 to 7 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 8 and 15 in the same dependent relationship as Supplementary Notes 2 to 7. Furthermore, not limited to Supplementary Notes 1, 8, and 15, but also to various hardware, software, various recording means for recording software, or systems, some or all of the configurations described as supplementary notes may be dependent thereon within the scope of each of the above-mentioned embodiments.

[0210] The disclosures of the above cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and amendments that a person skilled in the art can make in accordance with the entire disclosure, including the scope of the claims, and the technical ideas. [Explanation of symbols]

[0211] 10. Server device 20 Apartment 21 External intercom 22 Internal intercom 30 Registered terminals 40 Camera Equipment 41 Camera Equipment 50 Entrance Door 60 terminals 100 Server device 101 Memory means 102 Database Control Means 103 Detection means 201 Communication control section 202 Resident Management Department 203 Interphone control unit 204 Registration terminal control unit 205 Database Control Section 206 Authentication Department 207 Tracking control section 208 Suspicious Person Detection Unit 209 Memory section 311 Processor 312 Memory 313 Input / Output Interface 314 Communication Interface

Claims

1. a storage means for storing biometric information of residents of an apartment complex in a resident management database, and for storing in a temporary visitor management database biometric information of an admitted person who is permitted to enter the apartment complex and a permitted stay time, which is the time that the admitted person is permitted to stay in the apartment complex; a database control means for deleting, when the permitted stay time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose permitted stay time has elapsed from the temporary visitor management database; a detection means for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails and when a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A server device comprising:

2. 2. The server device according to claim 1, wherein the detection means transmits biometric information of the detected suspicious person and a location where the suspicious person was detected to a terminal carried by a security guard who guards the apartment complex.

3. 3. The server device according to claim 2, further comprising a tracking means for, if a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails, and if a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database is successful, determining that the subject appearing in the first image data is the person permitted to enter, and storing in the temporary visitor management database the location where the subject determined to be the person permitted to enter was detected and the first image data in which the subject appears.

4. The server device according to claim 3, further comprising a suspicious person detection means for detecting whether the person to be photographed who has been determined to be permitted entry is engaging in suspicious behavior based on the location where the person to be photographed was detected or the first image data in which the person to be photographed appears, which are stored in the temporary visitor management database.

5. acquiring second image data from a second camera device installed so as to be able to capture an image of a person to be authenticated attempting to enter the apartment building through an entrance of the apartment building; performing a first biometric authentication using biometric information obtained from the acquired second image data and biometric information stored in the resident management database; if the first biometric authentication fails, a second biometric authentication is performed using biometric information obtained from the acquired second image data and the biometric information stored in the temporary visitor management database; The server device according to claim 1 , further comprising an authentication means for permitting the person to be authenticated to enter the apartment building if either the first biometric authentication or the second biometric authentication is successful.

6. Acquire biometric information of a visitor to a resident of the apartment building from an external intercom installed at an entrance of the apartment building; When a resident of the apartment complex permits the visitor to enter the apartment complex, the residence permit time is obtained from an internal intercom installed in the residence of the resident of the apartment complex for the visitor who has been permitted to enter the apartment complex; 5. The server device according to claim 1, further comprising an interphone control means for storing the acquired biometric information of the visitor and the acquired permitted stay time in the temporary visitor management database.

7. acquire biometric information of a resident of the apartment complex who is accompanied by a person from a registration terminal installed at an entrance of the apartment complex, and when biometric authentication using the acquired biometric information and the biometric information stored in the resident management database is successful, notify the registration terminal of the success of the biometric authentication of the resident of the apartment complex who is accompanied by a person; Acquire the biometric information of the accompanying person and the permitted stay time for the accompanying person from the registration terminal; 5. The server device according to claim 1, further comprising a registration terminal control means for storing said acquired biometric information of said accompanying person and said acquired permitted stay time in said temporary visitor management database.

8. a storage process for storing biometric information of residents of an apartment building in a resident management database, and for correlating the biometric information of an admitted person who is permitted to enter the apartment building with an permitted stay time, which is the time that the admitted person is permitted to stay in the apartment building, in a temporary visitor management database; a database control step of deleting, when the stay permission time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose stay permission time has elapsed from the temporary visitor management database; a detection process for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the resident management database fails and when a matching process using the biometric information of the subject acquired from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A method for controlling a server device comprising:

9. A computer installed in the server device a storage process for storing biometric information of residents of an apartment building in a resident management database, and for correlating the biometric information of an admitted person who is permitted to enter the apartment building with an admitted stay time, which is the time that the admitted person is permitted to stay in the apartment building, in a temporary visitor management database; a database control process for deleting, when the stay permission time has elapsed since the biometric information of the admitted person was registered in the temporary visitor management database, at least the biometric information of the admitted person whose stay permission time has elapsed from the temporary visitor management database; a detection process for acquiring first image data from a first camera device installed inside the apartment complex, and detecting the subject appearing in the first image data as a suspicious person when a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the resident management database fails and when a matching process using the biometric information of the subject obtained from the acquired first image data and the biometric information stored in the temporary visitor management database fails; A program for executing the above.

Images