Systems, programs, and information processing methods

Abstract

The present invention provides a system, program, and information processing method for lifting restrictions on entry into a designated area based on facial images of intermediary employees and information on property viewing appointments. [Solution] In System 1, the intermediary registration means 111 of the management server 10 registers information regarding the identification information and facial images of the intermediary's employees, the viewing reservation acceptance means 113 accepts viewing reservation information including the identification information and viewing date and time information of the intermediary's employees, the first authentication means 114 compares the information regarding the facial image of the intermediary's employee that has been captured with the information regarding the facial image of the intermediary's employee that has been registered, and authenticates the intermediary's employee, and the first entry restriction release means 115 releases the restriction on entry into a predetermined area by the entry restriction device 30 if the intermediary's employee has been authenticated and the date and time on which the intermediary's employee was captured and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means meet predetermined conditions.

Description

Technical Field

[0001] This disclosure relates to a system, a program, and an information processing method.

Background Art

[0002] When renting or purchasing an existing real estate property, generally, the surrounding environment of the property is inspected, and the interior of the property that will actually be lived in or used is actually visited and confirmed. At this time, checking the interior before signing a lease or purchase contract for a real estate property is generally referred to as "viewing the interior."

[0003] Face recognition technology that can perform face recognition with an authentication engine is generally known (see, for example, Patent Document 1, etc.).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Here, in the conventional technology, instructions were not given to the access control device based on the authentication of the employees of the intermediary.

[0006] This disclosure has been made in consideration of such points, and an object thereof is to provide a system, a program, and an information processing method capable of releasing the restriction on entry into a predetermined area based on the face image of an employee of an intermediary and information on the reservation for viewing the interior of a property.

Means for Solving the Problems

[0007] The system of this disclosure is an access control device that selectively restricts entry into a predetermined area, An imaging device that captures the facial image of a user whose entry restrictions into a designated area by the aforementioned entry restriction device should be lifted, Computers and, A system equipped with, The aforementioned system functions as a means for registering intermediaries, a means for accepting viewing reservations, an authentication means, and a means for lifting entry restrictions by executing a program. The aforementioned intermediary registration means registers information regarding the identification information and facial images of the intermediary's employees. The aforementioned viewing reservation acceptance means accepts viewing reservation information including the identification information of the real estate agent's employee and viewing date and time information regarding the date and time the viewing will take place. The authentication means authenticates the intermediary's employees by comparing information regarding the facial images of the intermediary's employees captured by the imaging device with information regarding the facial images of the intermediary's employees registered by the intermediary registration means. The entry restriction release means releases the entry restriction on the designated area imposed by the entry restriction device when the authentication means authenticates the intermediary's employee and the date and time the intermediary's employee was photographed by the imaging device and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means meet predetermined conditions.

[0008] In the aforementioned system, the intermediary registration means may form the feature data of the facial image.

[0009] Furthermore, in the system described above, the feature data of the face image may be a set of pixel values ​​of pixels corresponding to the face image.

[0010] Furthermore, in the system, the intermediary registration means may form one of the following: a hash value, a checksum, or binarized compressed data of the facial image feature data.

[0011] Furthermore, in the system, the authentication means may detect contour lines for each facial part contained in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee based on the pixel values ​​contained in the information regarding the facial image of the intermediary's employee captured by the imaging device and the information regarding the facial image of the intermediary's employee registered by the intermediary registration means.

[0012] Furthermore, in the system, the authentication means may compare the contour lines of the detected captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee, and determine whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person based on the degree of similarity of the contour lines being compared.

[0013] Furthermore, in the system, if the authentication means determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person, it may grant permission as authentication.

[0014] Furthermore, in the system, if the authentication means determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, it may deny the authentication.

[0015] The program disclosed herein is An entry restriction device that selectively restricts entry into a designated area, An imaging device that captures the facial image of a user whose entry restrictions into a designated area by the aforementioned entry restriction device should be lifted, Computers and, A program that, when executed by the control unit of a system equipped with the above, causes the intermediary registration means, the viewing reservation acceptance means, the authentication means, and the entry restriction release means to function as follows: The aforementioned intermediary registration means registers information regarding the identification information and facial images of the intermediary's employees. The interior view reservation reception means receives interior view reservation information including identification information of an employee of a brokerage firm and interior view date and time information regarding the date and time when the interior view is to be conducted. The authentication means authenticates an employee of a brokerage firm by comparing information regarding a face image of an employee of a brokerage firm captured by the imaging device with information regarding a face image of an employee of a brokerage firm registered by the brokerage firm registration means. When the authentication of an employee of a brokerage firm is performed by the authentication means and the date and time when an employee of a brokerage firm is captured by the imaging device and the interior view date and time in the interior view reservation information received by the interior view reservation reception means satisfy a predetermined condition, the entry restriction release means releases the restriction on entry into a predetermined area by the entry restriction device.

[0016] The information processing method of the present disclosure is an information processing method executed by a control unit of a system including an entry restriction device that selectively restricts entry into a predetermined area, an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device is to be released, a computer, and includes registering identification information and information regarding a face image of an employee of a brokerage firm, receiving interior view reservation information including identification information of an employee of a brokerage firm and interior view date and time information regarding the date and time when the interior view is to be conducted, authenticating an employee of a brokerage firm by comparing information regarding a face image of an employee of a brokerage firm captured by the imaging device with registered information regarding a face image of an employee of a brokerage firm, and when the authentication of an employee of a brokerage firm is performed and the date and time when an employee of a brokerage firm is captured by the imaging device and the interior view date and time in the interior view reservation information satisfy a predetermined condition, releasing the restriction on entry into a predetermined area by the entry restriction device.

Advantages of the Invention

[0017] ​According to the system of the present disclosure, it is possible to provide a system, a program, and an information processing method that can selectively restrict the entry of a predetermined person into a predetermined area.

Brief Description of the Drawings

[0018] [Figure 1] It is a schematic diagram showing the overall configuration of the system according to this embodiment. [Figure 2] In the system according to this embodiment, it is an activity diagram showing the flow of information between elements when a broker is registered. [Figure 3] In the system according to this embodiment, it is an activity diagram showing the flow of information between elements when an interior viewing reservation of a property is made. [Figure 4] In the system according to this embodiment, it is an activity diagram showing the flow of information between elements when an interior viewing of a property is conducted. [Figure 5] (A) In the system according to this embodiment, it is a diagram showing an example of a display format in which candidates for available dates and times for an interior viewing presented at the time of interior viewing reservation can be selected, and (B) it is a diagram showing an example of a display presented after selecting candidates for an interior viewing reservation date and time. [Figure 6] In the system according to this embodiment, it is a flowchart showing the flow of processing by a broker. [Figure 7] In the system according to this embodiment, it is a flowchart showing the flow of processing for handling visitors based on whether authentication is successful or not. [Figure 8] In the system according to this embodiment, it is a flowchart showing the flow of processing for suspending the use and deleting the registration information of a resident who has already moved out.

Embodiments for Carrying Out the Invention

[0019] Hereinafter, this embodiment will be illustrated and described with reference to the drawings.

[0020] <System 1> As shown in Figure 1, in this embodiment, System 1 allows an employee of a property brokerage firm, who has previously registered information regarding facial images in a management server (computer 10), to lift the entry restriction imposed by the entry restriction device 30 to a predetermined area (specifically, a common space in an apartment building) based on the information regarding the facial image captured by the imaging device 20. The configuration of this System 1 will be explained using Figure 1.

[0021] As shown in Figure 1, System 1 comprises an access control device 30, an imaging device 20, a computer 10 (management server), a tenant terminal 40, a real estate agent terminal 50, and an administrator terminal 60. The computer 10 is connected to each of the access control device 30, imaging device 20, tenant terminal 40, real estate agent terminal 50, and administrator terminal 60 via a network such as the Internet. The access control device 30 and imaging device 20 are also connected to each other via wireless or wired connections. Furthermore, the access control device 30, imaging device 20, tenant terminal 40, real estate agent terminal 50, and administrator terminal 60 are each connected to each other via a network such as the Internet.

[0022] <Computer 10> Computer 10 is, for example, a management server of a system company. Computer 10 has a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 is, for example, a CPU, and by executing a program stored in the storage unit 12, it functions as a visitor registration information receiving means 110, an intermediary registration means 111, a means for displaying available viewing dates and times 112, a viewing reservation receiving means 113, a first authentication means 114, a first entry restriction release means 115, a warning notification means 116, a resident registration information receiving means 117, a usage suspension means 118, a resident registration information deletion means 119, an employee registration information deletion means 120, and a visitor registration information deletion means 121.

[0023] <Control systems applied to intermediaries> The intermediary registration means 111, triggered by the receipt of registration application information from the intermediary terminal 50, forms feature data of the intermediary's employee's face image and registers the intermediary's employee's identification information and information related to the face image. The information related to the intermediary's employee's face image includes at least one of the hash value, checksum, or binarized compressed data of the intermediary's employee's face image feature data. Here, the face image feature data is data of a face image that shows the features of a person's face, for example, a set of pixel values ​​of pixels corresponding to a face image. The intermediary's employee identification information means an identifier such as an ID that identifies the intermediary's employee. As shown in Figure 2, the intermediary registration means 111 also transmits the received registration application information to the administrator terminal 60 via the communication unit 13. The intermediary registration means 111 also transmits the approval information received from the administrator terminal 60 to the intermediary terminal 50 via the communication unit 13. The intermediary registration means 111 can also send the information related to the registered intermediary's employee's face image to the entry control device 30 via the communication unit 13.

[0024] As shown in Figure 3, the viewing availability date and time display means 112 receives viewing request information sent via the real estate agent terminal 50 from an employee of a real estate agent registered by the real estate agent registration means 111. The viewing request information refers to information about the viewing request date and time of a prospective viewer (viewer) that the prospective viewer has provided to the real estate agent, and which is entered into the system 1 by an employee of the real estate agent. Furthermore, triggered by the receipt of the viewing request information, the viewing availability date and time display means 112 sends a display signal to the real estate agent terminal 50 to display candidate viewing dates and times based on the viewing availability dates and times stored in the storage unit 12.

[0025] The viewing reservation acceptance means 113 receives viewing reservation information, which includes viewing date and time information and identification information of the real estate agent's employee, selected from the candidate dates and times of available viewings displayed on the real estate agent terminal 50, based on a display signal transmitted from the viewing availability date and time display means 112. The viewing reservation acceptance means 113 also stores the viewing date and time information in the received viewing reservation information in the storage unit 12. The viewing reservation is confirmed by storing the viewing reservation information in the storage unit 12. At this time, the candidate dates and times of available viewings are displayed in a calendar format, for example, as shown in Figure 5(A), and the viewing reservation can be confirmed by associating it with the real estate agent's employee name and property name, as shown in Figure 5(B).

[0026] Furthermore, as shown in Figure 3, the viewing reservation acceptance means 113 transmits the viewing reservation information to the administrator terminal 60 via the communication unit 13. At this time, the viewing reservation acceptance means 113 can also transmit the viewing reservation information to the entry restriction device 30 via the communication unit 13.

[0027] Furthermore, the viewing reservation acceptance means 113 transmits the reservation confirmation information for confirmed viewing reservations to the real estate agent terminal 50 via the communication unit 13. A pairing ID is assigned to the identification information and facial image information of the real estate agent's employees, as well as the viewing date and time information, in order to associate each piece of information.

[0028] The first authentication means 114 authenticates the intermediary's employees by comparing information regarding the facial images of the intermediary's employees captured by the imaging device 20 with information regarding the facial images of the intermediary's employees registered by the intermediary registration means 111.

[0029] The first authentication means 114 detects the contour lines of each facial part included in the captured facial image of the intermediary employee and the registered facial image of the intermediary employee, based on the pixel values ​​included in the information regarding the facial image of the intermediary employee captured by the imaging device 20 and the information regarding the facial image of the intermediary employee registered by the intermediary registration means 111. The first authentication means 114 compares the information regarding the facial image of the intermediary employee captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0030] The first authentication means 114 compares the facial image of the detected intermediary employee with the contour lines of the facial images of registered intermediary employees.

[0031] Furthermore, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity of the contour lines between the detected and captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee, as a result of the comparison.

[0032] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between closed curves in an image, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves are the same, the first authentication means 114 adds one point to the score for each. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114, in stages according to the score.

[0033] Furthermore, the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person if the calculated score is above a predetermined threshold. Also, the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, while leaving open the possibility that they are not the same person, if the calculated score falls below a predetermined threshold.

[0034] Furthermore, if the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0035] Furthermore, the first authentication means 114 determines whether the date and time on which the intermediary's employee was photographed by the imaging device 20 and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions. For example, the first authentication means 114 determines whether the date on which the intermediary's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113. Also, the first authentication means 114 determines whether the time on which the intermediary's employee was photographed by the imaging device 20 at the property matches or is included in the time period of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113.

[0036] If, at a property, the date on which the real estate agent's employee was photographed by the imaging device 20 matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, and the time on which the real estate agent's employee was photographed by the imaging device 20 matches or is included in the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113 (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed face image of the real estate agent's employee and the registered face image of the real estate agent's employee are the same person. If it is determined that the person represented in the photographed face image of the real estate agent's employee and the registered face image of the real estate agent's employee are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0037] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113, or is not included in the time period (date and time information mismatch), the first authentication means 114 either links the denial signal and the information regarding the date and time information mismatch, or does not link them, and does not output restriction release information to lift the restriction on entry to the predetermined area by the entry restriction device 30.

[0038] The first entry restriction release means 115 releases the entry restriction on the designated area by the entry restriction device 30 when the first authentication means 114 authenticates the intermediary's employee and the date and time the intermediary's employee was photographed by the imaging device 20 and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions.

[0039] Furthermore, as shown in Figure 4, the first entry restriction release means 115, after receiving entry restriction release information from the entry restriction device 30, transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0040] When the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0041] When the employee registration information deletion means 120 receives an instruction from the administrator terminal 60 or the intermediary terminal 50 to delete the registration information of an employee of a specific intermediary, it uses the receipt of the instruction to delete the registration information of an employee of a specific intermediary as a trigger to delete the information related to the facial image of the employee of that specific intermediary that was registered by the intermediary registration means 111.

[0042] <Control system applied to visitors> The visitor registration information receiving means 110 forms feature data of the visitor's face image and receives visitor registration information including information about the visitor's face image and the date and time of visit (visit date and time information). The information about the visitor's face image includes at least one of the hash value, checksum, or binarized compressed data of the visitor's face image feature data. Here, the face image feature data is face image data that shows the features of a person's face, for example, a set of pixel values ​​of pixels corresponding to the face image. The visitor's visit date and time information means the date and time of visit planned by a visitor who is scheduled to visit the property. Here, a visitor is a person who will visit the property, and means a third party person excluding tenants and employees of real estate agents. Examples of visitors include friends and relatives of tenants. A pairing ID is assigned to the visitor's face image information and visit date and time information in order to associate each piece of information.

[0043] The first authentication means 114 authenticates the visitor by comparing information about the visitor's face image captured by the imaging device 20 with information about the visitor's face image registered by the visitor registration information receiving means 110.

[0044] Furthermore, the first authentication means 114 detects the contour lines of each facial part included in the captured visitor's facial image and the registered visitor's facial image based on the pixel values ​​included in the information regarding the visitor's facial image captured by the imaging device 20 and the information regarding the visitor's facial image registered by the visitor registration information receiving means 110. The first authentication means 114 compares the information regarding the visitor's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0045] Furthermore, the first authentication means 114 compares the contour lines of the detected captured visitor's face image with those of the registered visitor's face image. Based on the comparison, the first authentication means 114 determines the identity of the person in both face images based on the degree of similarity of the contour lines of the detected captured visitor's face image and the registered visitor's face image that are being compared.

[0046] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between the closed curves in the images, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves are the same, the first authentication means 114 further adds 1 point to the score. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114 in stages according to the score. Furthermore, if the calculated score is above a preset threshold, the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are the same person. Furthermore, if the calculated score falls below a predetermined threshold, the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, while leaving open the possibility that they are not the same person.

[0047] Furthermore, if the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0048] Furthermore, the first authentication means 114 determines whether the date and time the visitor was photographed by the imaging device 20 and the visit date and time received by the visitor registration information receiving means 110 satisfy predetermined conditions. For example, the first authentication means 114 determines whether the date the visitor was photographed by the imaging device 20 at the property matches the visit date in the visit date and time information received by the visitor registration information receiving means 110. Also, the first authentication means 114 determines whether the time the visitor was photographed by the imaging device 20 at the property matches or is included in the time period of the visit in the visit date and time information received by the visitor registration information receiving means 110.

[0049] If, at a property, the date on which a visitor was photographed by the imaging device 20 matches the visit date in the visit date and time information received by the visitor registration information receiving means 110, and the time on which the visitor was photographed by the imaging device 20 matches or is included in the time period of the visit in the visit date and time information received by the visitor registration information receiving means 110 (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed visitor's face image and the registered visitor's face image are the same person. If it is determined that the person represented in the photographed visitor's face image and the registered visitor's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0050] On the other hand, if the first authentication means 114 determines that the date on which a visitor was photographed by the imaging device 20 at the property does not match the visit date in the visit date and time information received by the visitor registration information receiving means 110, or that the time on which the visitor was photographed by the imaging device 20 does not match the visit time in the visit date and time information received by the visitor registration information receiving means 110, or that it is not included in the time period (a mismatch in date and time information), the first authentication means 114 processes the output of restriction release information to lift the restriction on entry into a predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them.

[0051] Furthermore, the first entry restriction release means 115 releases the entry restriction to a predetermined area imposed by the entry restriction device 30 when the visitor has been authenticated by the first authentication means 114 and the date and time the visitor was photographed by the imaging device 20 and the date and time of visit in the registration information received by the visitor registration information receiving means 110 meet predetermined conditions. Also, as shown in Figure 4, after the first entry restriction release means 115 receives entry restriction release information from the entry restriction device 30, it transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0052] When the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0053] The warning notification means 116 determines whether the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor has exceeded a predetermined number within a predetermined period. If the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor has exceeded a predetermined number within a predetermined period, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, intermediary terminal 50, and administrator terminal 60) that has been set in advance. The warning notification includes, for example, an alert sound and an alert display.

[0054] When the visitor registration information deletion means 121 receives an instruction from the resident terminal 40, administrator terminal 60, or intermediary terminal 50 to delete the registration information of a specific visitor, it uses the receipt of the instruction to delete the registration information of a specific visitor as a trigger to delete the information related to the facial image of the specific visitor that was registered by the visitor registration information receiving means 110.

[0055] <Control system applied to residents> The resident registration information receiving means 117 forms feature data of the resident's face image and registers the resident's identification information and information related to the face image. The information related to the resident's face image includes at least one of the hash value, checksum, or binarized compressed data of the resident's face image feature data. Here, the face image feature data is face image data that shows the features of a person's face, for example, a set of pixel values ​​of pixels corresponding to the face image. The resident identification information refers to an identifier such as an ID that identifies a resident residing in the property. A pairing ID is assigned to the resident identification information and the information related to the face image in order to associate each piece of information. The resident registration information receiving means 117 also receives visitor registration information, including information regarding the date and time the resident will move out of the property (move-out date and time information). Note that resident includes those who have moved out.

[0056] The first authentication means 114 authenticates the resident by comparing information regarding the resident's facial image captured by the imaging device 20 with information regarding the resident's facial image registered by the resident registration information receiving means 117.

[0057] Furthermore, the first authentication means 114 detects the contour lines of each facial part included in the captured facial image of the resident and the registered facial image of the resident, based on the pixel values ​​included in the information regarding the resident's facial image captured by the imaging device 20 and the information regarding the resident's facial image registered by the resident registration information receiving means 117. The first authentication means 114 compares the information regarding the resident's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0058] Furthermore, the first authentication means 114 compares the contour lines of the detected captured resident's face image with those of the registered resident's face image. Based on the comparison, the first authentication means 114 determines the identity of the person in both face images based on the degree of similarity of the contour lines of the detected captured resident's face image and the registered resident's face image that are being compared.

[0059] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between closed curves in an image, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves are the same, the first authentication means 114 adds one point to the score for each. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114, in stages according to the score. Furthermore, the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image is the same person if the calculated score is above a predetermined threshold. Also, the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image is not the same person, while leaving open the possibility that they are not the same person, if the calculated score falls below a predetermined threshold.

[0060] Furthermore, if the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0061] Furthermore, the first authentication means 114 determines whether the date and time the resident was photographed by the imaging device 20 and the move-out date and time received by the resident registration information receiving means 117 meet predetermined conditions. For example, the first authentication means 114 determines whether the date the resident was photographed by the imaging device 20 at the property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117. Also, the first authentication means 114 determines whether the time the resident was photographed by the imaging device 20 at the property matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117.

[0062] If, in a property, the date on which the tenant was photographed by the imaging device 20 matches the move-out date in the move-out date and time information received by the tenant registration information receiving means 117, and the time on which the tenant was photographed by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the tenant registration information receiving means 117, and it is determined that the move-out date and time has not yet passed (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed tenant's face image and the registered tenant's face image are the same person. If it is determined that the person represented in the photographed tenant's face image and the registered tenant's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0063] Furthermore, if the first authentication means 114 determines that, in a property, the date on which the resident was photographed by the imaging device 20 does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time on which the resident was photographed by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or that it is not included in the time period (the time period defined as including the move-out time has passed) (a mismatch in date and time information), the first authentication means 114 will not output restriction release information to lift the restriction on entry into a predetermined area by the entry restriction device 30. Alternatively, the first authentication means 114 determines whether the person represented in the captured resident's face image and the registered resident's face image are the same person. If it determines that the person represented in the captured resident's face image and the registered resident's face image are not the same person, the first authentication means 114 either links the denial signal and information regarding the mismatch in date and time information, or does not link them, and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30.

[0064] Furthermore, if the first authentication means 114 determines that, in a property, the date on which the resident was photographed by the imaging device 20 does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has not yet been reached), or that the time on which the resident was photographed by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has not yet been reached), or that it is not included in the time period (the time period defined as including the move-out time has not been reached) (a mismatch in date and time information), the first authentication means 114 will either link the denial signal and the information regarding the mismatch in date and time information, or, without linking them, will not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30.

[0065] On the other hand, if it is determined that the person represented in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links the information regarding the mismatch between the permission signal and the date and time information, and outputs restriction release information to lift the restriction on entry into the predetermined area by the entry restriction device 30.

[0066] The first entry restriction release means 115 releases the entry restriction to a predetermined area imposed by the entry restriction device 30 when the resident has been authenticated by the first authentication means 114. Furthermore, as shown in Figure 4, after receiving entry restriction release information from the entry restriction device 30, the first entry restriction release means 115 transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0067] Furthermore, when the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0068] When the deactivation means 118 receives information regarding the deactivation of a specific resident's use from the administrator terminal 60, it does not perform resident authentication by the first authentication means 114 even if it receives information regarding the resident's facial image captured by the imaging device 20.

[0069] When the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident, it is triggered by the receipt of the instruction to delete the registration information of a specific resident and deletes the information related to the resident's face image that was registered by the resident registration information receiving means 117.

[0070] The program executed by the control unit 11 is not limited to those stored in the storage unit 12. The program executed by the control unit 11 may be one that is transmitted to the control unit 11 from an external device via the communication unit 13, one that is stored on a storage medium such as a USB memory attached to the computer 10, or one that is stored on a server other than the computer 10 (for example, a cloud server).

[0071] The storage unit 12 consists of an HDD (Hard Disk Drive), RAM (Random Access Memory), ROM (Read Only Memory), or SSD (Solid State Drive), etc. The storage unit 12 stores various programs, including programs executed by the control unit 11. The storage unit 12 also stores information regarding the facial images and visit dates and times of registered visitors, information regarding the facial images and identification information of registered residents, and information regarding the identification information and facial images of registered real estate agent employees.

[0072] The communication unit 13 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit 13 consists of a communication interface configured to communicate with other devices via a communication network such as an internet line.

[0073] <Resident terminal 40> The resident terminal 40 is a smartphone, portable tablet computer, etc., owned by the resident of the property. The resident terminal 40 has a control unit, display unit, operation unit, imaging unit, storage unit, and communication unit (not shown), and these components are electrically connected.

[0074] The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

[0075] The display unit is, for example, a display and is used to show inputs, outputs, etc. A well-known liquid crystal display can be used for the display. The operation unit is a keyboard or operation keys and is used for the inputs described above. Alternatively, a touch panel display that serves as both the display and operation unit can be used. In the following, as an example, input via the operation unit will be performed using touch input. The imaging unit is a camera capable of capturing images of residents' faces, identification documents, belongings, etc.

[0076] The memory unit consists of, for example, an auxiliary storage device such as an HDD or SSD, and stores various data and programs for driving the resident terminal 40. The programs are for performing various processes, which will be described later. The control unit is configured to perform various processes by interpreting and executing these programs.

[0077] The communication unit includes, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit consists of a communication interface configured to communicate with other devices via a communication network such as an internet connection.

[0078] The specific hardware configuration of the resident terminal 40 can be appropriately modified by omitting, substituting, and adding components depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. Furthermore, the resident terminal 40 may be a dedicated terminal for this system, or it can be used by installing the above-mentioned program on a general-purpose smartphone or the like.

[0079] The following processes are performed in the resident terminal 40. Specifically, the control unit of the resident terminal 40 loads the program stored in the memory unit into RAM, and then the CPU interprets and executes that program.

[0080] <Intermediary Terminal 50> The brokerage agent terminal 50 is a personal computer installed in the office of a real estate agent that handles property brokerage. Employees of the real estate agent who operate the brokerage agent terminal 50 can send and receive information with the tenant terminal 40 and the administrator terminal 60. The brokerage agent terminal 50 can download applications that utilize System 1 via the brokerage agent terminal 50. The brokerage agent terminal 50 also transmits various registration-related information (registration application information) in this embodiment to the computer 10 and receives various information from the computer 10. Furthermore, the brokerage agent terminal 50 transmits viewing reservation information to the computer 10.

[0081] <Administrator terminal 60> The administrator terminal 60 is a smartphone, portable tablet computer, personal computer, etc., installed in the office or other location of the administrator who manages the property in this embodiment. The administrator terminal 60 has a control unit, display unit, operation unit, imaging unit, storage unit, and communication unit (not shown), and these components are electrically connected. The administrator terminal 60 also receives registration application information transmitted from the intermediary registration means 111. The administrator terminal 60 allows the user to decide whether or not to apply for registration based on the received registration application information, and if the registration application is approved, approval information can be transmitted to the computer 10 as shown in Figure 2. The administrator terminal 60 also allows the user to output information (information regarding suspension of use) specifying that the use of a specific tenant in the property has been suspended or prohibited. The administrator terminal 60 also allows the user to output information (instruction information for deletion of registration information) instructing the system 1 to delete the registration information of a specific tenant in the property.

[0082] The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

[0083] The display unit is, for example, a display and is used to show inputs, outputs, etc. A well-known liquid crystal display can be used for the display. The operation unit is a keyboard or operation keys and is used for the inputs described above. Alternatively, a touch panel display that serves as both the display and operation unit can be used. In the following, as an example, input via the operation unit will be performed using touch input. The imaging unit is a camera capable of capturing images of residents' faces, identification documents, etc.

[0084] The memory unit consists of, for example, an auxiliary storage device such as an HDD or SSD, and stores various data and programs for driving the resident terminal 40. The programs are for performing various processes, which will be described later. The control unit is configured to perform various processes by interpreting and executing these programs.

[0085] The communication unit includes, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit consists of a communication interface configured to communicate with other devices via a communication network such as an internet connection.

[0086] The specific hardware configuration of the administrator terminal 60 can be appropriately modified by omitting, substituting, and adding components depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. Furthermore, the administrator terminal 60 may be a dedicated terminal for this system, or it can be used by installing the above-mentioned program on a general-purpose smartphone or the like.

[0087] The administrator terminal 60 performs the following process: The control unit of the administrator terminal 60 loads the program stored in the memory unit into RAM, and then the CPU interprets and executes the program.

[0088] <Entry restriction device 30 and imaging device 20> The access control device 30 and the imaging device 20 are installed near the entrance of the property. The access control device 30 selectively restricts movement from outside the property to common areas and private areas. For example, if there is a door at the entrance to a common area, the access control device 30 includes a locking device that locks and unlocks this door. Specifically, by using the locking device to lock the door that is normally installed at the entrance to the common area, it restricts third parties from entering the common areas or private areas from outside the property. On the other hand, if the imaging device 20 authenticates that the person whose face image has been captured is a pre-registered employee of the real estate agent, a visitor, or a resident, as shown in Figure 4, the access control device 30 (specifically, the locking device) unlocks the door, allowing the real estate agent's employee, visitor, or resident to enter the common areas or private areas from outside the property. The period during which the door is unlocked is predetermined, and after this period has elapsed, the locking device automatically locks the door again. Furthermore, after releasing the entry restriction, the entry restriction release information is transmitted to the computer 10, as shown in Figure 4.

[0089] Furthermore, if a sliding automatic door is installed at the entrance to the common area of ​​the property, the entry restriction device 30 includes a sliding device that slides this automatic door. Specifically, under normal circumstances, the sliding device maintains the automatic door in the closed position so that it blocks the entrance to the common area, thereby restricting third parties from entering the common area from outside the property. On the other hand, if the imaging device 20 authenticates that the person whose face image has been captured is a pre-registered employee of the real estate agent, a visitor, or a resident based on information about the face image transmitted from the imaging device 20, the entry restriction device 30 (specifically, the sliding device) slides the automatic door to the open position, so that the entrance to the common area is no longer blocked by the automatic door, allowing real estate agent employees, visitors, or resident users to enter the common area or private space from outside the property. The period during which the automatic door remains in the open position is predetermined, and after this period has elapsed, the sliding device moves the automatic door back from the open position to the closed position.

[0090] The entry restriction device 30 includes a control unit 31, a storage unit 32, and a communication unit 33. The control unit 31 is, for example, a CPU, and functions as a second authentication means 310 and a second entry restriction release means 311 by executing a program stored in the storage unit 32. The second authentication means 310 authenticates whether the person captured by the imaging device 20 is a pre-registered employee, visitor, or resident of the intermediary, by comparing information on the facial images of intermediary employees, visitors, and residents stored in the storage unit 32 with information on the facial images transmitted from the imaging device 20. The second entry restriction release means 311 releases the restriction on entry into a predetermined area for the authenticated intermediary employees, visitors, and residents. The first authentication means 114 and the second authentication means 310, as well as the first entry restriction release means 115 and the second entry restriction release means 311, are each selectively controlled. In other words, when the first authentication means 114 is applied to system 1, the second authentication means 310 is not applied, the operation of the second authentication means 310 is stopped, or the second authentication means 310 is not set. Also, when the first entry restriction release means 115 is applied to system 1, the second entry restriction release means 311 is not applied, the operation of the second entry restriction release means 311 is stopped, or the second entry restriction release means 311 is not set.

[0091] The program executed by the control unit 31 is not limited to those stored in the storage unit 32. The program executed by the control unit 31 may be one transmitted to the control unit 31 from an external device via the communication unit 33, one stored on a storage medium such as a USB memory attached to the access control device 30, or one stored on a server other than the access control device 30 (for example, a cloud server).

[0092] The storage unit 32 consists of an HDD (Hard Disk Drive), RAM (Random Access Memory), ROM (Read Only Memory), or SSD (Solid State Drive), etc. The storage unit stores various programs, including programs executed by the control unit. The storage unit also stores information regarding the facial images of registered real estate agents' employees and visitors, as well as information regarding the facial images of registered tenants.

[0093] The imaging device 20 includes a control unit 21, an imaging unit 22, and a communication unit 23. The imaging unit 22 and the communication unit 23 are connected to the control unit 21, for example, by a bus. The control unit 21 is a CPU, etc., and is configured to control the imaging unit 22 and the communication unit 23. The imaging unit 22 is a camera, etc., capable of capturing facial images of the intermediary's employees, visitors, and tenants. The communication unit 23 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. That is, the communication unit 23 is composed of a communication interface configured to communicate with other devices via a communication network such as an internet line. Note that the imaging device 20 may not be connected to the computer 10 via a network such as an internet line, and the imaging device 20 may be connected only to the entry restriction device 30 via wired or wireless communication.

[0094] Next, we will explain the flow of each process in System 1.

[0095] (Example 1: Processing flow by a real estate agent's employee during property viewing) As shown in Figure 6, first, the intermediary registration means 111 is used to register in advance the identification information and facial image information of the intermediary's employees (step S10).

[0096] Next, those wishing to view the property make a viewing appointment through a real estate agent. Through the operation of an employee of the real estate agent, the viewing appointment acceptance means 113 receives viewing appointment information, which includes the identification information of the employee of the real estate agent and viewing date and time information regarding the date and time the viewing will take place (step S20).

[0097] Next, the first authentication means 114 determines whether the date on which the real estate agent's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, and whether the time on which the real estate agent's employee was photographed by the imaging device 20 matches or is included in the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113 (match or mismatch of date and time information) (step S30).

[0098] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113, or is not included in the time period (date and time information mismatch), the first authentication means 114 performs a process of not outputting restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the date and time information mismatch, or without linking them (step S40).

[0099] If it is determined that the date and time information matches, the first authentication means 114 authenticates the intermediary's employee by comparing the information regarding the facial image of the intermediary's employee captured by the imaging device 20 with the information regarding the facial image of the intermediary's employee registered by the intermediary registration means 111 (determining whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person) (step S50).

[0100] If the date and time information is determined to match, the first authentication means 114 determines whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. If it is determined that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person, the first authentication means 114 links the permission signal and the information regarding the matching of the date and time information and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S60).

[0101] On the other hand, if it is determined that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S70).

[0102] Next, when the first entry restriction release means 115 receives the entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the designated area, in order to release the restriction on entry into the designated area imposed by the entry restriction device 30. In this way, the entry restriction process for property viewings by the real estate agent's employees proceeds.

[0103] (Example 2: Processing flow for handling visitors based on authentication status) As shown in Figure 7, first, the visitor registration information receiving means 110 registers visitor registration information in advance, including information about the visitor's facial image and the date and time of visit (visit date and time information) (step S80).

[0104] Here, the warning notification means 116 determines whether the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has exceeded a predetermined number (step S90). If the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, intermediary terminal 50, and administrator terminal 60) that has been set in advance (step S100). If the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0105] Next, the first authentication means 114 determines whether the date and time when the visitor was photographed by the imaging device 20 and the date and time of the visit received by the visitor registration information receiving means 110 meet predetermined conditions (step S110).

[0106] Here, if the first authentication means 114 determines that the date on which a visitor was photographed by the imaging device 20 at the property does not match the visit date in the visit date and time information received by the visitor registration information receiving means 110, or that the time on which a visitor was photographed by the imaging device 20 does not match the visit time in the visit date and time information received by the visitor registration information receiving means 110, or is not included in the time period (a mismatch in date and time information; if the predetermined conditions are not met), the first authentication means 114 performs a process of not outputting restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them (step S120).

[0107] Here, the warning notification means 116 determines whether the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number (step S130). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary terminal 50, and the administrator terminal 60) that has been set in advance (step S140). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0108] If, at the property, the date on which the visitor was photographed by the imaging device 20 matches the visit date in the visit date and time information received by the visitor registration information receiving means 110, and the time on which the visitor was photographed by the imaging device 20 matches or is included in the visit time in the visit date and time information received by the visitor registration information receiving means 110 (matching date and time information; when predetermined conditions are met), the first authentication means 114 authenticates the visitor by comparing the information regarding the visitor's face image photographed by the imaging device 20 with the information regarding the visitor's face image registered by the visitor registration information receiving means 110 (determining whether the person represented in the photographed visitor's face image and the registered visitor's face image are the same person) (step S150).

[0109] If it is determined that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S160).

[0110] Here, the warning notification means 116 determines whether the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number (step S170). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary terminal 50, and the administrator terminal 60) that has been set in advance (step S180). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0111] Then, if it is determined that the person represented in the captured visitor's face image and the registered visitor's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the matching of date and time information and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S190).

[0112] Here, if the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period does not reach a predetermined number or more, the warning notification means 116 repeats the process until the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period reaches a predetermined number or more.

[0113] (Example 3: Processing flow for suspending and deleting registration information of tenants who have moved out) As shown in Figure 8, first, the resident registration information receiving means 117 registers the resident's identification information and facial image information in advance. In addition, the resident registration information receiving means 117 also registers visitor registration information, including information regarding the date and time the resident will move out of the property (move-out date and time information) in advance (step S200).

[0114] Next, the first authentication means 114 determines whether the date and time when the resident was imaged by the imaging device 20 and the date and time of departure received by the resident registration information receiving means 117 meet predetermined conditions (step S210).

[0115] Here, if the first authentication means 114 determines that the date on which the resident was imaged by the imaging device 20 at the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or if the time on which the resident was imaged by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period defined as including the move-out time has passed) (a mismatch in date and time information; if the predetermined conditions are not met), the first authentication means 114 does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them (step S220).

[0116] Next, the first authentication means 114 authenticates the resident by comparing information regarding the resident's face image captured by the imaging device 20 with information regarding the resident's face image registered by the resident registration information receiving means 117 (determining whether the person represented in the captured resident's face image and the registered resident's face image are the same person) (step S230).

[0117] Here, if it is determined that the date on which the tenant was photographed by the imaging device 20 at the property matches the move-out date in the move-out date and time information received by the tenant registration information receiving means 117, and that the time on which the tenant was photographed by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the tenant registration information receiving means 117 (matching date and time information; if the predetermined conditions are met (if the move-out date and time has not elapsed)), the first authentication means 114 determines whether the person represented in the photographed tenant's face image and the registered tenant's face image are the same person. If it is determined that the person represented in the photographed tenant's face image and the registered tenant's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the matching date and time information, and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S240).

[0118] On the other hand, if it is determined that the person represented in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S250).

[0119] If the entry restriction device 30 does not output information to lift the restriction on entry into a designated area, the usage suspension means 118, upon receiving information from the administrator terminal 60 regarding the suspension of use for a specific resident (step S260), will not perform resident authentication by the first authentication means 114, even if it receives information regarding the resident's facial image captured by the imaging device 20 (step S270).

[0120] Furthermore, when the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident (step S280), it uses the receipt of the instruction to delete the registration information of a specific resident as a trigger to delete the information related to the resident's face image that was registered by the resident registration information receiving means 117 (step S290).

[0121] According to the system 1, program, and information processing method of this embodiment, which has the above configuration, the system 1 comprises an entry restriction device 30 that selectively restricts entry into a predetermined area, an imaging device 20 that captures facial images of users whose entry into the predetermined area should be restricted by the entry restriction device 30, and a computer 10. The system 1 functions as an intermediary registration means 111, a viewing reservation acceptance means 113, an authentication means (first authentication means 114), and an entry restriction release means (first entry restriction release means 115) by executing a program. The intermediary registration means 111 registers information regarding the identification information and facial images of the intermediary's employees. The viewing reservation acceptance means 113 registers information regarding the intermediary's employees. The system receives viewing reservation information, which includes employee identification information and viewing date and time information. The authentication means (first authentication means 114) authenticates the real estate agent's employee by comparing information regarding the facial image of the real estate agent's employee captured by the imaging device 20 with information regarding the facial image of the real estate agent's employee registered by the real estate agent registration means 111. The entry restriction release means (first entry restriction release means 115) releases the entry restriction to a predetermined area by the entry restriction device 30 if the authentication means (first authentication means 114) authenticates the real estate agent's employee and the date and time the real estate agent's employee was captured by the imaging device 20 and the viewing date and time in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions. Conventionally, when visiting facilities such as apartment complexes for viewings, facial recognition technology was known that could perform facial recognition using an authentication engine. However, conventional technology did not give instructions to the entry restriction device based on the authentication of the real estate agent's employee. According to the system 1, program, and information processing method of this embodiment, by comparing the facial images of the intermediary's employees registered in the system 1 with facial images taken on-site and matching them with date and time information, it is possible to lift restrictions on entry into a predetermined area based on the facial images of the intermediary's employees and the property viewing reservation information.

[0122] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the intermediary registration means 111 may form facial image feature data. In this case, the system 1 can use facial image data that shows the features of a person's face.

[0123] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the feature data of the face image may be a set of pixel values ​​of pixels corresponding to the face image. In this case, the pixel values, which are the smallest elements constituting the image, can be used, and it becomes easy to apply processing to the information held by the pixels, thus enabling easy image processing.

[0124] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the intermediary registration means 111 may form one of the following: a hash value, a checksum, or binarized compressed data of the facial image feature data. In this case, it becomes possible to apply further processing to the image.

[0125] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may detect contour lines for each facial part contained in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee based on the pixel values ​​contained in the information regarding the facial image of the intermediary's employee captured by the imaging device 20 and the information regarding the facial image of the intermediary's employee registered by the intermediary registration means 111. In this case, a comparison of facial images can be performed based on multiple facial parts represented in the facial image, enabling a detailed comparison.

[0126] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may compare the contour lines of the detected captured facial image of the intermediary's employee with those of the registered facial image of the intermediary's employee, and determine whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person based on the degree of similarity of the contour lines being compared. In this case, even if there are some changes in the face of the person being compared, authentication can be performed while maintaining a certain level of accuracy.

[0127] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may grant permission as authentication if it determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. In this case, the restriction can be lifted based on the degree of similarity.

[0128] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may deny authentication if it determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person. In this case, processing can be performed to maintain the regulation based on the degree of similarity.

[0129] Furthermore, the system 1 according to this embodiment is not limited to the above-described configuration, and various modifications can be made.

[0130] For example, in this embodiment, even when the date and time information does not match, it was determined whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. However, in this case, it is not necessary to perform such a determination. [Explanation of Symbols]

[0131] 1: System 10: Computer 11: Control Unit 12: Storage section 13: Communications Department 20: Imaging device 21: Control Unit 22: Imaging Department 23: Communications Department 30: Entry control device 31: Control Unit 32: Storage section 33: Communications Department 40: Resident terminal 50: Intermediary terminal 60: Administrator terminal 110: Visitor registration information reception method 111: Method of registering as an intermediary 112: Means of indicating available viewing dates and times 113: How to make a viewing appointment 114: First Authentication Method 115: First method for lifting entry restrictions 116: Warning notification means 117: Method for receiving resident registration information 118:Means for suspending use 119: Means for deleting resident registration information 120: Method for deleting employee registration information 121: Method for deleting visitor registration information 310: Second authentication method 311: Second method for lifting entry restrictions

Claims

1. An entry restriction device that selectively restricts entry into a designated area, An imaging device that captures the facial image of a user whose entry restrictions into a designated area by the aforementioned entry restriction device should be lifted, Computers and, A system equipped with, The aforementioned system functions as a means for registering intermediaries, a means for accepting viewing reservations, an authentication means, and a means for lifting entry restrictions by executing a program. The aforementioned intermediary registration means registers information regarding the identification information and facial images of the intermediary's employees. The aforementioned viewing reservation acceptance means accepts viewing reservation information including the identification information of the real estate agent's employee and viewing date and time information regarding the date and time the viewing will take place. The authentication means authenticates the intermediary's employees by comparing information regarding the facial images of the intermediary's employees captured by the imaging device with information regarding the facial images of the intermediary's employees registered by the intermediary registration means. The entry restriction release means is a system that releases the entry restriction on a predetermined area by the entry restriction device when the authentication means authenticates an employee of the intermediary and the date and time the intermediary employee was photographed by the imaging device and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means meet predetermined conditions.

2. The intermediary registration means forms the feature data of the facial image. The system according to claim 1.

3. The feature data of the face image is a set of pixel values ​​of pixels corresponding to the face image. The system according to claim 2.

4. The intermediary registration means forms one of the hash value, checksum, or binarized compressed data of the facial image feature data. The system according to claim 1.

5. The authentication means detects the contour lines of each facial part contained in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee based on the pixel values ​​contained in the information regarding the facial image of the intermediary's employee captured by the imaging device and the information regarding the facial image of the intermediary's employee registered by the intermediary registration means. The system according to claim 1.

6. The authentication means compares the contour lines of the detected captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee, and determines whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person based on the degree of similarity of the contour lines being compared. The system according to claim 5.

7. The authentication means grants permission as authentication if it determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. The system according to claim 6.

8. If the authentication means determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, it denies the authentication. The system according to claim 6.

9. An entry restriction device that selectively restricts entry into a designated area, An imaging device that captures the facial image of a user whose entry restrictions into a designated area by the aforementioned entry restriction device should be lifted, Computers and, A program that, when executed by the control unit of a system equipped with the above, causes the intermediary registration means, the viewing reservation acceptance means, the authentication means, and the entry restriction release means to function as follows: The aforementioned intermediary registration means registers information regarding the identification information and facial images of the intermediary's employees. The aforementioned viewing reservation acceptance means accepts viewing reservation information including the identification information of the real estate agent's employee and viewing date and time information regarding the date and time the viewing will take place. The authentication means authenticates the intermediary's employees by comparing information regarding the facial images of the intermediary's employees captured by the imaging device with information regarding the facial images of the intermediary's employees registered by the intermediary registration means. The entry restriction release means is a program that releases the entry restriction on a predetermined area by the entry restriction device when the authentication means authenticates an employee of the intermediary and the date and time the intermediary employee was photographed by the imaging device and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means meet predetermined conditions.

10. An entry restriction device that selectively restricts entry into a designated area, An imaging device that captures the facial image of a user whose entry restrictions into a designated area by the aforementioned entry restriction device should be lifted, Computers and, An information processing method performed by a control unit of a system equipped with, The intermediary's employees' identification information and facial image information will be registered. We accept viewing reservation information, which includes the identification information of the real estate agent's employees and viewing date and time information. The intermediary's employees are authenticated by comparing the facial image information of the intermediary's employees captured by the aforementioned imaging device with the registered facial image information of the intermediary's employees. An information processing method that, when an employee of the intermediary is authenticated and the date and time on which the intermediary's employee was photographed by the imaging device and the date and time of the viewing in the viewing reservation information meet predetermined conditions, lifts the restriction on entry to a predetermined area by the entry restriction device.

Images