Facial recognition system

Abstract

The present invention provides a facial recognition system, method, and program that lifts restrictions on entry to a designated area based on the facial image of a prospective viewer and information regarding the property viewing appointment. [Solution] The facial recognition system 1 comprises a camera installed near the entrance of a real estate property, a storage unit 12 that holds facial data which is processed data of the user's facial image, an authentication means 114 that compares the face captured by the camera with the facial data in the storage unit, a means 112 that displays the date and time when the real estate property can be viewed, a viewing reservation acceptance means 113 that allows the user to select a viewing date and time from the dates and times shown on the viewing reservation acceptance means and register it as a reservation, and an unlocking instruction means that sends an unlocking instruction to the locking device of the entrance door when the authentication means has successfully authenticated the user's face and a viewing of the real estate property by the user is reserved for that date and time.

Description

Technical Field

[0001] This disclosure relates to a system, a program, and an information processing method.

Background Art

[0002] When leasing or purchasing an existing real estate property, generally, the surrounding environment of the property is inspected, and the interior of the property that will actually be lived in or used is actually visited and confirmed. At this time, the act of checking the interior before signing a lease or purchase contract for a real estate property is generally referred to as "viewing the interior."

[0003] Face recognition technology that can perform face recognition using an authentication engine is generally known (see, for example, Patent Document 1, etc.).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Here, in the conventional technology, instructions were not given to an access control device based on the authentication of a person who visited a real estate property for viewing the interior or the like.

[0006] This disclosure has been made in consideration of such points, and an object thereof is to provide a system, a program, and an information processing method capable of releasing the restriction on entry into a predetermined area based on a face image of a person who wishes to view the interior or the like and information on a reservation for viewing the interior of a property.

Means for Solving the Problems

[0007] The face recognition system of this disclosure is a photographing device installed near the entrance of a real estate property, and A storage unit that holds face data, which is processed data of the user's face image, Authentication means for comparing the face captured by the aforementioned imaging device with the face data in the storage unit, A means for displaying the dates and times when the property can be viewed, A viewing reservation acceptance means for the user to select a viewing date and time for the real estate property from the dates and times indicated by the viewing availability display means and register a reservation, The gist of the system is that it includes an unlocking instruction means which transmits an unlocking instruction to the locking device of the entrance door when the authentication means successfully recognizes the user's face and a viewing of the property by the user is scheduled for that date and time. [Effects of the Invention]

[0008] According to this disclosure, a facial recognition system can be provided that can selectively restrict the entry of a particular person into a designated area. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram showing the overall configuration of the system according to this embodiment. [Figure 2] This is an activity diagram showing the flow of information between elements during the registration of an intermediary in the system according to this embodiment. [Figure 3] This is an activity diagram showing the flow of information between elements when making a property viewing reservation in the system according to this embodiment. [Figure 4] This is an activity diagram showing the flow of information between elements during a property viewing in the system according to this embodiment. [Figure 5] (A) A diagram showing an example of a display format in the system according to this embodiment, which allows the user to select from a list of available viewing dates and times when making a viewing reservation, and (B) A diagram showing an example of the display that appears after selecting a viewing reservation date and time. [Figure 6]This flowchart shows the processing flow by the intermediary in the system according to this embodiment. [Figure 7] This is a flowchart showing the processing flow for dealing with visitors based on whether or not authentication is successful in the system according to this embodiment. [Figure 8] This flowchart shows the process for suspending use and deleting the registration information of tenants who have moved out in the system according to this embodiment. [Modes for carrying out the invention]

[0010] This embodiment will be explained below with reference to the drawings.

[0011] <System 1> As shown in Figure 1, in this embodiment, System 1 allows an employee of a property brokerage firm, who has previously registered information regarding facial images in a management server (computer 10), to lift the entry restriction imposed by the entry restriction device 30 to a predetermined area (specifically, a common space in an apartment building) based on the information regarding the facial image captured by the imaging device 20. The configuration of this System 1 will be explained using Figure 1.

[0012] As shown in Figure 1, System 1 comprises an access control device 30, an imaging device 20, a computer 10 (management server), a tenant terminal 40, a real estate agent terminal 50, and an administrator terminal 60. The computer 10 is connected to each of the access control device 30, imaging device 20, tenant terminal 40, real estate agent terminal 50, and administrator terminal 60 via a network such as the Internet. The access control device 30 and imaging device 20 are also connected to each other via wireless or wired connections. Furthermore, the access control device 30, imaging device 20, tenant terminal 40, real estate agent terminal 50, and administrator terminal 60 are each connected to each other via a network such as the Internet.

[0013] <Computer 10> The computer 10 is, for example, a management server of a system company or the like. The computer 10 has a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 is, for example, a CPU or the like, and by executing a program stored in the storage unit 12, it functions as a visitor registration information reception means 110, an agency registration means 111, an interior inspection available date and time presentation means 112, an interior inspection reservation reception means 113, a first authentication means 114, a first entry restriction release means 115, a warning notification means 116, an occupant registration information reception means 117, a use stop means 118, an occupant registration information deletion means 119, an employee registration information deletion means 120, and a visitor registration information deletion means 121.

[0014] <Control system applied to the agency> The agency registration means 111 forms feature amount data of the face images of the employees of the agency triggered by receiving registration application information from the agency terminal 50, and registers the identification information of the employees of the agency and information related to the face images. The information related to the face images of the employees of the agency includes at least any one of the hash value, checksum, and binary compressed data of the feature amount data of the face images of the employees of the agency. Here, the feature amount data of the face image is data of a face image indicating the features of a person's face, and is, for example, a set of pixel values of pixels corresponding to the face image. Also, the identification information of the employees of the agency means an identifier such as an ID for identifying the employees of the agency. Also, as shown in FIG. 2, the agency registration means 111 transmits the received registration application information to the administrator terminal 60 via the communication unit 13. Also, the agency registration means 111 transmits the approval information received from the administrator terminal 60 to the agency terminal 50 via the communication unit 13. Also, the agency registration means 111 can also send information related to the face images of the registered employees of the agency to the entry restriction device 30 via the communication unit 13.

[0015] As shown in FIG. 3, the interior viewing available time display means 112 receives interior viewing application information sent from an employee of a broker via the broker terminal 50. The interior viewing application information means information regarding the interior viewing desired date and time input by an employee of the broker into the system 1 based on one or more interior viewing desired dates and times presented by a person (interior viewing applicant) who wishes to view the property to the broker. Further, the interior viewing available time display means 112 transmits a display signal to the broker terminal 50 to display candidates for available interior viewing times on the broker terminal 50 based on the available interior viewing times stored in the storage unit 12 triggered by receiving the interior viewing application information.

[0016] Based on the display signal transmitted from the interior viewing available time display means 112, the interior viewing reservation reception means 113 receives interior viewing reservation information including interior viewing time information regarding the date and time when the interior viewing is to be conducted selected from the candidates for available interior viewing times displayed on the broker terminal 50 and identification information of an employee of the broker. Further, the interior viewing reservation reception means 113 stores the interior viewing time information in the received interior viewing reservation information in the storage unit 12. By storing the interior viewing reservation information in this storage unit 12, the interior viewing reservation is confirmed. At this time, the candidates for available interior viewing times are displayed in a calendar format as shown in, for example, FIG. 5(A), and the interior viewing reservation can be confirmed in association with the name of the employee of the broker and the name of the property as shown in FIG. 5(B).

[0017] Also, as shown in FIG. 3, the interior viewing reservation reception means 113 transmits the interior viewing reservation information to the administrator terminal 60 via the communication unit 13. At this time, the interior viewing reservation reception means 113 can also transmit the interior viewing reservation information to the access control device 30 via the communication unit 13.

[0018] Further, the interior viewing reservation reception means 113 transmits reservation confirmation information of the confirmed interior viewing reservation to the broker terminal 50 via the communication unit 13. A pairing ID is assigned to the identification information and face image information of the employee of the broker, as well as the interior viewing time information, in order to associate each piece of information.

[0019] The first authentication means 114 authenticates the intermediary's employees by comparing information regarding the facial images of the intermediary's employees captured by the imaging device 20 with information regarding the facial images of the intermediary's employees registered by the intermediary registration means 111.

[0020] The first authentication means 114 detects the contour lines of each facial part included in the captured facial image of the intermediary employee and the registered facial image of the intermediary employee, based on the pixel values ​​included in the information regarding the facial image of the intermediary employee captured by the imaging device 20 and the information regarding the facial image of the intermediary employee registered by the intermediary registration means 111. The first authentication means 114 compares the information regarding the facial image of the intermediary employee captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0021] The first authentication means 114 compares the facial image of the detected intermediary employee with the contour lines of the facial images of registered intermediary employees.

[0022] Furthermore, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity of the contour lines between the detected and captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee, as a result of the comparison.

[0023] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between closed curves in an image, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves are the same, the first authentication means 114 adds one point to the score for each. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114, in stages according to the score.

[0024] Furthermore, the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person if the calculated score is above a predetermined threshold. Also, the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, while leaving open the possibility that they are not the same person, if the calculated score falls below a predetermined threshold.

[0025] Furthermore, if the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0026] Furthermore, the first authentication means 114 determines whether the date and time on which the intermediary's employee was photographed by the imaging device 20 and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions. For example, the first authentication means 114 determines whether the date on which the intermediary's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113. Also, the first authentication means 114 determines whether the time on which the intermediary's employee was photographed by the imaging device 20 at the property matches or is included in the time period of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113.

[0027] If, at a property, the date on which the real estate agent's employee was photographed by the imaging device 20 matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, and the time on which the real estate agent's employee was photographed by the imaging device 20 matches or is included in the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113 (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed face image of the real estate agent's employee and the registered face image of the real estate agent's employee are the same person. If it is determined that the person represented in the photographed face image of the real estate agent's employee and the registered face image of the real estate agent's employee are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0028] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113, or is not included in the time period (date and time information mismatch), the first authentication means 114 either links the denial signal and the information regarding the date and time information mismatch, or does not link them, and does not output restriction release information to lift the restriction on entry to the predetermined area by the entry restriction device 30.

[0029] The first entry restriction release means 115 releases the entry restriction on the designated area by the entry restriction device 30 when the first authentication means 114 authenticates the intermediary's employee and the date and time the intermediary's employee was photographed by the imaging device 20 and the date and time of the viewing in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions.

[0030] Furthermore, as shown in Figure 4, the first entry restriction release means 115, after receiving entry restriction release information from the entry restriction device 30, transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0031] When the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0032] When the employee registration information deletion means 120 receives an instruction from the administrator terminal 60 or the intermediary terminal 50 to delete the registration information of an employee of a specific intermediary, it uses the receipt of the instruction to delete the registration information of an employee of a specific intermediary as a trigger to delete the information related to the facial image of the employee of that specific intermediary that was registered by the intermediary registration means 111.

[0033] <Control system applied to visitors> The visitor registration information receiving means 110 forms feature data of the visitor's face image and receives visitor registration information including information about the visitor's face image and the date and time of visit (visit date and time information). The information about the visitor's face image includes at least one of the hash value, checksum, or binarized compressed data of the visitor's face image feature data. Here, the face image feature data is face image data that shows the features of a person's face, for example, a set of pixel values ​​of pixels corresponding to the face image. The visitor's visit date and time information means the date and time of visit planned by a visitor who is scheduled to visit the property. Here, a visitor is a person who will visit the property, and means a third party person excluding tenants and employees of real estate agents. Examples of visitors include friends and relatives of tenants. A pairing ID is assigned to the visitor's face image information and visit date and time information in order to associate each piece of information.

[0034] The first authentication means 114 authenticates the visitor by comparing information about the visitor's face image captured by the imaging device 20 with information about the visitor's face image registered by the visitor registration information receiving means 110.

[0035] Furthermore, the first authentication means 114 detects the contour lines of each facial part included in the captured visitor's facial image and the registered visitor's facial image based on the pixel values ​​included in the information regarding the visitor's facial image captured by the imaging device 20 and the information regarding the visitor's facial image registered by the visitor registration information receiving means 110. The first authentication means 114 compares the information regarding the visitor's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0036] Furthermore, the first authentication means 114 compares the contour lines of the detected captured visitor's face image with those of the registered visitor's face image. Based on the comparison, the first authentication means 114 determines the identity of the person in both face images based on the degree of similarity of the contour lines of the detected captured visitor's face image and the registered visitor's face image that are being compared.

[0037] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between the closed curves in the images, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves match, the first authentication means 114 further adds 1 point to the score. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114 in stages according to the score. Furthermore, if the calculated score is above a preset threshold, the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are the same person. Furthermore, if the calculated score falls below a predetermined threshold, the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, while still leaving open the possibility that they are not the same person.

[0038] Furthermore, if the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0039] Furthermore, the first authentication means 114 determines whether the date and time the visitor was photographed by the imaging device 20 and the visit date and time received by the visitor registration information receiving means 110 satisfy predetermined conditions. For example, the first authentication means 114 determines whether the date the visitor was photographed by the imaging device 20 at the property matches the visit date in the visit date and time information received by the visitor registration information receiving means 110. Also, the first authentication means 114 determines whether the time the visitor was photographed by the imaging device 20 at the property matches or is included in the time period of the visit in the visit date and time information received by the visitor registration information receiving means 110.

[0040] If, at a property, the date on which a visitor was photographed by the imaging device 20 matches the visit date in the visit date and time information received by the visitor registration information receiving means 110, and the time on which the visitor was photographed by the imaging device 20 matches or is included in the time period of the visit in the visit date and time information received by the visitor registration information receiving means 110 (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed visitor's face image and the registered visitor's face image are the same person. If it is determined that the person represented in the photographed visitor's face image and the registered visitor's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0041] On the other hand, if the first authentication means 114 determines that the date on which a visitor was photographed by the imaging device 20 at the property does not match the visit date in the visit date and time information received by the visitor registration information receiving means 110, or that the time on which the visitor was photographed by the imaging device 20 does not match the visit time in the visit date and time information received by the visitor registration information receiving means 110, or that it is not included in the time period (a mismatch in date and time information), the first authentication means 114 processes the output of restriction release information to lift the restriction on entry into a predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them.

[0042] Furthermore, the first entry restriction release means 115 releases the entry restriction to a predetermined area imposed by the entry restriction device 30 when the visitor has been authenticated by the first authentication means 114 and the date and time the visitor was photographed by the imaging device 20 and the date and time of visit in the registration information received by the visitor registration information receiving means 110 meet predetermined conditions. Also, as shown in Figure 4, after the first entry restriction release means 115 receives entry restriction release information from the entry restriction device 30, it transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0043] When the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0044] The warning notification means 116 determines whether the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor has exceeded a predetermined number within a predetermined period. If the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor has exceeded a predetermined number within a predetermined period, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, intermediary terminal 50, and administrator terminal 60) that has been set in advance. The warning notification includes, for example, an alert sound and an alert display.

[0045] When the visitor registration information deletion means 121 receives an instruction from the resident terminal 40, administrator terminal 60, or intermediary terminal 50 to delete the registration information of a specific visitor, it uses the receipt of the instruction to delete the registration information of a specific visitor as a trigger to delete the information related to the facial image of the specific visitor that was registered by the visitor registration information receiving means 110.

[0046] <Control system applied to residents> The resident registration information receiving means 117 forms feature data of the resident's face image and registers the resident's identification information and information related to the face image. The information related to the resident's face image includes at least one of the hash value, checksum, or binarized compressed data of the resident's face image feature data. Here, the face image feature data is face image data that shows the features of a person's face, for example, a set of pixel values ​​of pixels corresponding to the face image. The resident identification information refers to an identifier such as an ID that identifies a resident residing in the property. A pairing ID is assigned to the resident identification information and the information related to the face image in order to associate each piece of information. The resident registration information receiving means 117 also receives visitor registration information, including information regarding the date and time the resident will move out of the property (move-out date and time information). Note that resident includes those who have moved out.

[0047] The first authentication means 114 authenticates the resident by comparing information regarding the resident's facial image captured by the imaging device 20 with information regarding the resident's facial image registered by the resident registration information receiving means 117.

[0048] Furthermore, the first authentication means 114 detects the contour lines of each facial part included in the captured facial image of the resident and the registered facial image of the resident, based on the pixel values ​​included in the information regarding the resident's facial image captured by the imaging device 20 and the information regarding the resident's facial image registered by the resident registration information receiving means 117. The first authentication means 114 compares the information regarding the resident's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial parts included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0049] Furthermore, the first authentication means 114 compares the contour lines of the detected captured resident's face image with those of the registered resident's face image. Based on the comparison, the first authentication means 114 determines the identity of the person in both face images based on the degree of similarity of the contour lines of the detected captured resident's face image and the registered resident's face image that are being compared.

[0050] Furthermore, the first authentication means 114 calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of adjacent closed curves, the number of enclosed closed curves, etc. For example, if a one-to-one correspondence is made between closed curves in an image, and there are no closed curves that cannot be matched, the first authentication means 114 assigns the number of closed curves as a score. Also, if the number of adjacent closed curves (adjacent lines) and the number of enclosed closed curves (nested parent) of the matched closed curves are the same, the first authentication means 114 adds one point to the score for each. This calculation is performed for all combinations of closed curves, and the highest score is taken as the final score between the images. The higher this score, the greater the degree of similarity between the two images is judged by the first authentication means 114, in stages according to the score. Furthermore, the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image is the same person if the calculated score is above a predetermined threshold. Also, the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image is not the same person, while leaving open the possibility that they are not the same person, if the calculated score falls below a predetermined threshold.

[0051] Furthermore, if the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person represented in the captured resident's face image and the registered resident's face image are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0052] Furthermore, the first authentication means 114 determines whether the date and time the resident was photographed by the imaging device 20 and the move-out date and time received by the resident registration information receiving means 117 meet predetermined conditions. For example, the first authentication means 114 determines whether the date the resident was photographed by the imaging device 20 at the property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117. Also, the first authentication means 114 determines whether the time the resident was photographed by the imaging device 20 at the property matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117.

[0053] If, in a property, the date on which the tenant was photographed by the imaging device 20 matches the move-out date in the move-out date and time information received by the tenant registration information receiving means 117, and the time on which the tenant was photographed by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the tenant registration information receiving means 117, and it is determined that the move-out date and time has not yet passed (match in date and time information), the first authentication means 114 determines whether the person represented in the photographed tenant's face image and the registered tenant's face image are the same person. If it is determined that the person represented in the photographed tenant's face image and the registered tenant's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the match in date and time information, and outputs restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30.

[0054] Furthermore, if the first authentication means 114 determines that, in a property, the date on which the resident was photographed by the imaging device 20 does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time on which the resident was photographed by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or that it is not included in the time period (the time period defined as including the move-out time has passed) (a mismatch in date and time information), the first authentication means 114 will not output restriction release information to lift the restriction on entry into a predetermined area by the entry restriction device 30. Alternatively, the first authentication means 114 determines whether the person represented in the captured resident's face image and the registered resident's face image are the same person. If it determines that the person represented in the captured resident's face image and the registered resident's face image are not the same person, the first authentication means 114 either links the denial signal and information regarding the mismatch in date and time information, or does not link them, and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30.

[0055] Furthermore, if the first authentication means 114 determines that, in a property, the date on which the resident was photographed by the imaging device 20 does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has not yet been reached), or that the time on which the resident was photographed by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has not yet been reached), or that it is not included in the time period (the time period defined as including the move-out time has not been reached) (a mismatch in date and time information), the first authentication means 114 will either link the denial signal and the information regarding the mismatch in date and time information, or, without linking them, will not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30.

[0056] On the other hand, if it is determined that the person represented in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links the information regarding the mismatch between the permission signal and the date and time information, and outputs restriction release information to lift the restriction on entry into the predetermined area by the entry restriction device 30.

[0057] The first entry restriction release means 115 releases the entry restriction to a predetermined area imposed by the entry restriction device 30 when the resident has been authenticated by the first authentication means 114. Furthermore, as shown in Figure 4, after receiving entry restriction release information from the entry restriction device 30, the first entry restriction release means 115 transmits the entry restriction release information to the administrator terminal 60 to notify the administrator that the entry restriction to the property has been lifted.

[0058] Furthermore, when the first entry restriction release means 115 receives entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the predetermined area, in order to release the restriction on entry into the predetermined area imposed by the entry restriction device 30.

[0059] When the deactivation means 118 receives information regarding the deactivation of a specific resident's use from the administrator terminal 60, it does not perform resident authentication by the first authentication means 114 even if it receives information regarding the resident's facial image captured by the imaging device 20.

[0060] When the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident, it is triggered by the receipt of the instruction to delete the registration information of a specific resident and deletes the information related to the resident's face image that was registered by the resident registration information receiving means 117.

[0061] The program executed by the control unit 11 is not limited to those stored in the storage unit 12. The program executed by the control unit 11 may be one that is transmitted to the control unit 11 from an external device via the communication unit 13, one that is stored on a storage medium such as a USB memory attached to the computer 10, or one that is stored on a server other than the computer 10 (for example, a cloud server).

[0062] The storage unit 12 consists of an HDD (Hard Disk Drive), RAM (Random Access Memory), ROM (Read Only Memory), or SSD (Solid State Drive), etc. The storage unit 12 stores various programs, including programs executed by the control unit 11. The storage unit 12 also stores information regarding the facial images and visit dates and times of registered visitors, information regarding the facial images and identification information of registered residents, and information regarding the identification information and facial images of registered real estate agent employees.

[0063] The communication unit 13 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit 13 consists of a communication interface configured to communicate with other devices via a communication network such as an internet line.

[0064] <Resident terminal 40> The resident terminal 40 is a smartphone, portable tablet computer, etc., owned by the resident of the property. The resident terminal 40 has a control unit, display unit, operation unit, imaging unit, storage unit, and communication unit (not shown), and these components are electrically connected.

[0065] The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

[0066] The display unit is, for example, a display and is used to show inputs, outputs, etc. A well-known liquid crystal display can be used for the display. The operation unit is a keyboard or operation keys and is used for the inputs described above. Alternatively, a touch panel display that serves as both the display and operation unit can be used. In the following, as an example, input via the operation unit will be performed using touch input. The imaging unit is a camera capable of capturing images of residents' faces, identification documents, belongings, etc.

[0067] The memory unit consists of, for example, an auxiliary storage device such as an HDD or SSD, and stores various data and programs for driving the resident terminal 40. The programs are for performing various processes, which will be described later. The control unit is configured to perform various processes by interpreting and executing these programs.

[0068] The communication unit includes, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit consists of a communication interface configured to communicate with other devices via a communication network such as an internet connection.

[0069] The specific hardware configuration of the resident terminal 40 can be appropriately modified by omitting, substituting, and adding components depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. Furthermore, the resident terminal 40 may be a dedicated terminal for this system, or it can be used by installing the above-mentioned program on a general-purpose smartphone or the like.

[0070] The following processes are performed in the resident terminal 40. Specifically, the control unit of the resident terminal 40 loads the program stored in the memory unit into RAM, and then the CPU interprets and executes that program.

[0071] <Intermediary Terminal 50> The brokerage agent terminal 50 is a personal computer installed in the office of a real estate agent that handles property brokerage. Employees of the real estate agent who operate the brokerage agent terminal 50 can send and receive information with the tenant terminal 40 and the administrator terminal 60. The brokerage agent terminal 50 can download applications that utilize System 1 via the brokerage agent terminal 50. The brokerage agent terminal 50 also transmits various registration-related information (registration application information) in this embodiment to the computer 10 and receives various information from the computer 10. Furthermore, the brokerage agent terminal 50 transmits viewing reservation information to the computer 10.

[0072] <Administrator terminal 60> The administrator terminal 60 is a smartphone, portable tablet computer, personal computer, etc., installed in the office or other location of the administrator who manages the property in this embodiment. The administrator terminal 60 has a control unit, display unit, operation unit, imaging unit, storage unit, and communication unit (not shown), and these components are electrically connected. The administrator terminal 60 also receives registration application information transmitted from the intermediary registration means 111. The administrator terminal 60 allows the user to decide whether or not to apply for registration based on the received registration application information, and if the registration application is approved, approval information can be transmitted to the computer 10 as shown in Figure 2. The administrator terminal 60 also allows the user to output information (information regarding suspension of use) specifying that the use of a specific tenant in the property has been suspended or prohibited. The administrator terminal 60 also allows the user to output information (instruction information for deletion of registration information) instructing the system 1 to delete the registration information of a specific tenant in the property.

[0073] The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

[0074] The display unit is, for example, a display and is used to show inputs, outputs, etc. A well-known liquid crystal display can be used for the display. The operation unit is a keyboard or operation keys and is used for the inputs described above. Alternatively, a touch panel display that serves as both the display and operation unit can be used. In the following, as an example, input via the operation unit will be performed using touch input. The imaging unit is a camera capable of capturing images of residents' faces, identification documents, etc.

[0075] The memory unit consists of, for example, an auxiliary storage device such as an HDD or SSD, and stores various data and programs for driving the resident terminal 40. The programs are for performing various processes, which will be described later. The control unit is configured to perform various processes by interpreting and executing these programs.

[0076] The communication unit includes, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit consists of a communication interface configured to communicate with other devices via a communication network such as an internet connection.

[0077] The specific hardware configuration of the administrator terminal 60 can be appropriately modified by omitting, substituting, and adding components depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. Furthermore, the administrator terminal 60 may be a dedicated terminal for this system, or it can be used by installing the above-mentioned program on a general-purpose smartphone or the like.

[0078] The administrator terminal 60 performs the following process: The control unit of the administrator terminal 60 loads the program stored in the memory unit into RAM, and then the CPU interprets and executes the program.

[0079] <Entry restriction device 30 and imaging device 20> The access control device 30 and the imaging device 20 are installed near the entrance of the property. The access control device 30 selectively restricts movement from outside the property to common areas and private areas. For example, if there is a door at the entrance to a common area, the access control device 30 includes a locking device that locks and unlocks this door. Specifically, by using the locking device to lock the door that is normally installed at the entrance to the common area, it restricts third parties from entering the common areas or private areas from outside the property. On the other hand, if the imaging device 20 authenticates that the person whose face image has been captured is a pre-registered employee of the real estate agent, a visitor, or a resident, as shown in Figure 4, the access control device 30 (specifically, the locking device) unlocks the door, allowing the real estate agent's employee, visitor, or resident to enter the common areas or private areas from outside the property. The period during which the door is unlocked is predetermined, and after this period has elapsed, the locking device automatically locks the door again. Furthermore, after releasing the entry restriction, the entry restriction release information is transmitted to the computer 10, as shown in Figure 4.

[0080] Furthermore, if a sliding automatic door is installed at the entrance to the common area of ​​the property, the entry restriction device 30 includes a sliding device that slides this automatic door. Specifically, under normal circumstances, the sliding device maintains the automatic door in the closed position so that it blocks the entrance to the common area, thereby restricting third parties from entering the common area from outside the property. On the other hand, if the imaging device 20 authenticates that the person whose face image has been captured is a pre-registered employee of the real estate agent, a visitor, or a resident based on information about the face image transmitted from the imaging device 20, the entry restriction device 30 (specifically, the sliding device) slides the automatic door to the open position, so that the entrance to the common area is no longer blocked by the automatic door, allowing real estate agent employees, visitors, or resident users to enter the common area or private space from outside the property. The period during which the automatic door remains in the open position is predetermined, and after this period has elapsed, the sliding device moves the automatic door back from the open position to the closed position.

[0081] The entry restriction device 30 includes a control unit 31, a storage unit 32, and a communication unit 33. The control unit 31 is, for example, a CPU, and functions as a second authentication means 310 and a second entry restriction release means 311 by executing a program stored in the storage unit 32. The second authentication means 310 authenticates whether the person captured by the imaging device 20 is a pre-registered employee, visitor, or resident of the intermediary, by comparing information on the facial images of intermediary employees, visitors, and residents stored in the storage unit 32 with information on the facial images transmitted from the imaging device 20. The second entry restriction release means 311 releases the restriction on entry into a predetermined area for the authenticated intermediary employees, visitors, and residents. The first authentication means 114 and the second authentication means 310, as well as the first entry restriction release means 115 and the second entry restriction release means 311, are each selectively controlled. In other words, when the first authentication means 114 is applied to system 1, the second authentication means 310 is not applied, the operation of the second authentication means 310 is stopped, or the second authentication means 310 is not set. Also, when the first entry restriction release means 115 is applied to system 1, the second entry restriction release means 311 is not applied, the operation of the second entry restriction release means 311 is stopped, or the second entry restriction release means 311 is not set.

[0082] The program executed by the control unit 31 is not limited to those stored in the storage unit 32. The program executed by the control unit 31 may be one transmitted to the control unit 31 from an external device via the communication unit 33, one stored on a storage medium such as a USB memory attached to the access control device 30, or one stored on a server other than the access control device 30 (for example, a cloud server).

[0083] The storage unit 32 consists of an HDD (Hard Disk Drive), RAM (Random Access Memory), ROM (Read Only Memory), or SSD (Solid State Drive), etc. The storage unit stores various programs, including programs executed by the control unit. The storage unit also stores information regarding the facial images of registered real estate agents' employees and visitors, as well as information regarding the facial images of registered tenants.

[0084] The imaging device 20 includes a control unit 21, an imaging unit 22, and a communication unit 23. The imaging unit 22 and the communication unit 23 are connected to the control unit 21, for example, by a bus. The control unit 21 is a CPU, etc., and is configured to control the imaging unit 22 and the communication unit 23. The imaging unit 22 is a camera, etc., capable of capturing facial images of the intermediary's employees, visitors, and tenants. The communication unit 23 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. That is, the communication unit 23 is composed of a communication interface configured to communicate with other devices via a communication network such as an internet line. Note that the imaging device 20 may not be connected to the computer 10 via a network such as an internet line, and the imaging device 20 may be connected only to the entry restriction device 30 via wired or wireless communication.

[0085] Next, we will explain the flow of each process in System 1.

[0086] (Example 1: Processing flow by a real estate agent's employee during property viewing) As shown in Figure 6, first, the intermediary registration means 111 is used to register in advance the identification information and facial image information of the intermediary's employees (step S10).

[0087] Next, those wishing to view the property make a viewing appointment through a real estate agent. Through the operation of an employee of the real estate agent, the viewing appointment acceptance means 113 receives viewing appointment information, which includes the identification information of the employee of the real estate agent and viewing date and time information regarding the date and time the viewing will take place (step S20).

[0088] Next, the first authentication means 114 determines whether the date on which the real estate agent's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, and whether the time on which the real estate agent's employee was photographed by the imaging device 20 matches or is included in the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113 (match or mismatch of date and time information) (step S30).

[0089] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information received by the viewing reservation acceptance means 113, or is not included in the time period (date and time information mismatch), the first authentication means 114 performs a process of not outputting restriction release information to release the restriction on entry into a predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the date and time information mismatch, or without linking them (step S40).

[0090] If it is determined that the date and time information matches, the first authentication means 114 authenticates the intermediary's employee by comparing the information regarding the facial image of the intermediary's employee captured by the imaging device 20 with the information regarding the facial image of the intermediary's employee registered by the intermediary registration means 111 (determining whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person) (step S50).

[0091] If the date and time information is determined to match, the first authentication means 114 determines whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. If it is determined that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person, the first authentication means 114 links the permission signal and the information regarding the matching of the date and time information and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S60).

[0092] On the other hand, if it is determined that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S70).

[0093] Next, when the first entry restriction release means 115 receives the entry restriction release information output by the first authentication means 114, it sends information to the entry restriction device 30 to release the restriction on entry into the designated area, in order to release the restriction on entry into the designated area imposed by the entry restriction device 30. In this way, the entry restriction process for property viewings by the real estate agent's employees proceeds.

[0094] (Example 2: Processing flow for handling visitors based on authentication status) As shown in Figure 7, first, the visitor registration information receiving means 110 registers visitor registration information in advance, including information about the visitor's facial image and the date and time of visit (visit date and time information) (step S80).

[0095] Here, the warning notification means 116 determines whether the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has exceeded a predetermined number (step S90). If the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, intermediary terminal 50, and administrator terminal 60) that has been set in advance (step S100). If the number of times the visitor registration information receiving means 110 has received visitor registration information within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0096] Next, the first authentication means 114 determines whether the date and time when the visitor was photographed by the imaging device 20 and the date and time of the visit received by the visitor registration information receiving means 110 meet predetermined conditions (step S110).

[0097] Here, if the first authentication means 114 determines that the date on which a visitor was photographed by the imaging device 20 at the property does not match the visit date in the visit date and time information received by the visitor registration information receiving means 110, or that the time on which a visitor was photographed by the imaging device 20 does not match the visit time in the visit date and time information received by the visitor registration information receiving means 110, or is not included in the time period (a mismatch in date and time information; if the predetermined conditions are not met), the first authentication means 114 performs a process of not outputting restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them (step S120).

[0098] Here, the warning notification means 116 determines whether the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number (step S130). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary terminal 50, and the administrator terminal 60) that has been set in advance (step S140). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0099] If, at the property, the date on which the visitor was photographed by the imaging device 20 matches the visit date in the visit date and time information received by the visitor registration information receiving means 110, and the time on which the visitor was photographed by the imaging device 20 matches or is included in the visit time in the visit date and time information received by the visitor registration information receiving means 110 (matching date and time information; when predetermined conditions are met), the first authentication means 114 authenticates the visitor by comparing the information regarding the visitor's face image photographed by the imaging device 20 with the information regarding the visitor's face image registered by the visitor registration information receiving means 110 (determining whether the person represented in the photographed visitor's face image and the registered visitor's face image are the same person) (step S150).

[0100] If it is determined that the person represented in the captured visitor's face image and the registered visitor's face image are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S160).

[0101] Here, the warning notification means 116 determines whether the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number (step S170). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has exceeded a predetermined number, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary terminal 50, and the administrator terminal 60) that has been set in advance (step S180). If the number of times the first authentication means 114 has authenticated a visitor within a predetermined period has not exceeded a predetermined number, the warning notification means 116 returns the process to the first authentication means 114.

[0102] Then, if it is determined that the person represented in the captured visitor's face image and the registered visitor's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the matching of date and time information and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S190).

[0103] Here, if the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period does not reach a predetermined number or more, the warning notification means 116 repeats the process until the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period reaches a predetermined number or more.

[0104] (Example 3: Processing flow for suspending and deleting registration information of tenants who have moved out) As shown in Figure 8, first, the resident registration information receiving means 117 registers the resident's identification information and facial image information in advance. In addition, the resident registration information receiving means 117 also registers visitor registration information, including information regarding the date and time the resident will move out of the property (move-out date and time information) in advance (step S200).

[0105] Next, the first authentication means 114 determines whether the date and time when the resident was imaged by the imaging device 20 and the date and time of departure received by the resident registration information receiving means 117 meet predetermined conditions (step S210).

[0106] Here, if the first authentication means 114 determines that the date on which the resident was imaged by the imaging device 20 at the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or if the time on which the resident was imaged by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period defined as including the move-out time has passed) (a mismatch in date and time information; if the predetermined conditions are not met), the first authentication means 114 does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal and the information regarding the mismatch in date and time information, or without linking them (step S220).

[0107] Next, the first authentication means 114 authenticates the resident by comparing information regarding the resident's face image captured by the imaging device 20 with information regarding the resident's face image registered by the resident registration information receiving means 117 (determining whether the person represented in the captured resident's face image and the registered resident's face image are the same person) (step S230).

[0108] Here, if it is determined that the date on which the tenant was photographed by the imaging device 20 at the property matches the move-out date in the move-out date and time information received by the tenant registration information receiving means 117, and that the time on which the tenant was photographed by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the tenant registration information receiving means 117 (matching date and time information; if the predetermined conditions are met (if the move-out date and time has not elapsed)), the first authentication means 114 determines whether the person represented in the photographed tenant's face image and the registered tenant's face image are the same person. If it is determined that the person represented in the photographed tenant's face image and the registered tenant's face image are the same person, the first authentication means 114 links the permission signal and the information regarding the matching date and time information, and outputs restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30 (step S240).

[0109] On the other hand, if it is determined that the person represented in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction release information to release the restriction on entry into the predetermined area by the entry restriction device 30, either by linking the denial signal with information regarding the mismatch in date and time information or by not linking them (step S250).

[0110] If the entry restriction device 30 does not output information to lift the restriction on entry into a designated area, the usage suspension means 118, upon receiving information from the administrator terminal 60 regarding the suspension of use for a specific resident (step S260), will not perform resident authentication by the first authentication means 114, even if it receives information regarding the resident's facial image captured by the imaging device 20 (step S270).

[0111] Furthermore, when the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident (step S280), it uses the receipt of the instruction to delete the registration information of a specific resident as a trigger to delete the information related to the resident's face image that was registered by the resident registration information receiving means 117 (step S290).

[0112] According to the system 1, program, and information processing method of this embodiment, which has the above configuration, the system 1 comprises an entry restriction device 30 that selectively restricts entry into a predetermined area, an imaging device 20 that captures facial images of users whose entry into the predetermined area should be restricted by the entry restriction device 30, and a computer 10. The system 1 functions as an intermediary registration means 111, a viewing reservation acceptance means 113, an authentication means (first authentication means 114), and an entry restriction release means (first entry restriction release means 115) by executing a program. The intermediary registration means 111 registers information regarding the identification information and facial images of the intermediary's employees. The viewing reservation acceptance means 113 registers information regarding the intermediary's employees. The system receives viewing reservation information, which includes employee identification information and viewing date and time information. The authentication means (first authentication means 114) authenticates the real estate agent's employee by comparing information regarding the facial image of the real estate agent's employee captured by the imaging device 20 with information regarding the facial image of the real estate agent's employee registered by the real estate agent registration means 111. The entry restriction release means (first entry restriction release means 115) releases the entry restriction to a predetermined area by the entry restriction device 30 if the authentication means (first authentication means 114) authenticates the real estate agent's employee and the date and time the real estate agent's employee was captured by the imaging device 20 and the viewing date and time in the viewing reservation information received by the viewing reservation acceptance means 113 meet predetermined conditions. Conventionally, when visiting facilities such as apartment complexes for viewings, facial recognition technology was known that could perform facial recognition using an authentication engine. However, conventional technology did not give instructions to the entry restriction device based on the authentication of the real estate agent's employee. According to the system 1, program, and information processing method of this embodiment, by comparing the facial images of the intermediary's employees registered in the system 1 with facial images taken on-site and matching them with date and time information, it is possible to lift restrictions on entry into a predetermined area based on the facial images of the intermediary's employees and the property viewing reservation information.

[0113] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the intermediary registration means 111 may form facial image feature data. In this case, the system 1 can use facial image data that shows the features of a person's face.

[0114] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the feature data of the face image may be a set of pixel values ​​of pixels corresponding to the face image. In this case, the pixel values, which are the smallest elements constituting the image, can be used, and it becomes easy to apply processing to the information held by the pixels, thus enabling easy image processing.

[0115] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the intermediary registration means 111 may form one of the following: a hash value, a checksum, or binarized compressed data of the facial image feature data. In this case, it becomes possible to apply further processing to the image.

[0116] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may detect contour lines for each facial part contained in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee based on the pixel values ​​contained in the information regarding the facial image of the intermediary's employee captured by the imaging device 20 and the information regarding the facial image of the intermediary's employee registered by the intermediary registration means 111. In this case, a comparison of facial images can be performed based on multiple facial parts represented in the facial image, enabling a detailed comparison.

[0117] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may compare the contour lines of the detected captured facial image of the intermediary's employee with those of the registered facial image of the intermediary's employee, and determine whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person based on the degree of similarity of the contour lines being compared. In this case, even if there are some changes in the face of the person being compared, authentication can be performed while maintaining a certain level of accuracy.

[0118] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may grant permission as authentication if it determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. In this case, the restriction can be lifted based on the degree of similarity.

[0119] Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may deny authentication if it determines that the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are not the same person. In this case, processing can be performed to maintain the regulation based on the degree of similarity.

[0120] Furthermore, the system 1 according to this embodiment is not limited to the above-described configuration, and various modifications can be made.

[0121] For example, in this embodiment, even when the date and time information does not match, it was determined whether the person represented in the captured facial image of the intermediary's employee and the registered facial image of the intermediary's employee are the same person. However, in this case, it is not necessary to perform such a determination. [Explanation of Symbols]

[0122] 1: System 10: Computer 11: Control Unit 12: Storage section 13: Communications Department 20: Imaging device 21: Control Unit 22: Imaging Department 23: Communications Department 30: Entry control device 31: Control Unit 32: Storage section 33: Communications Department 40: Resident terminal 50: Intermediary terminal 60: Administrator terminal 110: Visitor registration information reception method 111: Method of registering as an intermediary 112: Means of indicating available viewing dates and times 113: How to make a viewing appointment 114: First Authentication Method 115: First method for lifting entry restrictions 116: Warning notification means 117: Method for receiving resident registration information 118:Means for suspending use 119: Means for deleting resident registration information 120: Method for deleting employee registration information 121: Method for deleting visitor registration information 310: Second authentication method 311: Second method for lifting entry restrictions

Claims

1. A camera installed near the entrance of the real estate property, A storage unit that holds face data, which is processed data of the user's face image, Authentication means for comparing the face captured by the aforementioned imaging device with the face data in the storage unit, A means for displaying the dates and times when the property can be viewed, A viewing reservation acceptance means for the user to select a viewing date and time for the real estate property from the dates and times indicated by the viewing availability display means and register a reservation, The system includes an unlocking instruction means that transmits an unlocking instruction to the locking device of the entrance door when the authentication means successfully recognizes the user's face and a viewing of the property by the user is scheduled for that date and time. Facial recognition system.

2. The property further comprises a tenant registration means for which tenants of the property register their own facial data in the storage unit. The authentication means compares the resident's face captured by the camera with the face data in the storage unit. The unlocking instruction means transmits an unlocking instruction to the locking device when the authentication means successfully recognizes the resident's face. The facial recognition system according to claim 1.

3. The administrator terminal used by the manager of the aforementioned real estate property, The system further includes an unlocking notification means that notifies the administrator when the entrance door is unlocked. The facial recognition system according to claim 1.

Images