System, program and information processing method

Abstract

To provide a system, a program, and an information processing method configured to lift the restrictions on entry to a predetermined area, based on a face image of an employee of a broker and information on an appointment for viewing a property.SOLUTION: In a system 1, a management server 10 includes: agent registration means 111 which registers identification information and information on a face image of an employee of a broker; viewing appointment receiving means 113 which receives viewing appointment information including the identification information of the employee of the broker, and viewing time and date information; first authentication means 114 which compares information on a captured face image of the employee of the broker with the registered information on the face image of the employee of the broker to authenticate the employee of the broker; first entry restriction lifting means 115 which lifts the restrictions put by an entry restriction apparatus 30 on entry to a predetermined area when the employee of the broker is authenticated and a predetermined condition is satisfied by the time and date at which the employee of the broker is imaged and the viewing time and date in the viewing appointment information received by the viewing appointment receiving means.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a system, a program, and an information processing method. [Background technology]

[0002] When renting or purchasing an existing real estate property, it is common to preview the surrounding area and also visit the interior of the property that you will actually be living in or using. In this case, inspecting the interior of the property before signing a lease or purchase contract is generally referred to as a "viewing."

[0003] 2. Description of the Related Art Facial recognition technology that can perform facial recognition using an authentication engine is generally known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6839313 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, in the conventional technology, instructions are not given to the entrance control device based on the authentication of the agent's employee.

[0006] The present disclosure has been made in consideration of these points, and aims to provide a system, program, and information processing method that can lift restrictions on entry into a specified area based on facial images of real estate agents' employees and information on property viewing reservations. [Means for solving the problem]

[0007] The system of the present disclosure comprises: an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; A computer, A system comprising: The system functions as a real estate agent registration means, a viewing reservation acceptance means, an authentication means, and an admission restriction removal means by executing a program. the agent registration means registers identification information and facial image information of the agent's employees; The preview reservation receiving means receives preview reservation information including identification information of an employee of the real estate agent and preview date and time information regarding the date and time of the preview, the authentication means performs authentication of the employee of the intermediary agency by comparing information on the facial image of the employee of the intermediary agency captured by the imaging device with information on the facial image of the employee of the intermediary agency registered by the intermediary agency registration means; The entry restriction release means releases the restriction on entry into a specified area imposed by the entry restriction device when the authentication means authenticates the agent's employee and the date and time when the agent's employee is photographed by the imaging device and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means satisfy specified conditions.

[0008] In the system, the intermediary agent registration means may form feature amount data of the facial image.

[0009] In the system, the feature amount data of the face image may be a set of pixel values ​​of pixels corresponding to the face image.

[0010] In the system, the intermediary registration means may form one of a hash value, a checksum, and binarized compressed data of the feature amount data of the face image.

[0011] In addition, in the system, the authentication means may detect the contours of each facial part contained in the captured facial image of the intermediary agent's employee and the registered facial image of the intermediary agent's employee based on pixel values ​​contained in information regarding the facial image of the intermediary agent's employee captured by the imaging device and information regarding the facial image of the intermediary agent's employee registered by the intermediary agent registration means.

[0012] In addition, in the system, the authentication means may compare the contour lines of the detected facial image of the captured employee of the intermediary and the facial image of the registered employee of the intermediary, and determine whether the person represented in the captured facial image of the employee of the intermediary and the facial image of the registered employee of the intermediary are the same person based on the degree of similarity of the contour lines of the compared objects.

[0013] In addition, in the system, the authentication means may grant permission as the authentication if it determines that the person shown in the captured facial image of the intermediary agent's employee and the facial image of the registered intermediary agent's employee are the same person.

[0014] In addition, in the system, the authentication means may reject the authentication if it determines that the person shown in the captured facial image of the intermediary agent's employee and the facial image of the registered intermediary agent's employee are not the same person.

[0015] The program of the present disclosure is an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; A computer, A program that functions as a real estate agent registration means, a preview reservation acceptance means, an authentication means, and an admission restriction release means when executed by a control unit of the system having the above. the agent registration means registers identification information and facial image information of the agent's employees; The preview reservation receiving means receives preview reservation information including identification information of an employee of the real estate agent and preview date and time information regarding the date and time of the preview, the authentication means performs authentication of the employee of the intermediary agency by comparing information on the facial image of the employee of the intermediary agency captured by the imaging device with information on the facial image of the employee of the intermediary agency registered by the intermediary agency registration means; The entry restriction release means releases the restriction on entry into a specified area imposed by the entry restriction device when the authentication means authenticates the agent's employee and the date and time when the agent's employee is photographed by the imaging device and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means satisfy specified conditions.

[0016] The information processing method of the present disclosure includes: an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; A computer, An information processing method executed by a control unit of a system comprising: Registering the identification information and facial image information of the intermediary's employees, Accepting viewing reservation information including identifying information of the agent's employees and viewing date and time information regarding the date and time the viewing will take place; authenticating the agent's employee by comparing information about the face image of the agent's employee captured by the imaging device with information about the face image of the agent's employee registered; When the agent's employee is authenticated and the date and time when the agent's employee is photographed by the imaging device and the preview date and time in the preview reservation information satisfy a predetermined condition, the restriction on entry into the predetermined area by the entry restriction device is lifted. [Effects of the Invention]

[0017] According to the system of the present disclosure, it is possible to provide a system, a program, and an information processing method that can selectively restrict the entry of predetermined people into a predetermined area. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a schematic diagram showing the overall configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 1 is an activity diagram showing the flow of information between elements when registering an intermediary in the system according to the present embodiment. [Figure 3] FIG. 1 is an activity diagram showing the flow of information between elements when booking a preview of a property in the system according to the present embodiment. [Figure 4] FIG. 1 is an activity diagram showing the flow of information between elements during a property viewing in the system according to the present embodiment. [Figure 5] (A) A figure showing an example of a display format in which candidates for viewing dates and times presented when booking a preview in a system according to this embodiment can be selected, and (B) a figure showing an example of a display that appears after selecting a candidate for a preview reservation date and time. [Figure 6] 10 is a flowchart showing the flow of processing by an intermediary in the system according to the present embodiment. [Figure 7] 10 is a flowchart showing the flow of processing for dealing with a visitor based on whether or not authentication has been successful in the system according to the present embodiment. [Figure 8] 10 is a flowchart showing the process of suspending use and deleting registered information of a resident who has already moved out in the system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] The present embodiment will be described below by way of example with reference to the drawings.

[0020] <System 1> 1, in system 1 according to this embodiment, an employee of a real estate agent who has registered information about a face image in advance in a management server (computer 10) releases the restriction on entry into a predetermined area (specifically, a shared space in an apartment building) imposed by entrance restriction device 30 based on information about a face image captured by imaging device 20. The configuration of such system 1 will be described using FIG. 1.

[0021] As shown in Fig. 1, system 1 includes an entrance restriction device 30, an imaging device 20, a computer 10 (management server), a resident terminal 40, an agent terminal 50, and an administrator terminal 60. Computer 10 is communicatively connected to each of entrance restriction device 30, imaging device 20, resident terminal 40, agent terminal 50, and administrator terminal 60 via a network such as the Internet. Furthermore, entrance restriction device 30 and imaging device 20 are communicatively connected to each other wirelessly or via a wire. Furthermore, entrance restriction device 30, imaging device 20, resident terminal 40, agent terminal 50, and administrator terminal 60 are communicatively connected to each other via a network such as the Internet.

[0022] <Computer 10> Computer 10 is, for example, a management server of a system company. Computer 10 has control unit 11, memory unit 12, and communication unit 13. Control unit 11 is, for example, a CPU, and by executing programs stored in memory unit 12, functions as visitor registration information receiving means 110, real estate agent registration means 111, available viewing date and time presentation means 112, viewing reservation receiving means 113, first authentication means 114, first entry restriction lifting means 115, warning notification means 116, tenant registration information receiving means 117, usage suspension means 118, tenant registration information deletion means 119, employee registration information deletion means 120, and visitor registration information deletion means 121.

[0023] <Control system applied to brokers> The intermediary registration means 111 generates facial image feature data of the intermediary's employees upon receiving registration application information from the intermediary terminal 50 and registers the identification information and facial image information of the intermediary's employees. The facial image information of the intermediary's employees includes at least one of a hash value, a checksum, and binarized compressed data of the facial image feature data of the intermediary's employees. Here, the facial image feature data is facial image data that indicates the facial features of a person, such as a set of pixel values ​​of pixels corresponding to the facial image. Furthermore, the identification information of the intermediary's employees refers to an identifier such as an ID that identifies the intermediary's employees. As shown in FIG. 2 , the intermediary registration means 111 transmits the received registration application information to the administrator terminal 60 via the communication unit 13. Furthermore, the intermediary registration means 111 transmits approval information received from the administrator terminal 60 to the intermediary terminal 50 via the communication unit 13. Furthermore, the intermediary registration means 111 can also transmit facial image information of registered intermediary employees to the entry control device 30 via the communication unit 13.

[0024] As shown in Fig. 3, the viewing available date and time presentation means 112 accepts viewing request information sent via the agent terminal 50 from an employee of the agent registered by the agent registration means 111. The viewing request information refers to information regarding the desired viewing date and time of the person wishing to view the property (viewing candidate) that is entered into the system 1 by the agent employee based on one or more desired viewing dates and times presented to the agent by the person wishing to view the property (viewing candidate). In addition, the viewing available date and time presentation means 112, triggered by the acceptance of the viewing request information, sends a display signal to the agent terminal 50 to cause the agent terminal 50 to display candidate viewing dates and times based on the available viewing dates and times stored in the memory unit 12.

[0025] The preview reservation accepting means 113 accepts preview reservation information, which includes preview date and time information regarding the date and time at which the preview will take place, selected from the candidate preview date and time options displayed on the real estate agent terminal 50, based on the display signal transmitted from the preview available date and time presentation means 112, and identification information for an employee of the real estate agent. The preview reservation accepting means 113 also stores the preview date and time information in the accepted preview reservation information in the memory unit 12. The preview reservation is confirmed by storing the preview reservation information in the memory unit 12. At this time, the candidate preview date and time options are displayed in a calendar format, for example, as shown in FIG. 5(A), and the preview reservation can be confirmed by associating them with the name of an employee of the real estate agent and the name of the property, as shown in FIG. 5(B).

[0026] 3, the preview reservation acceptance means 113 transmits the preview reservation information to the manager terminal 60 via the communication unit 13. At this time, the preview reservation acceptance means 113 can also transmit the preview reservation information to the entry restriction device 30 via the communication unit 13.

[0027] The preview reservation acceptance means 113 also transmits reservation confirmation information for the confirmed preview reservation to the agent terminal 50 via the communication unit 13. A pairing ID is assigned to the identification information and facial image information of the agent's employee, as well as the preview date and time information, in order to associate each piece of information.

[0028] The first authentication means 114 authenticates the agent's employee by comparing information regarding the facial image of the agent's employee captured by the imaging device 20 with information regarding the facial image of the agent's employee registered by the agent registration means 111.

[0029] The first authentication means 114 detects the contours of each facial feature included in the captured facial image of the agent's employee and the registered facial image of the agent's employee, based on pixel values ​​included in information related to the facial image of the agent's employee captured by the imaging device 20 and information related to the facial image of the agent's employee registered by the agent registration means 111. The first authentication means 114 compares the information related to the facial image of the agent's employee captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0030] The first authentication means 114 compares the contours of the detected captured facial image of the agent's employee with the contours of the facial images of registered agent's employees.

[0031] Furthermore, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity of the contours of the facial image of the detected captured employee of the intermediary agent and the facial image of the registered employee of the intermediary agent as the comparison result.

[0032] The first authentication means 114 also calculates the degree of approximation between each image. The degree of approximation is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, the number of enclosed closed curves, etc. For example, when closed curves within an image are appropriately matched one-to-one within the image, if there are no unmatched closed curves, the first authentication means 114 assigns the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parent curves) match, the first authentication means 114 further adds one point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is designated as the final score between the images. The higher the score, the greater the degree of approximation between the two images, as determined by the first authentication means 114 in a stepwise manner according to the score.

[0033] Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person. Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are not the same person, while leaving open the possibility that they are not the same person.

[0034] Furthermore, if the first authentication means 114 determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0035] The first authentication means 114 also determines whether the date and time when the agent's employee was imaged by the imaging device 20 and the preview date and time in the preview reservation information accepted by the preview reservation accepting means 113 satisfy a predetermined condition. For example, the first authentication means 114 determines whether the date when the agent's employee was imaged by the imaging device 20 at the property matches the preview date in the preview reservation information accepted by the preview reservation accepting means 113. The first authentication means 114 also determines whether the time when the agent's employee was imaged by the imaging device 20 at the property matches the preview time or is included in the time period for the preview in the preview reservation information accepted by the preview reservation accepting means 113.

[0036] If it is determined that the date on which an image of an agent's employee was captured by the imaging device 20 for a property matches the viewing date in the viewing reservation information received by the viewing reservation reception means 113, and that the time at which the image of the agent's employee was captured by the imaging device 20 matches the viewing time or is included in the time period in the viewing reservation information received by the viewing reservation reception means 113 (match of date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the agent's employee and the facial image of the registered agent's employee are the same person, and if it is determined that the person shown in the captured facial image of the agent's employee and the facial image of the registered agent's employee are the same person, the first authentication means 114 links the permission signal and information related to the match of the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0037] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, or that the time at which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information accepted by the viewing reservation acceptance means 113 or is not included in the time period (mismatch in date and time information), the first authentication means 114 performs a process of linking the denial signal and information related to the mismatch in date and time information, or without linking them, not outputting restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

[0038] The first entry restriction release means 115 releases the restriction on entry into a specified area imposed by the entry restriction device 30 when the agent's employee is authenticated by the first authentication means 114 and the date and time when the agent's employee is photographed by the imaging device 20 and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means 113 satisfy specified conditions.

[0039] Also, as shown in Figure 4, after receiving the entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 notifies the manager that the entry restriction to the property has been lifted by transmitting the entry restriction lifting information to the manager terminal 60.

[0040] When the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the restriction on entry into the specified area, in order to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0041] When the employee registration information deletion means 120 receives an instruction to delete the registration information of an employee of a specific intermediary from the administrator terminal 60 or the intermediary terminal 50, it deletes information relating to the facial image of the employee of the specific intermediary registered by the intermediary registration means 111, triggered by the receipt of the instruction to delete the registration information of the employee of the specific intermediary.

[0042] <Control system applied to visitors> The visitor registration information receiving means 110 forms feature amount data of the visitor's facial image and receives visitor registration information including information about the visitor's facial image and the visit date and time (visit date and time information). The information about the visitor's facial image includes at least one of a hash value, a checksum, and binarized compressed data of the feature amount data of the visitor's facial image. Here, the feature amount data of the facial image is facial image data showing the facial features of a person, such as a set of pixel values ​​of pixels corresponding to the facial image. Furthermore, the visitor's visit date and time information refers to information about the planned date and time of a visit by a visitor who is scheduled to visit the property. Here, a visitor refers to a person who visits the property, and is a third party other than the resident or an employee of the real estate agent. Examples of visitors include the resident's friends and relatives. A pairing ID is assigned to the visitor's facial image information and visit date and time information to associate each piece of information.

[0043] The first authentication means 114 compares information relating to the visitor's facial image captured by the imaging device 20 with information relating to the visitor's facial image registered by the visitor registration information receiving means 110 to authenticate the visitor.

[0044] Furthermore, the first authentication means 114 detects the contours of each facial feature included in the captured visitor's facial image and the registered visitor's facial image based on pixel values ​​included in information related to the visitor's facial image captured by the imaging device 20 and information related to the visitor's facial image registered by the visitor registration information receiving means 110. The first authentication means 114 compares the information related to the visitor's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0045] The first authentication means 114 also compares the contours of the detected captured facial image of the visitor with those of the registered visitor. Based on the comparison result, the first authentication means 114 determines whether the people in both facial images are the same based on the degree of similarity of the contours of the detected captured facial image of the visitor and the registered facial image of the visitor that are the subjects of comparison.

[0046] The first authentication means 114 also calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, the number of enclosed closed curves, etc. For example, if there are no unmatched closed curves when the closed curves in the images are appropriately matched one-to-one within the image, the first authentication means 114 assigns the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parent curves) match, the first authentication means 114 adds another point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is the final score between the images. The higher the score, the greater the degree of similarity between the two images, as determined by the first authentication means 114 in a qualitative manner. Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person depicted in the captured visitor's facial image and the registered visitor's facial image are the same person. Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person, while leaving open the possibility that they are not the same person.

[0047] Furthermore, if the first authentication means 114 determines that the person shown in the captured face image of the visitor and the registered face image of the visitor are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured face image of the visitor and the registered face image of the visitor are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0048] The first authentication means 114 also determines whether the date and time when the visitor was imaged by the imaging device 20 and the visit date and time accepted by the visitor registration information accepting means 110 satisfy a predetermined condition. For example, the first authentication means 114 determines whether the date when the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information accepted by the visitor registration information accepting means 110. The first authentication means 114 also determines whether the time when the visitor was imaged by the imaging device 20 at the property matches the visit time or is included in the time period in the visit date and time information accepted by the visitor registration information accepting means 110.

[0049] If it is determined that the date on which the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, and that the time at which the visitor was imaged by the imaging device 20 matches the visit time or is included in the time period in the visit date and time information accepted by the visitor registration information accepting means 110 (match of date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person, and if it is determined that the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person, the first authentication means 114 links the permission signal and information related to the match of the date and time information, and outputs restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

[0050] On the other hand, if the first authentication means 114 determines that the date on which the visitor was imaged by the imaging device 20 at the property does not match the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, or that the time on which the visitor was imaged by the imaging device 20 does not match the visit time in the visit date and time information accepted by the visitor registration information accepting means 110 or is not included in the time period (mismatch in date and time information), the first authentication means 114 performs a process of linking the denial signal and information related to the mismatch in date and time information, or without linking them, not outputting restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

[0051] Furthermore, the first entry restriction lifting means 115 lifts the restriction on entry into a predetermined area imposed by the entry restriction device 30 when the visitor is authenticated by the first authentication means 114 and the date and time when the visitor was imaged by the imaging device 20 and the visit date and time in the registration information accepted by the visitor registration information accepting means 110 satisfy predetermined conditions. Furthermore, as shown in Fig. 4, after receiving entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 transmits the entry restriction lifting information to the manager terminal 60, thereby notifying the manager that the entry restriction to the property has been lifted.

[0052] When the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the restriction on entry into the specified area, in order to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0053] The warning notification means 116 determines whether the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information or the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more. If the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information or the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more, the warning notification means 116 transmits warning notification information to a predetermined terminal (at least one of the resident terminal 40, the agent terminal 50, and the manager terminal 60). The warning notification includes, for example, an audio alert or a visual alert.

[0054] When the visitor registration information deletion means 121 receives an instruction to delete the registration information of a specific visitor from the resident terminal 40, the administrator terminal 60, or the intermediary terminal 50, it deletes information related to the facial image of the specific visitor registered by the visitor registration information receiving means 110, triggered by the receipt of the instruction to delete the registration information of the specific visitor.

[0055] <Control system applied to residents> The resident registration information receiving means 117 forms feature amount data of the resident's facial image and registers the resident's identification information and information about the facial image. The information about the resident's facial image includes at least one of a hash value, a checksum, and binary compressed data of the feature amount data of the resident's facial image. Here, the feature amount data of the facial image is facial image data that indicates the characteristics of a person's face, such as a set of pixel values ​​of pixels corresponding to the facial image. Furthermore, the resident's identification information refers to an identifier such as an ID that identifies the resident residing in the property. A pairing ID is assigned to the resident's identification information and information about the facial image to associate each piece of information. Furthermore, the resident registration information receiving means 117 receives registration information of visitors, including information about the date and time when the resident will move out of the property (moving date and time information). Note that the term "resident" includes those who move out.

[0056] The first authentication means 114 authenticates the resident by comparing information about the resident's facial image captured by the imaging device 20 with information about the resident's facial image registered by the resident registration information receiving means 117.

[0057] Furthermore, the first authentication means 114 detects the contours of each facial feature included in the captured facial image of the resident and the registered facial image of the resident, based on pixel values ​​included in information related to the facial image of the resident captured by the imaging device 20 and information related to the facial image of the resident registered by the resident registration information receiving means 117. The first authentication means 114 compares the information related to the facial image of the resident captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features included in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

[0058] The first authentication means 114 also compares the contours of the detected captured facial image of the resident with those of the registered facial image of the resident. As a result of the comparison, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity of the contours of the detected captured facial image of the resident and the registered facial image of the resident that are the comparison targets.

[0059] The first authentication means 114 also calculates the degree of approximation between each image. The degree of approximation is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, the number of enclosed closed curves, etc. For example, when closed curves within an image are appropriately matched one-to-one within the image, if there are no unmatched closed curves, the first authentication means 114 assigns the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parent curves) match, the first authentication means 114 further adds one point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is designated as the final score between the images. The higher the score, the greater the degree of approximation between the two images, as determined by the first authentication means 114 in a stepwise manner according to the score. Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person. Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, while leaving open the possibility that they are not the same person.

[0060] Furthermore, if the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

[0061] The first authentication means 114 also determines whether the date and time when the image of the resident was captured by the imaging device 20 and the move-out date and time received by the resident registration information receiving means 117 satisfy a predetermined condition. For example, the first authentication means 114 determines whether the date when the image of the resident was captured by the imaging device 20 in the property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117. The first authentication means 114 also determines whether the time when the image of the resident was captured by the imaging device 20 in the property matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117.

[0062] In the property, if it is determined that the date on which a resident's image was captured by the imaging device 20 matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117, and that the time at which the resident's image was captured by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117, and that the move-out date and time has not passed (match of date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, and if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links information regarding the match of the permission signal and the date and time information, and performs a process of outputting restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0063] Furthermore, if the first authentication means 114 determines that the date on which the image of the resident was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time at which the resident was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period specified to include the move-out time has passed) (mismatch in date and time information), the first authentication means 114 performs processing not to output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30. Alternatively, the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, and if it determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 performs a process of not outputting restriction release information for lifting the restriction on entry into a specified area imposed by the entry restriction device 30, without linking or linking information regarding the discrepancy between the denial signal and the date and time information.

[0064] Furthermore, if the first authentication means 114 determines that the date on which the image of the resident was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has not yet arrived), or that the time at which the resident was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has not yet arrived), or is not included in the time period (the time period specified to include the move-out time has not yet arrived) (mismatch in date and time information), the first authentication means 114 performs a process of not outputting restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30, without linking the denial signal and information related to the mismatch in date and time information, or without linking them.

[0065] On the other hand, if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links information regarding the discrepancy between the permission signal and the date and time information, and performs a process of outputting restriction lifting information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0066] When the resident is authenticated by the first authentication means 114, the first entry restriction lifting means 115 lifts the restriction on entry into the specified area imposed by the entry restriction device 30. Furthermore, as shown in Fig. 4, after receiving entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 transmits the entry restriction lifting information to the manager terminal 60, thereby notifying the manager that the entry restriction to the property has been lifted.

[0067] In addition, when the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the restriction on entry into the specified area, in order to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

[0068] When the usage suspension means 118 receives information regarding suspension of usage by a specific resident from the administrator terminal 60, it does not authenticate the resident using the first authentication means 114 even if it receives information regarding the resident's facial image captured by the imaging device 20.

[0069] When the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident, it deletes information regarding the facial image of the resident registered by the resident registration information reception means 117, triggered by the receipt of the instruction to delete the registration information of the specific resident.

[0070] The programs executed by the control unit 11 are not limited to those stored in the storage unit 12. The programs executed by the control unit 11 may be those transmitted to the control unit 11 from an external device via the communication unit 13, those stored in a storage medium such as a USB memory attached to the computer 10, or those stored in a server (for example, a cloud server) separate from the computer 10.

[0071] The storage unit 12 is composed of a hard disk drive (HDD), random access memory (RAM), read only memory (ROM), or solid state drive (SSD), etc. The storage unit 12 stores various programs including programs executed by the control unit 11. The storage unit 12 also stores information relating to facial images of registered visitors and visit date and time information, information relating to facial images and identification information of registered tenants, and identification information and information relating to facial images of registered employees of the real estate agent.

[0072] The communication unit 13 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for performing wired or wireless communication. That is, the communication unit 13 is configured from a communication interface configured to communicate with other devices via a communication network such as the Internet.

[0073] <Resident terminal 40> The resident terminal 40 is a smartphone, a portable tablet computer, etc., owned by a resident of the property. The resident terminal 40 has a control unit, a display unit, an operation unit, an imaging unit, a memory unit, and a communication unit (not shown), and these components are electrically connected.

[0074] The control unit includes a CPU, RAM, ROM, etc., and is configured to execute various information processes based on programs and data.

[0075] The display unit is, for example, a display, and is used to display input, output, etc. The display can be a known liquid crystal display, etc. The operation unit is a keyboard, operation keys, etc., and is used to perform the above-mentioned input. A touch panel display that serves as both the display unit and the operation unit can also be used. In the following, as an example, input via the operation unit is performed by touch input. The imaging unit is a camera, etc., that can capture images of the resident's face, identification card, luggage, etc.

[0076] The storage unit is configured with an auxiliary storage device such as an HDD or SSD, and stores various data and programs for operating the resident terminal 40. The programs are used to perform various processes, which will be described later. The control unit is configured to interpret and execute these programs to perform various processes.

[0077] The communication unit is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for performing wired or wireless communication. That is, the communication unit is configured with a communication interface configured to communicate with other devices via a communication network such as the Internet.

[0078] The specific hardware configuration of the resident terminal 40 can be modified by omitting, replacing, or adding components as appropriate depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. The resident terminal 40 may be a terminal dedicated to this system, or it may be a general-purpose smartphone or the like on which the above-mentioned program is installed and used.

[0079] The following process is performed in the resident terminal 40. That is, the control unit of the resident terminal 40 loads the program stored in the storage unit into the RAM, and then the CPU interprets and executes the program.

[0080] <Intermediary terminal 50> The agent terminal 50 is a personal computer or the like installed in the office of an agent who brokers properties, and an employee of the agent who operates the agent terminal 50 can use the agent terminal 50 to send and receive information to and from the resident terminal 40 and the manager terminal 60. Applications that utilize the system 1 can be downloaded to the agent terminal 50 via the agent terminal 50. The agent terminal 50 also transmits information related to various registrations in this embodiment (registration application information) to the computer 10, and receives various information from the computer 10. The agent terminal 50 also transmits preview reservation information to the computer 10.

[0081] <Administrator terminal 60> The administrator terminal 60 is a smartphone, a portable tablet computer, a personal computer, or the like installed in the office of the administrator who manages the property in this embodiment. The administrator terminal 60 has a control unit, a display unit, an operation unit, an imaging unit, a memory unit, and a communication unit (not shown), and these components are electrically connected. The administrator terminal 60 also receives registration application information transmitted from the real estate agent registration means 111. The administrator terminal 60 also allows a user to determine whether or not to apply for registration based on the received registration application information. If the user approves the registration application, approval information can be transmitted to the computer 10, as shown in FIG. 2. The administrator terminal 60 also allows a user to output information (information regarding suspension of use) specifying that a specific resident of the property has been suspended or prohibited from using the property. The administrator terminal 60 also allows a user to output information (information regarding deletion of registration information) instructing the system 1 to delete the registration information of a specific resident of the property.

[0082] The control unit includes a CPU, RAM, ROM, etc., and is configured to execute various information processes based on programs and data.

[0083] The display unit is, for example, a display, and is used to display input, output, etc. The display can be a known liquid crystal display, etc. The operation unit is a keyboard, operation keys, etc., and is used to perform the above-mentioned input. A touch panel display that serves as both the display unit and the operation unit can also be used. In the following, as an example, input via the operation unit is performed by touch input. The imaging unit is a camera, etc., that can capture images of the resident's face, identification card, etc.

[0084] The storage unit is configured with an auxiliary storage device such as an HDD or SSD, and stores various data and programs for operating the resident terminal 40. The programs are used to perform various processes, which will be described later. The control unit is configured to interpret and execute these programs to perform various processes.

[0085] The communication unit is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for performing wired or wireless communication. That is, the communication unit is configured with a communication interface configured to communicate with other devices via a communication network such as the Internet.

[0086] The specific hardware configuration of the administrator terminal 60 may include omissions, substitutions, and additions of components as appropriate depending on the embodiment. For example, the control unit may include multiple processors. The control unit may be configured with an FPGA. The storage unit may be configured with RAM and ROM included in the control unit. The administrator terminal 60 may be a terminal dedicated to this system, or may be a general-purpose smartphone or the like with the above-mentioned program installed and used.

[0087] The following processing is performed in the administrator terminal 60. That is, the control unit of the administrator terminal 60 loads the program stored in the storage unit into the RAM, and then the CPU interprets and executes the program.

[0088] <Entry Restriction Device 30 and Image Capture Device 20> The entry restriction device 30 and the imaging device 20 are each installed near the entrance to the property. The entry restriction device 30 selectively restricts movement from outside the property to the shared space or the private space. For example, if a door is installed at the entrance to the shared space, the entry restriction device 30 includes a locking device that locks and unlocks the door. Specifically, the locking device normally locks the door installed at the entrance to the shared space, thereby restricting third parties from entering the shared space or the private space from outside the property. On the other hand, if the person whose face image is captured by the imaging device 20 is authenticated as a pre-registered employee, visitor, or resident of the real estate agent based on the facial image information transmitted from the imaging device 20, the entry restriction device 30 (specifically, the locking device) unlocks the door, as shown in FIG. 4, allowing the real estate agent's employee, visitor, or resident to enter the shared space or the private space from outside the property. Note that the door remains unlocked for a predetermined period of time, and the locking device automatically relocks the door after the period has elapsed. After the entrance restriction device 30 has lifted the entrance restriction, it transmits entrance restriction lifting information to the computer 10 as shown in FIG.

[0089] Furthermore, if a sliding automatic door is installed at the entrance to the shared space of the property, the entry restriction device 30 includes a sliding device that slides the automatic door. Specifically, the sliding device normally keeps the automatic door in a closed position to block the entrance to the shared space, thereby restricting third parties from entering the shared space from outside the property. On the other hand, if the person whose face image is captured by the imaging device 20 is authenticated as a pre-registered employee, visitor, or resident of the real estate agent based on the facial image information transmitted from the imaging device 20, the entry restriction device 30 (specifically, the sliding device) slides the automatic door to an open position, thereby unblocking the entrance to the shared space and allowing users (employees, visitors, or resident) of the real estate agent to enter the shared space or private space from outside the property. Note that the automatic door remains in the open position for a predetermined period of time, and when this period has elapsed, the sliding device again moves the automatic door from the open position to the closed position.

[0090] The entrance restriction device 30 includes a control unit 31, a memory unit 32, and a communication unit 33. The control unit 31 is, for example, a CPU, and functions as a second authentication means 310 and a second entrance restriction lifting means 311 by executing a program stored in the memory unit 32. The second authentication means 310 verifies whether the person captured by the image capture device 20 is a pre-registered employee, visitor, or resident of the agent by comparing information about facial images of the agent's employees, visitors, and residents stored in the memory unit 32 with information about facial images transmitted from the image capture device 20. The second entrance restriction lifting means 311 lifts the restriction on the authenticated agent's employees, visitors, and resident from entering a predetermined area. The first authentication means 114 and the second authentication means 310, as well as the first entrance restriction lifting means 115 and the second entrance restriction lifting means 311, are each selectively controlled. In other words, when the first authentication means 114 is applied to the system 1, the second authentication means 310 is not applied, and the operation of the second authentication means 310 is stopped or the second authentication means 310 is not set. Also, when the first admission restriction release means 115 is applied to the system 1, the second admission restriction release means 311 is not applied, and the operation of the second admission restriction release means 311 is stopped or the second admission restriction release means 311 is not set.

[0091] The programs executed by the control unit 31 are not limited to those stored in the storage unit 32. The programs executed by the control unit 31 may be those transmitted to the control unit 31 from an external device via the communication unit 33, those stored in a storage medium such as a USB memory attached to the entrance control device 30, or those stored in a server (for example, a cloud server) separate from the entrance control device 30.

[0092] The storage unit 32 is composed of a hard disk drive (HDD), random access memory (RAM), read only memory (ROM), or solid state drive (SSD), etc. The storage unit stores various programs, including programs executed by the control unit. The storage unit also stores information on facial images of registered agents' employees and visitors, as well as information on facial images of registered residents.

[0093] The imaging device 20 includes a control unit 21, an imaging unit 22, and a communication unit 23. The imaging unit 22 and the communication unit 23 are connected to the control unit 21 via, for example, a bus. The control unit 21 is a CPU or the like, and controls the imaging unit 22 and the communication unit 23. The imaging unit 22 is a camera or the like capable of capturing facial images of the agent's employees, visitors, and tenants. The communication unit 23 is, for example, a wired LAN (Local Area Network) module or a wireless LAN module, and includes an interface for wired or wireless communication. That is, the communication unit 23 is configured with a communication interface configured to communicate with other devices via a communication network such as the Internet. Note that the imaging device 20 may not be communicatively connected to the computer 10 via a network such as the Internet, but may be communicatively connected only to the entry control device 30 via a wired or wireless connection.

[0094] Next, the flow of each process in the system 1 will be described.

[0095] (Example 1: Processing flow by a real estate agent employee during property viewing) As shown in FIG. 6, first, the agent registration means 111 registers in advance the identification information and facial image information of the agent's employees (step S10).

[0096] Next, the person wishing to view the property makes a reservation for viewing the property through the real estate agent. Through an operation by an employee of the real estate agent, the preview reservation accepting means 113 accepts preview reservation information including identification information of the employee of the real estate agent and preview date and time information regarding the date and time of the preview (step S20).

[0097] Next, the first authentication means 114 determines whether the date on which the agent's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, and whether the time on which the agent's employee was photographed by the imaging device 20 matches the viewing time or is included in the time period in the viewing reservation information accepted by the viewing reservation acceptance means 113 (match or mismatch of date and time information) (step S30).

[0098] On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, or that the time at which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information accepted by the viewing reservation acceptance means 113 or is not included in the time period (mismatch in date and time information), the first authentication means 114 performs a process of linking the denial signal and information related to the mismatch in date and time information, or without linking them, not outputting restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S40).

[0099] If it is determined that the date and time information matches, the first authentication means 114 authenticates the agent's employee by comparing information regarding the facial image of the agent's employee captured by the imaging device 20 with information regarding the facial image of the agent's employee registered by the agent registration means 111 (determines whether the person depicted in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person) (step S50).

[0100] If it is determined that the date and time information matches, the first authentication means 114 determines whether the person shown in the captured facial image of the agent's employee and the facial image of the registered agent's employee are the same person, and if it is determined that the person shown in the captured facial image of the agent's employee and the facial image of the registered agent's employee are the same person, the first authentication means 114 links the permission signal and information regarding the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S60).

[0101] On the other hand, if it is determined that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are not the same person, the first authentication means 114 outputs a denial signal, and does not link the denial signal with information regarding the discrepancy between the date and time information, or does not link them, and does not output restriction lifting information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S70).

[0102] Next, when first entry restriction lifting means 115 receives the entry restriction lifting information output by first authentication means 114, it sends information to entry restriction device 30 to lift the restriction on entry into the specified area by entry restriction device 30. In this way, entry restriction processing for property viewings by employees of the real estate agent in the property viewing business proceeds.

[0103] (Example 2: Processing flow for dealing with visitors based on whether they are authenticated or not) As shown in FIG. 7, first, visitor registration information including information related to the visitor's facial image and the visit date and time (visit date and time information) is registered in advance by the visitor registration information receiving means 110 (step S80).

[0104] Here, the warning notification means 116 determines whether the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within a predetermined period of time has reached a predetermined number or more (step S90). If the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 transmits warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60) (step S100). If the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns the process to the first authentication means 114.

[0105] Next, the first authentication means 114 determines whether or not the date and time when the visitor was imaged by the imaging device 20 at the property and the visit date and time accepted by the visitor registration information accepting means 110 satisfy a predetermined condition (step S110).

[0106] Here, if the first authentication means 114 determines that the date on which the visitor was imaged by the imaging device 20 at the property does not match the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, or that the time on which the visitor was imaged by the imaging device 20 does not match the visit time in the visit date and time information accepted by the visitor registration information accepting means 110, or is not included in the time period (mismatch in date and time information; does not satisfy specified conditions), the first authentication means 114 performs a process of linking the denial signal and information related to the mismatch in date and time information, or without linking them, not outputting restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S120).

[0107] Here, the warning notification means 116 determines whether the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more (step S130). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 transmits warning notification information to a predetermined terminal (at least one of the resident terminal 40, the agent terminal 50, and the manager terminal 60) (step S140). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns the process to the first authentication means 114.

[0108] If it is determined that the date on which the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, and that the time at which the visitor was imaged by the imaging device 20 matches the visit time or is included in the time period in the visit date and time information accepted by the visitor registration information accepting means 110 (matching of date and time information; when a predetermined condition is met), the first authentication means 114 authenticates the visitor by comparing information related to the visitor's facial image taken by the imaging device 20 with information related to the visitor's facial image registered by the visitor registration information accepting means 110 (determines whether the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person) (step S150).

[0109] If it is determined that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person, the first authentication means 114 outputs a denial signal, and links the denial signal with information regarding the discrepancy in the date and time information, or does not link them, and does not output restriction lifting information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S160).

[0110] Here, the warning notification means 116 determines whether the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more (step S170). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 transmits warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60) (step S180). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns the process to the first authentication means 114.

[0111] If it is determined that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person, the first authentication means 114 links the information regarding the match between the permission signal and the date and time information, and outputs restriction lifting information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S190).

[0112] Here, if the number of times that the visitor registration information accepting means 110 accepts the visitor's registration information or the number of times that the first authentication means 114 authenticates the visitor within the specified period does not reach or exceed the specified number, the warning notification means 116 repeats the process until the number of times that the visitor registration information accepting means 110 accepts the visitor's registration information or the number of times that the first authentication means 114 authenticates the visitor within the specified period reaches or exceeds the specified number.

[0113] (Example 3: Processing flow for suspending and deleting registered information of tenants who have already moved out) 8, first, information relating to the identification information and facial image of the resident is registered in advance by the resident registration information receiving means 117. Also, visitor registration information including information relating to the date and time when the resident will leave the property (moving date and time information) is registered in advance by the resident registration information receiving means 117 (step S200).

[0114] Next, the first authentication means 114 determines whether the date and time when the image of the resident was captured by the imaging device 20 in the property and the date and time of departure received by the resident registration information receiving means 117 satisfy a predetermined condition (step S210).

[0115] Here, if the first authentication means 114 determines that the date on which the resident's image was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time at which the resident's image was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period specified to include the move-out time has passed) (mismatch in date and time information; if the specified condition is not met), the first authentication means 114 will link the denial signal and the information regarding the mismatch in date and time information, or will not link them, and will not output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S220).

[0116] Next, the first authentication means 114 authenticates the resident (determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person) by comparing information about the facial image of the resident captured by the imaging device 20 with information about the facial image of the resident registered by the resident registration information receiving means 117 (step S230).

[0117] Here, if it is determined that the date on which a resident's image was captured by the imaging device 20 in the property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117, and the time at which the resident's image was captured by the imaging device 20 matches or is within the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (matching of date and time information; if a specified condition is met (if the move-out date and time has not passed)), the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, and if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links the permission signal and information related to the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S240).

[0118] On the other hand, if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 outputs a denial signal and does not output restriction lifting information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30, without linking the denial signal and information regarding the discrepancy between the date and time information or without linking them (step S250).

[0119] If restriction lifting information for lifting the restriction on entry into a specified area imposed by the entry restriction device 30 is not output, the usage suspension means 118 receives information regarding the suspension of use by a specific resident from the administrator terminal 60 (step S260), and thereafter does not authenticate the resident using the first authentication means 114 even if it receives information regarding the resident's facial image captured by the imaging device 20 (step S270).

[0120] In addition, when the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident (step S280), the receipt of the instruction to delete the registration information of the specific resident triggers the deletion of information regarding the facial image of the resident registered by the resident registration information receiving means 117 (step S290).

[0121] According to the system 1, program, and information processing method of the present embodiment configured as described above, the system 1 is equipped with an entrance restriction device 30 that selectively restricts entry into a predetermined area, an imaging device 20 that captures facial images of users whose entry into the predetermined area should be lifted from the restriction imposed by the entrance restriction device 30, and a computer 10. By executing the program, the system 1 functions as an agent registration means 111, a preview reservation acceptance means 113, an authentication means (first authentication means 114), and an entrance restriction lifting means (first entrance restriction lifting means 115). The agent registration means 111 registers identification information and information related to facial images of employees of the agent, and the preview reservation acceptance means 113 registers information related to the identification information and facial images of employees of the agent. The viewing reservation information includes the agent's identification information and viewing date and time information regarding the date and time of the viewing. The authentication means (first authentication means 114) authenticates the agent's employee by comparing information regarding the agent's facial image captured by the imaging device 20 with information regarding the agent's facial image registered by the agent registration means 111. The entry restriction release means (first entry restriction release means 115) releases the restriction on entry into the specified area imposed by the entry restriction device 30 when the agent's employee is authenticated by the authentication means (first authentication means 114) and the date and time the agent's employee was captured by the imaging device 20 and the viewing date and time in the viewing reservation information received by the viewing reservation receiving means 113 satisfy a predetermined condition. Conventionally, facial recognition technology has been known that can perform facial recognition using, for example, an authentication engine when visiting a facility such as an apartment complex for a viewing. However, conventional technology does not issue instructions to the entry restriction device based on the authentication of the agent's employee. According to the system 1, program, and information processing method of this embodiment, the facial images of the real estate agent's employees registered in the system 1 are compared with facial images taken on-site, and also with information regarding the date and time, thereby making it possible to lift restrictions on entry into a specified area based on the facial images of the real estate agent's employees and information regarding property viewing reservations.

[0122] Furthermore, in the system 1, the program, and the information processing method according to the present embodiment, as described above, the intermediary registration means 111 may generate facial image feature data. In this case, the system 1 can use facial image data that indicates the facial features of a person.

[0123] Furthermore, in the system 1, the program, and the information processing method according to the present embodiment, as described above, the feature amount data of the face image may be a set of pixel values ​​of pixels corresponding to the face image. In this case, the value of a pixel, which is the smallest element constituting the image, can be used, and it becomes easy to process the information possessed by the pixel, thereby facilitating image processing.

[0124] Furthermore, in the system 1, program, and information processing method according to the present embodiment, as described above, the intermediary registration means 111 may generate one of a hash value, a checksum, and binarized compressed data of the feature amount data of the facial image, which allows further processing of the image.

[0125] Furthermore, in the system 1, program, and information processing method according to the present embodiment, as described above, the authentication means (first authentication means 114) may detect the contours of each facial feature contained in the captured facial image of the agent's employee and the registered facial image of the agent's employee, based on pixel values ​​contained in information relating to the facial image of the agent's employee captured by the imaging device 20 and information relating to the facial image of the agent's employee registered by the agent registration means 111. In this case, it is possible to compare the facial images based on multiple facial features shown in the facial images, allowing for a detailed comparison.

[0126] Furthermore, in the system 1, program, and information processing method according to the present embodiment, as described above, the authentication means (first authentication means 114) may compare the contours of the detected captured facial image of the agent employee with those of the registered agent employee, and determine whether the person depicted in the captured facial image of the agent employee and the registered facial image of the agent employee are the same person based on the degree of similarity of the contours of the compared persons. In this case, authentication can be performed with a certain level of accuracy even if there are some changes in the face of the person being compared.

[0127] Furthermore, in the system 1, the program, and the information processing method according to the present embodiment, as described above, the authentication means (first authentication means 114) may perform authorization as authentication when it is determined that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person. In this case, the restriction can be lifted based on the degree of similarity.

[0128] Furthermore, in the system 1, the program, and the information processing method according to the present embodiment, as described above, the authentication means (first authentication means 114) may reject the authentication if it determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are not the same person. In this case, processing to maintain the regulation can be performed based on the degree of similarity.

[0129] The system 1 according to this embodiment is not limited to the above-described embodiment, and various modifications can be made.

[0130] For example, in this embodiment, even when the date and time information does not match, a determination is made as to whether the person depicted in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person, but in this case, such a determination does not need to be made. [Explanation of symbols]

[0131] 1: System 10: Computer 11: Control section 12: Storage section 13: Communications Department 20: Imaging device 21: Control unit 22: Imaging unit 23: Communications Department 30: Entry control device 31: Control unit 32: Storage section 33: Communications Department 40: Resident terminal 50: Broker terminal 60: Administrator terminal 110: Visitor registration information reception means 111: Intermediary registration means 112: Means for displaying available viewing dates and times 113: Viewing reservation acceptance method 114: First authentication method 115: First admission restriction release method 116: Warning notification means 117: Tenant registration information reception means 118:Means for suspending use 119: Resident registration information deletion method 120: Employee registration information deletion method 121: Visitor registration information deletion method 310: Second authentication method 311: Second admission restriction release method

Claims

1. an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; a storage unit in which information relating to facial images of employees of one or more intermediary agents is registered; A system comprising: The system functions as a real estate agent registration means, a viewing reservation acceptance means, an authentication means, and an admission restriction removal means by executing a program. The broker registration means registers in advance identification information of employees of one or more brokers based on instructions transmitted from the broker terminal, The preview reservation receiving means receives preview reservation information from the agent terminal, the preview reservation information including identification information of an employee of one or more agents and preview date and time information regarding the date and time of the preview; the authentication means performs authentication of the employee of the intermediary agency by comparing information about the facial image of the employee of the intermediary agency captured by the imaging device with information about the facial image of the employee of the intermediary agency that has been registered; The entry restriction lifting means lifts the restriction on entry into a specified area imposed by the entry restriction device when the authentication means authenticates an employee of the agent and successfully verifies that the person shown in the captured facial image of the agent employee and the registered facial image of the agent employee are the same person, and when the date and time the agent employee was photographed by the imaging device and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means meet specified conditions.

2. The intermediary registration means forms feature amount data of the facial image. The system of claim 1 .

3. the feature amount data of the face image is a set of pixel values ​​of pixels corresponding to the face image; The system of claim 2 .

4. the intermediary registration means forms one of a hash value, a checksum, and binarized compressed data of the feature amount data of the facial image; The system of claim 1 .

5. The authentication means detects contours of each facial part included in the captured facial image of the agent's employee and the registered facial image of the agent's employee based on pixel values ​​included in information on the facial image of the agent's employee captured by the imaging device and information on the facial image of the agent's employee registered by the agent registration means. The system of claim 1 .

6. The authentication means compares the contour lines of the detected captured facial image of the agent employee with those of the registered agent employee, and determines whether the person represented in the captured facial image of the agent employee and the registered agent employee are the same person based on the degree of similarity of the contour lines of the compared objects. The system of claim 5.

7. When the authentication means determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person, it performs the authentication and grants permission. The system of claim 6.

8. When the authentication means determines that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are not the same person, it denies the authentication. The system of claim 6.

9. The storage unit stores information regarding dates and times when the property is available for preview viewing, The system further functions as a preview available date and time presenting means by executing a program, When the preview available date and time presentation means receives preview application information from an employee of the agent registered by the agent registration means, it sends a display signal to the agent terminal to cause the agent terminal to display candidate preview available dates and times based on the preview available dates and times stored in the storage unit; The system described in claim 1, wherein the viewing reservation acceptance means accepts viewing reservation information including viewing date and time information regarding the date and time at which the viewing will take place, selected from the candidate viewing dates and times displayed on the agent's terminal, and identification information of an agent's employee, and stores the viewing date and time information in the accepted viewing reservation information in the memory unit.

10. an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; a storage unit in which information relating to facial images of employees of one or more intermediary agents is registered; A program that functions as a real estate agent registration means, a preview reservation acceptance means, an authentication means, and an admission restriction release means when executed by a control unit of the system having the above. The broker registration means registers in advance identification information of employees of one or more brokers based on instructions transmitted from the broker terminal, The preview reservation receiving means receives preview reservation information from the agent terminal, the preview reservation information including identification information of an employee of one or more agents and preview date and time information regarding the date and time of the preview; the authentication means performs authentication of the employee of the intermediary agency by comparing information about the facial image of the employee of the intermediary agency captured by the imaging device with information about the facial image of the employee of the intermediary agency that has been registered; The entry restriction lifting means is a program that lifts the restriction on entry into a specified area imposed by the entry restriction device when the authentication means authenticates an employee of the agent and successfully verifies that the person shown in the captured facial image of the agent employee and the registered facial image of the agent employee are the same person, and when the date and time the agent employee was photographed by the imaging device and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means meet specified conditions.

11. an entrance control device that selectively restricts entrance into a predetermined area; an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted; a storage unit in which information relating to facial images of employees of one or more intermediary agents is registered; An information processing method executed by a control unit of a system comprising: Identification information of employees of one or more intermediary agents is registered in advance based on instructions transmitted from the intermediary agent terminal; Accepting preview reservation information from the agent terminal, the preview reservation information including identification information of an employee of one or more agents and preview date and time information regarding the date and time of the preview; authenticating the agent's employee by comparing information about the face image of the agent's employee captured by the imaging device with information about the face image of the agent's employee registered; An information processing method in which an employee of a real estate agent is authenticated, and if it is successfully verified that the person shown in the captured facial image of the employee of the real estate agent and the person shown in the registered facial image of the employee of the real estate agent are the same person, and if the date and time when the employee of the real estate agent was photographed by the imaging device and the viewing date and time in the viewing reservation information satisfy specified conditions, the entry restriction device's restriction on entry into a specified area is lifted.

Images