Service providing device, service providing method, and program

Abstract

To provide a service providing device capable of reducing burdens on persons concerned with residents and staff members of a facility while securing safety of the residents of the facility.SOLUTION: A service providing device includes acquisition means and control means. The acquisition means acquires collation results between a face image of a visitor of a facility and pre-registered face images of one or more persons concerned each pre-registered as a person related to a resident of the facility. When the collation results indicate coincidence, the control means performs control for unlocking a gate of the facility, but when the collation results indicate non-coincidence, the control means performs control for notifying the pre-registered person concerned, of a possibility that a visitor not pre-registered has visited the facility.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a service providing device, a service providing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a facility visitor authentication system. The system according to Patent Document 1 has a storage unit that stores guardian information including characteristic information of the guardian, and resident information, which is information about the resident associated with the guardian. The system according to Patent Document 1 also has an authentication unit that compares the acquired visitor characteristic information with characteristic information included in the guardian information stored in the storage unit, and authenticates that the visitor is the guardian. The system according to Patent Document 1 also has an output unit that outputs information about the resident based on the resident information associated with the guardian authenticated by the authentication unit. The system according to Patent Document 1 also has an alarm unit that alarms the inside of the facility of the information about the resident output by the output unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-81449 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology disclosed in Patent Document 1, the acquired characteristic information of the visitor is compared with characteristic information included in the guardian information stored in a storage unit, and if the comparison result shows a match and the visitor is authenticated as a guardian, unlocking of the door is permitted. On the other hand, the technology disclosed in Patent Document 1 does not disclose that if the comparison result shows a mismatch, it simply does not permit unlocking but takes any action. Therefore, there is a risk that it will not be possible to reduce the burden on the resident's relatives (such as the resident's guardian) and facility staff while ensuring the safety of the resident when visiting the facility.

[0005] The purpose of the present disclosure has been made to solve such problems, and is to provide a service providing device, a service providing method, and a program that can ensure the safety of facility residents while reducing the burden on those related to the residents and facility staff. [Means for solving the problem]

[0006] The service providing device according to the present disclosure has an acquisition means for acquiring a matching result between a facial image of a visitor to a facility and pre-registered facial images of one or more related parties who are pre-registered as persons related to an occupant of the facility, and a control means for controlling unlocking of a gate of the facility when the matching result indicates a match, and for controlling notifying the pre-registered related parties that an unregistered visitor may have visited the facility when the matching result indicates a mismatch.

[0007] The service providing method according to the present disclosure obtains a matching result between a facial image of a visitor to a facility and pre-registered facial images of one or more related parties who are pre-registered as persons related to an occupant of the facility, and if the matching result indicates a match, performs control to unlock a gate of the facility, and if the matching result indicates a mismatch, performs control to notify the pre-registered related parties that an unregistered visitor may have visited the facility.

[0008] The program disclosed herein causes a computer to execute the steps of obtaining a matching result between a facial image of a visitor to a facility and pre-registered facial images of one or more related parties who are pre-registered as persons related to an occupant of the facility, and, if the matching result indicates a match, performing control to unlock the gate of the facility, and, if the matching result indicates a mismatch, performing control to notify the pre-registered related parties that an unregistered visitor may have visited the facility. Effect of the Invention

[0009] According to the present disclosure, it is possible to provide a service providing device, a service providing method, and a program that can ensure the safety of facility residents while reducing the burden on residents' relatives and facility staff. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating a configuration of a service providing device according to the present disclosure. [Diagram 2] 1 is a flowchart illustrating a service providing method executed by a service providing device according to the present disclosure. [Diagram 3] 1 is a diagram illustrating an example of a configuration of a service providing system according to the present disclosure. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a service providing device according to the present disclosure. [Diagram 5] 1 is a diagram illustrating an example of a functional configuration of a service providing device according to the present disclosure. [Figure 6] 1 is a flowchart illustrating an example of a process executed by a service providing system according to the present disclosure. [Figure 7] 1 is a flowchart illustrating an example of a process executed by a service providing system according to the present disclosure. [Figure 8] 13 is a diagram illustrating an example of a pre-registration image displayed when registration is performed by a related person registration unit according to the present disclosure. FIG. [Figure 9] 11 is a diagram illustrating an example of a display image that is displayed when a comparison result indicates a match in the present disclosure. [Figure 10] 11 is a diagram illustrating an example of a display image that is displayed when a comparison result indicates a mismatch in the present disclosure. FIG. [Figure 11] 13A and 13B are diagrams illustrating example inquiry images displayed by processing of a related party notification control unit according to the present disclosure. [Figure 12] 13 is a diagram illustrating an example of a display image that is displayed when the matching result indicates a mismatch and unlocking is permitted in the present disclosure. FIG. [Figure 13] 11A and 11B are diagrams illustrating examples of display images displayed by processing of a facility notification control unit according to the present disclosure. [Figure 14] 1 is a diagram illustrating an example of a functional configuration of a service providing device according to the present disclosure. [Figure 15] 10 is a flowchart illustrating an example of a process executed by a service providing device according to the present disclosure. [Figure 16] 13 is a diagram illustrating an example of a pre-registration image displayed when registration is performed by a related person registration unit according to the present disclosure. FIG. [Figure 17] 11 is a diagram illustrating a face registration image displayed when registration is performed by a related person registration unit according to the present disclosure; FIG. [Figure 18] 1 is a diagram illustrating an example of a functional configuration of a service providing device according to the present disclosure. [Figure 19] 1 is a flowchart illustrating an example of a process executed by a service providing system according to the present disclosure. [Figure 20] 13 is a diagram illustrating a visit schedule registration image displayed when registration is performed by a visit schedule registration unit according to the present disclosure. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary. In addition, although the following description will be made using the drawings, the drawings used in the description of a certain embodiment do not apply only to that embodiment. Each drawing may be applied to all embodiments.

[0012] (Embodiment 1) 1 is a diagram showing a configuration of a service providing device 1 according to the present disclosure. The service providing device 1 has an acquisition unit 12 and a control unit 14. The acquisition unit 12 has a function as an acquisition means. The control unit 14 has a function as a control means. With these components, the service providing device 1 provides services to persons related to the residents of the facility and staff of the facility.

[0013] The service providing device 1 may be realized by a computer. The service providing device 1 may be realized by, for example, cloud computing. The service providing device 1 may also be realized by, for example, a plurality of computers communicably connected to each other. The components of the service providing device 1 may also be distributed and realized on a plurality of computers. That is, the computer that realizes the acquisition unit 12 and the computer that realizes the control unit 14 may be physically separate. The functions of each of the plurality of components may also be realized by a plurality of computers.

[0014] FIG. 2 is a flowchart showing a service providing method executed by the service providing device 1 according to the present disclosure. The acquisition unit 12 acquires a result of matching between a face image of a visitor to the facility and face images registered in advance of one or more related persons who are registered in advance as persons related to the facility's resident (step S12). Here, in the present disclosure, a "facility" is a place where one or more persons enter as residents and where staff members take care of the residents. The facility may be, for example, a nursery school, kindergarten, childcare center, or child welfare facility, which takes in children temporarily or for a predetermined period and provides care (education, childcare, and care, etc.). In this case, the residents of the facility are, for example, kindergarteners. The facility may also be, for example, a school, a cram school, or an educational facility (for example, a facility that teaches academics, sports, music, etc.), which takes in children temporarily and provides care (education, etc.). In this case, the residents of the facility are, for example, students. The facility may also be a place that provides short-term or long-term care (nursing, care, assistance, etc.) for elderly or disabled people, such as a welfare facility for the elderly, a nursing home, a nursing home, an elderly facility, or a welfare facility for disabled people. In this case, the residents of the facility are, for example, elderly people. The facility may also be a medical facility such as a hospital or a clinic. In this case, the residents of the facility are, for example, patients, such as hospitalized patients.

[0015] Moreover, a "visitor" refers to a person who visits a facility. Specifically, a visitor refers to a person who visits a specific resident of the facility. "Visiting" corresponds to visiting a facility to meet a resident of the facility. For example, if the "facility" is a facility that temporarily takes care of residents, such as a nursery school or an educational facility, "visiting" corresponds to coming to pick up the resident. In this case, the visitor may be a person who comes to pick up the resident. Furthermore, if the "facility" is a facility that continuously provides long-term care to residents, such as a medical facility or a nursing home, "visiting" corresponds to visiting the facility to meet with the resident. In this case, the visitor may be a visitor who meets with the resident. Furthermore, "visiting a facility" corresponds to the act of calling a staff member of the facility to visit a resident of the facility. For example, "visiting a facility" includes calling a staff member by operating an intercom system installed in the facility.

[0016] Furthermore, a "person related to a facility resident" may be a person who may visit the resident. For example, if the "facility" is a facility that temporarily takes care of the resident, a "person related to a facility resident" corresponds to a person who may pick up the resident. For example, if the "facility" is a facility that continuously provides long-term care for the resident, a "person related to a facility resident" corresponds to a person who may meet the resident. Furthermore, a "related person" corresponds to, for example, the above-mentioned person who picks up or visits the resident. A "related person" may be, for example, the guardian, parent, grandparent, family member, or relative of the resident. A "related person" may be, for example, a representative other than a relative of the resident, such as a pick-up service staff member or an adult guardian.

[0017] In addition, in the present disclosure, a "face image" corresponds to an image in which a person's face is photographed. In other words, the face image includes the person's face. Note that the "face image" may mean image data indicating a face image that is the subject of information processing. Furthermore, a "face image of a visitor to a facility" is acquired, for example, by a photographing device capable of photographing the visitor's face. The photographing device is, for example, a camera installed on the gate or the like of the facility, but is not limited to this. The photographing device corresponds to the photographing device 30 described later. The photographing device may be installed in an intercom system. The photographing device will be described later.

[0018] Furthermore, the "pre-registered face image" corresponds to a face image of a related person, that is, a person who may visit the facility. The "pre-registered face image" may be registered in advance, for example, by a related person of the resident. Furthermore, the "matching result" corresponds to a determination result as to whether or not two or more face images match each other. The "matching result" is generated, for example, by a face recognition device equipped with a face recognition system that performs face recognition, but is not limited to this. The face recognition device corresponds to face recognition device 50, which will be described later. The face recognition device will be described later.

[0019] If the collation result indicates a match (YES in step S14), the control unit 14 performs control for unlocking the gate of the facility (step S16). Note that "control for unlocking the gate of the facility" may include, for example, automatically releasing the lock of the gate by electronic control. Also, "control for unlocking the gate of the facility" may include, for example, notifying a staff member of the facility to manually unlock the gate.

[0020] On the other hand, if the comparison result indicates a mismatch (NO in S14), the control unit 14 performs control to notify the pre-registered related party that a visitor not registered in advance may have visited the facility (step S18). Specifically, the control unit 14 may perform control to send a notification indicating that a visitor not registered in advance may have visited the facility to a terminal owned by the pre-registered related party. The terminal is, for example, but is not limited to, a smartphone, a mobile phone, or a tablet terminal. The terminal corresponds to the related party terminal device 40 described later.

[0021] The service providing device 1 according to the present disclosure, configured as described above, can reduce the burden on the people related to the resident and the staff of the facility while ensuring the safety of the resident. That is, if the face image collation result shows a mismatch, the visitor may be a suspicious person whose identity is unknown. For example, the visitor may be a person impersonating a guardian. If the gate is unlocked in such a case, the safety of the resident may not be ensured.

[0022] On the other hand, if the face image matching result shows a mismatch, the visitor may be a person who visited the facility at the request of a related person who was registered in advance. For example, if the facility is a nursery school, etc., the grandparents of the child who is a resident may have come to pick up the child at the request of the guardian (mother, etc.) who was registered in advance. In such a case, if the gate is always kept unlocked, there is a risk that a legitimate visitor to the resident will not be able to visit the resident smoothly. In other words, the staff may need to take actions such as responding to the visitor, asking about the situation, and contacting the related person who requested the visitor to confirm the legitimacy. In addition, the related person such as the guardian will also need to explain the situation to the staff when contacted by the staff. This may increase the burden on the related person of the resident and the staff of the facility.

[0023] In response to this, the service providing device 1 according to the present disclosure notifies the pre-registered related party that a visitor not registered in advance may have visited the facility when the comparison result indicates a mismatch. As a result, the related party who has received the notification can permit the unlocking of the gate if the visitor is a person whom the related party has requested to visit. Therefore, a visitor who has legitimately visited the resident can smoothly visit the resident. Therefore, it is possible to reduce the burden on the related party of the resident and the facility staff. On the other hand, the related party who has received the notification can not permit the unlocking of the gate if the visitor is a stranger. As a result, the facility staff can prevent a person who may be a suspicious person from entering the facility, so that the safety of the resident can be ensured. Therefore, it is possible to reduce the burden on the related party of the resident and the facility staff while ensuring the safety of the resident.

[0024] As described below, a service providing system including the service providing device 1 can also ensure the safety of the facility residents while reducing the burden on those related to the residents and the facility staff. A service providing method executed by the service providing device 1 can also ensure the safety of the facility residents while reducing the burden on those related to the residents and the facility staff. A program executing the service providing method can also ensure the safety of the facility residents while reducing the burden on those related to the residents and the facility staff.

[0025] (Embodiment 2) Next, the second embodiment will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same reference numerals, and repeated explanations are omitted as necessary.

[0026] 3 is a diagram illustrating a configuration of a service providing system 20 according to the present disclosure. The service providing system 20 has one or more image capturing devices 30, one or more facility terminal devices 32, one or more related party terminal devices 40, one or more face authentication devices 50, and a service providing device 100. The image capturing devices 30, the facility terminal devices 32, the related party terminal devices 40, the face authentication devices 50, and the service providing device 100 each have a function as, for example, a computer.

[0027] The photographing device 30, the facility terminal device 32, the related party terminal device 40, the face authentication device 50, and the service providing device 100 are communicatively connected via a network. The network may be, for example, a wireless network or a wired network. That is, the service providing device 100 is connected to the photographing device 30, the facility terminal device 32, the related party terminal device 40, and the face authentication device 50 wirelessly or wired. The wireless network may be, for example, a network using a communication line standard such as LTE (Long Term Evolution), or a network used in a specific area such as WiFi (registered trademark) or local 5G. The wired network may be, for example, a LAN (Local Area Network) or optical fiber.

[0028] The photographing device 30 is, for example, a camera. The photographing device 30 photographs a subject and generates image data showing the photographed image. The image data may show a still image or may show a moving image. As described above, the photographing device 30 may be installed, for example, at the entrance or gate of a facility. In this case, the photographing device 30 may be built into an entrance slave of an intercom system installed in the facility. In this case, the photographing device 30 may start photographing when a visitor to the facility operates the entrance slave. In the present disclosure, the photographing device 30 photographs a visitor and generates a photographed image in which at least the visitor's face is photographed. Then, the photographing device 30 transmits the photographed image (image data) in which the visitor's face is photographed to the service providing device 100. At this time, the photographing device 30 may transmit the photographed image (image data) to the service providing device 100 together with identification information of the facility in which the photographing device 30 is installed. The identification information of the facility may indicate, for example, the address of the facility or an identification number assigned to each facility.

[0029] Facility terminal device 32 is a terminal provided in the facility. For example, facility terminal device 32 may be provided in any location in the facility (such as a management office) or may be carried by a staff member. Facility terminal device 32 presents necessary information to the staff member. Facility terminal device 32 may be a PC (Personal Computer) such as a desktop computer or a laptop computer. Facility terminal device 32 may also be, for example, a smartphone, a mobile phone, a tablet terminal, a smart watch, or a wearable device. Facility terminal device 32 may also be incorporated in, for example, an intercom system provided in the facility. In this case, facility terminal device 32 may be, for example, a room master unit of the intercom system.

[0030] The related person terminal device 40 is a terminal owned by a related person (such as a guardian) of the resident. For example, the related person terminal device 40 may be carried by a user who is a related person. The related person terminal device 40 presents necessary information to the related person. The related person terminal device 40 may be, for example, a smartphone, a mobile phone, a tablet terminal, a smart watch, or a wearable device. The related person terminal device 40 may also be a PC (Personal Computer) such as a desktop computer or a laptop computer.

[0031] The face recognition device 50 performs a comparison as to whether at least two face images show the face of the same person. The face recognition device 50 may perform the comparison based on, for example, the positions of feature points such as the eyes, nose, and mouth, the position of the face area, and the size of the face area in each of the two face images. For example, the face recognition device 50 may calculate the degree of match between the two face images. Then, the face recognition device 50 may generate a comparison result based on the calculated degree of match. If the degree of match is equal to or greater than a predetermined threshold, the face recognition device 50 may generate a comparison result of "match" indicating that the faces shown by the two face images are the faces of the same person. On the other hand, if the degree of match is less than a predetermined threshold, the face recognition device 50 may generate a comparison result of "mismatch" indicating that the faces shown by the two face images are not the faces of the same person. The face recognition device 50 may perform the comparison using, for example, a machine learning algorithm.

[0032] In the present disclosure, the face authentication device 50 acquires a photographed image including a face image of a visitor photographed by the photographing device 30. The face authentication device 50 also acquires one or more registered face images from the service providing device 100. Here, the "registered face image" refers to a face image registered in advance. Each of the "registered face images" is obtained by previously registering a face image of a related person registered in advance in the service providing device 100. The face authentication device 50 may store one or more registered face images registered by the service providing device 100 in advance. The face authentication device 50 compares the photographed image (the face image of the visitor) with one or more registered face images (face images registered in advance). The face authentication device 50 generates a comparison result based on the calculated degree of match. When the calculated degree of match is equal to or greater than a predetermined threshold, the face authentication device 50 generates a comparison result indicating "match". On the other hand, when the calculated degree of match is less than a predetermined threshold, the face authentication device 50 generates a comparison result indicating "mismatch". In this way, the face authentication device 50 generates a matching result between the face image of the facility visitor and the face image registered in advance. If the face image of the facility visitor shows the same person as the face image registered in advance, the face authentication device 50 may generate a matching result indicating "match." On the other hand, if the face image of the facility visitor shows a person different from the face image registered in advance, the face authentication device 50 may generate a matching result indicating "mismatch." The face authentication device 50 transmits the generated matching result to the service providing device 100.

[0033] In addition, when there are multiple registered face images, the face authentication device 50 may compare each of the multiple registered face images (pre-registered face images) with the captured image (visitor's face image). Then, the face authentication device 50 may generate a comparison result between each of the multiple registered face images (pre-registered face images) and the captured image (visitor's face image). Then, the face authentication device 50 may transmit the multiple comparison results to the service providing device 100.

[0034] The service providing device 100 corresponds to the service providing device 1 shown in FIG. 1. The service providing device 100 may be, for example, a server. The service providing device 100 may be, for example, an information terminal. The service providing device 100 may be realized by, for example, cloud computing. The service providing device 100 may be realized by, for example, a plurality of computers connected to each other so as to be able to communicate with each other. Each component of the service providing device 100 described later may be realized by a plurality of computers.

[0035] Any of a plurality of devices constituting the service providing system 20 may be physically integrated. For example, the photographing device 30 and the facility terminal device 32 may be physically integrated. The photographing device 30 and the face authentication device 50 may be physically integrated. The photographing device 30 and the service providing device 100 may be physically integrated. The facility terminal device 32 and the service providing device 100 may be physically integrated. The face authentication device 50 and the service providing device 100 may be physically integrated. The photographing device 30, the facility terminal device 32 and the service providing device 100 may be physically integrated. The photographing device 30, the face authentication device 50 and the service providing device 100 may be physically integrated. The photographing device 30, the facility terminal device 32 and the service providing device 100 may be physically integrated. The photographing device 30, the face authentication device 50 and the service providing device 100 may be physically integrated. The related party terminal device 40 and the service providing device 100 may be physically integrated.

[0036] 4 is a diagram illustrating a hardware configuration of the service providing device 100 according to the present disclosure. As shown in FIG. 4, the service providing device 100 has a control unit 102, a storage unit 104, a communication unit 106, and an interface unit 108 (IF; Interface) as main hardware components. The control unit 102, the storage unit 104, the communication unit 106, and the interface unit 108 are connected to each other via a data bus or the like. Note that the above-mentioned photographing device 30, the facility terminal device 32, the related party terminal device 40, and the face authentication device 50 may also have the hardware configuration of the service providing device 100 shown in FIG. 4.

[0037] The control unit 102 is a processor such as a CPU (Central Processing Unit). The control unit 102 has a function as a calculation device that performs control processing and calculation processing. The control unit 102 may have multiple processors. The storage unit 104 is a storage device such as a memory or a hard disk. The storage unit 104 is a read only memory (ROM) or a random access memory (RAM). The storage unit 104 has a function for storing a control program and a calculation program executed by the control unit 102. That is, the storage unit 104, which is a memory, stores one or more instructions. The storage unit 104 also has a function for temporarily storing processing data and the like. The storage unit 104 may include a database. The storage unit 104 may also have multiple memories.

[0038] The communication unit 106 performs processing required for the service providing device 100 to communicate with other devices via a network. The communication unit 106 may include a communication port, a router, a firewall, and the like. The interface unit 108 (IF; Interface) is, for example, a user interface (UI). The interface unit 108 has an input device such as a keyboard, a touch panel, or a mouse, and an output device such as a display or a speaker. The interface unit 108 may be configured such that the input device and the output device are integrated, such as a touch screen or a touch panel. The interface unit 108 accepts data input operations by a user such as an operator or a worker, and outputs information to the user.

[0039] FIG. 5 is a diagram illustrating a functional configuration of the service providing device 100 according to the present disclosure. The service providing device 100 has, as components, a related person registration unit 120, a related person information storage unit 122, a photographed image acquisition unit 130, a face image transmission unit 132, a matching result acquisition unit 140, and a matching result determination unit 142. The service providing device 100 also has, as components, a service provision control unit 150. The service provision control unit 150 also has an unlocking control unit 152, a related person notification control unit 154, a registration control unit 156, and a facility notification control unit 158. As described above, the service providing device 100 does not need to be physically configured as one device. In this case, each of the above-mentioned components may be realized by multiple physically separate devices. These are the same in other embodiments described later.

[0040] The service providing device 100 provides a service according to the result of matching the face image of the visitor to the facility with the face image registered in advance by these components. Furthermore, when the matching result shows a match, the service providing device 100 controls the unlocking of the gate of the facility by these components. Furthermore, when the matching result shows a mismatch, the service providing device 100 controls the notification of at least one person registered in advance as a related person that a visitor not registered in advance may have visited the facility by these components. Furthermore, the service providing device 100 may provide a service to related persons of the resident of the facility and the staff of the facility by using, for example, a web application. Furthermore, the service providing device 100 may provide similar services to each of a plurality of facilities. In this case, the above-mentioned photographing device 30 may be provided in each of the plurality of facilities. Similarly, the above-mentioned facility terminal device 32 may be provided in each of the plurality of facilities. These are also the same in other embodiments described later.

[0041] The related person registration unit 120 functions as related person registration means. The related person information storage unit 122 functions as related person information storage means. The captured image acquisition unit 130 functions as captured image acquisition means. The facial image transmission unit 132 functions as facial image transmission means. The matching result acquisition unit 140 functions as matching result acquisition means (acquisition means). The matching result determination unit 142 functions as matching result determination means. The service provision control unit 150 functions as service provision control means (control means). The unlocking control unit 152 functions as unlocking control means. The related person notification control unit 154 functions as related person notification control means. The registration control unit 156 functions as registration control means. The facility notification control unit 158 ​​functions as facility notification control means.

[0042] Each of the above-mentioned components can be realized, for example, by executing a program under the control of the control unit 102. More specifically, each of the components can be realized by the control unit 102 executing a program (instruction) stored in the storage unit 104. Also, each of the components may be realized by recording a necessary program in an arbitrary non-volatile recording medium and installing it as necessary. Also, each of the components may be realized not only by software by a program, but also by a combination of hardware, firmware, and software. Also, each of the components may be realized by using an integrated circuit that can be programmed by a user, such as an FPGA (field-programmable gate array) or a microcomputer. In this case, a program composed of each of the above-mentioned components may be realized by using this integrated circuit. The same applies to other embodiments described later.

[0043] The related person registration unit 120 registers a person (related person) related to an occupant of the facility. Here, as described above, the related person to be registered is a person who may visit an occupant related to the person. The related person registration unit 120 also registers at least a facial image of the related person in advance before the visit. The related person registration unit 120 also registers related person information related to the related person. The related person registration unit 120 may register the related person information in association with information of an occupant related to the corresponding related person (entrant information). For example, in the case where the facility is a facility (such as a nursery school) that temporarily takes care of children, the related person registration unit 120 registers at least a facial image of a person (such as a guardian) who may pick up the occupant in advance in association with the occupant. The occupant information may include, for example, a facial image of the occupant, the name of the occupant, and identification information of the occupant.

[0044] Furthermore, the related person registration unit 120 may register each of a plurality of related persons related to an entrant. In this case, the related person registration unit 120 registers in advance at least a facial image of each of a plurality of related persons related to an entrant. For example, if the facility is a facility (such as a nursery school) that temporarily looks after children, the related person registration unit 120 registers in advance at least a facial image of each of a plurality of people (such as parents, grandparents, representatives, etc.) who may be coming to pick up the entrant, in association with the entrant.

[0045] By registering a plurality of related parties associated with a certain resident, when any of the registered related parties visits the facility, the matching result between the facial image of the visitor to the facility and the facial image registered in advance can show a match. That is, when the facility is a facility (such as a nursery school) that temporarily takes care of children, the matching result can show a match in both cases where the mother picks up the child and where the father picks up the child. Therefore, since only one specific related party does not need to visit the facility, the burden on the related party can be reduced. Also, when any of the registered related parties visits the facility, the gate can be unlocked. Therefore, the staff can smoothly deal with the visiting related party. Therefore, the burden on the staff is reduced.

[0046] The related person registration unit 120 registers related person information in advance through an operation by a related person. The related person registration unit 120 may register the related person information through a website, for example. Specifically, the related person registration unit 120 makes a website for registering related person information (such as facial images) viewable on the related person's terminal (related person terminal device 40). The related person operates the terminal to upload the related person information on the website. Note that when multiple related persons related to a certain resident are registered, one of the multiple related persons may upload the related person information (such as facial images) of all the related persons on behalf of the multiple related persons. In other words, the related person registration unit 120 may register facial images of multiple related persons in response to an operation on the terminal (related person terminal device 40) of a representative (first related person) of multiple related persons related to a certain resident.

[0047] The related party information includes at least a facial image (registered facial image). The related party information may also include personal information of the related party (name, telephone number, address, etc.). The related party information may also include relationship information indicating the relationship with the resident. Here, the related party related to the related party information registered in the related party registration unit 120 can be said to be a related party registered in advance. And the related party information registered in the related party registration unit 120 can be said to be information related to a related party registered in advance. In this way, by registering at least the facial image of the related party in advance, the service providing system 20 can verify whether or not a person who actually visits the facility is a legitimate visitor.

[0048] Furthermore, the related person registration unit 120 may register information that proves the relationship between the related person corresponding to the related person information and the resident as the relationship information. That is, the related person information may include the relationship information. And the relationship information may include the certification information. Furthermore, the related person registration unit 120 may determine the authenticity of the face image using the certification information. This makes it possible to prove that the face image included in the related person information truly shows the face of the related person. The certification information may be information recorded on an official certificate. The official certificate may be, for example, an identification card such as a resident's card, a passport, a driver's license, or a personal identification number card. Such a configuration makes it possible to prevent impersonation by a third party other than the related person.

[0049] The related party information may also include identification information of the related party. The identification information may be used, for example, to provide information to the related party. The identification information may, for example, indicate an account for using a web application provided by the service providing device 100. The identification information may also indicate identification information of the related party terminal device 40 owned by the related party. The identification information may also indicate an ID of a message application of the related party. The message application may, for example, be an email or a social networking service (SNS). The "message application ID" may, for example, be an email address.

[0050] The related person information storage unit 122 stores the related person information registered by the related person registration unit 120. The related person information storage unit 122 may store the related person information using the memory unit 104. The related person information storage unit 122 may store the related person information in association with the resident information of the resident related to the related person corresponding to the related person information.

[0051] The service providing device 100 may perform control so that the information stored in the related person information storage unit 122 is displayed on the facility terminal device 32. In this case, the service providing device 100 may perform control so that the facility terminal device 32 displays the related person information when a new related person is registered by the related person registration unit 120. Furthermore, the service providing device 100 may perform control so that the related person information can be viewed on the facility terminal device 32 in response to a request from the facility terminal device 32. Furthermore, the service providing device 100 may perform control so that the information stored in the related person information storage unit 122 is displayed on the related person terminal device 40. In this case, the service providing device 100 may perform control so that the related person information corresponding to the related person related to the related person terminal device 40 can be viewed on the related person terminal device 40.

[0052] The photographed image acquisition unit 130 acquires a photographed image associated with the identification information of the facility from the photographing device 30. The face image transmission unit 132 transmits the photographed image acquired from the photographing device 30 to the face authentication device 50 as a face image of a visitor to the facility. The face image transmission unit 132 may also transmit a face image (registered face image) registered by the related person registration unit 120 to the face authentication device 50 together with the identification information of the related person of the registered face image. Specifically, the face image transmission unit 132 may transmit a registered face image included in related person information related to a resident of the facility associated with the photographed image to the face authentication device 50. At this time, the face image transmission unit 132 may transmit a registered face image included in related person information related to all residents of the facility to the face authentication device 50. In other words, the face image transmission unit 132 may transmit the registered face images of all related persons registered for the facility to the face authentication device 50. With such a configuration, the face authentication device 50 can compare the captured image (the visitor's face image) with each of all registered face images (face images registered in advance).

[0053] The matching result acquisition unit 140 corresponds to the acquisition unit 12 in FIG. 1 described above. The matching result acquisition unit 140 receives the matching result between the face image shown in the photographed image and the registered face image from the face authentication device 50. That is, the matching result acquisition unit 140 acquires the matching result between the face image of the visitor to the facility and the face image registered in advance. When there are multiple registered face images, the matching result acquisition unit 140 may receive the matching result between the face image shown in the photographed image and each of the multiple registered face images from the face authentication device 50. In this case, the matching result acquisition unit 140 acquires multiple matching results between the face image of the visitor to the facility and the face images registered in advance. Note that the matching result may include identification information of a related person of the registered face image used for matching.

[0054] The matching result determination unit 142 determines whether the acquired matching result indicates a "match" or a "mismatch." When multiple matching results are acquired, the matching result determination unit 142 may determine whether the acquired matching result indicates a "match" or a "mismatch" for each of the multiple matching results. Furthermore, the matching result determination unit 142 may determine that the person involved, who corresponds to the registered face image related to the matching result that indicates a "match" and has the highest degree of match among the multiple matching results, is the person involved who visited the facility.

[0055] In addition, when there are multiple registered face images, the face authentication device 50 may transmit the matching result having the highest degree of matching, which is equal to or greater than a predetermined threshold, among the multiple matching results together with the identification information on the registered face image corresponding to the matching result to the service providing device 100. In this case, the matching result acquisition unit 140 may acquire one matching result.

[0056] The service provision control unit 150 corresponds to the control unit 14 in FIG. 1 described above. The service provision control unit 150 performs control to provide services according to the collation results to the staff of the facility and to people related to the residents of the facility. Specifically, the service provision control unit 150 transmits a command required to provide the service to the staff to the facility terminal device 32. This allows the facility terminal device 32 to execute a predetermined service. For example, when the service provision control unit 150 causes the facility terminal device 32 to execute an operation, the service provision control unit 150 transmits a command to the facility terminal device 32 to execute the operation. Furthermore, when the service provision control unit 150 causes the facility terminal device 32 to display an image, the service provision control unit 150 transmits a command to the facility terminal device 32 to display the image.

[0057] Similarly, the service provision control unit 150 transmits commands necessary to provide services to related parties associated with the resident to the related party terminal device 40, using the identification information included in the related party information. This allows a specified service to be executed in the related party terminal device 40. For example, when the service provision control unit 150 causes the related party terminal device 40 to execute an operation, it transmits a command to execute the operation to the related party terminal device 40. Furthermore, when the service provision control unit 150 causes the related party terminal device 40 to display an image, it transmits a command to the related party terminal device 40 to display the image.

[0058] If the matching result indicates a match, the service provision control unit 150 performs control to unlock the gate of the facility. This will be described in detail later. Note that "if the matching result indicates a match" corresponds to a case where it is determined that the visitor's facial image matches at least one of a plurality of registered facial images. At this time, the service provision control unit 150 may perform control to cause the facility terminal device 32 to display the matching result, related party information of the related party who is the visitor, and resident information of the resident related to the related party who is the visitor. Note that the "related party who is the visitor" refers to the related party whose registered facial image has been matched with the visitor's facial image.

[0059] On the other hand, if the matching result indicates a mismatch, the service provision control unit 150 performs control to notify pre-registered related parties that a visitor not pre-registered may have visited the facility. This will be described in detail later. Note that "if the matching result indicates a mismatch" corresponds to a case where it is determined that the visitor's facial image does not match any of the multiple registered facial images.

[0060] The unlocking control unit 152 performs control for unlocking the gate of the facility when the collation result indicates a match. Even when the collation result indicates a mismatch, the unlocking control unit 152 may perform control for unlocking the gate of the facility when unlocking is permitted by the relevant person, as described below. The unlocking control unit 152 may, for example, unlock the gate by electronic control. In this case, the unlocking control unit 152 may unlock the gate by transmitting a control signal to the locking mechanism of the gate.

[0061] Alternatively, for example, the unlocking control unit 152 may notify the staff of the facility to unlock the gate. In this case, the unlocking control unit 152 may control to notify the staff by a method such as image display, audio output, lighting of a light, etc. For example, the unlocking control unit 152 may control to display a message urging the staff to unlock the gate on the facility terminal device 32. When the staff visually checks the message displayed on the facility terminal device 32 urging the staff to unlock the gate, the staff can perform an action to unlock the gate. Note that the service provision control unit 150 may control to display related party information corresponding to the related party who visited the facility and resident information of the resident related to the related party on the facility terminal device 32 together with the message urging the staff to unlock the gate. This allows the staff to easily understand which related party visited which resident.

[0062] When the matching result shows a mismatch, the related person notification control unit 154 performs control to notify the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility. Specifically, the related person notification control unit 154 performs control to display a notification indicating that a visitor who is not registered in advance may have visited the facility on the related person terminal device 40. Furthermore, when the matching result shows a mismatch, the related person notification control unit 154 performs control to display a face image of the visitor who visited the facility on the related person terminal device 40. With this configuration, the related person can easily know that a visitor who is not registered in advance may have visited the facility and the face image of the visitor without the staff of the facility notifying them. Then, the related person can easily know whether the visitor is an acquaintance of the related person by visually checking the face image of the visitor. This makes it possible to improve the convenience of the related person and the staff.

[0063] Furthermore, when the collation result indicates a mismatch, the related person notification control unit 154 performs control to ask the related person whether to permit unlocking of the gate. Specifically, the related person notification control unit 154 performs control to display an inquiry image, which is an image for inquiring whether to permit unlocking of the gate, on the related person terminal device 40. The inquiry image may include, for example, a message asking whether to permit unlocking of the gate and an operation image (permission operation image) for permitting unlocking. Furthermore, when permitting unlocking, the inquiry image may include a name input operation image for inputting the name of the visitor and a relationship input operation image for inputting relationship information indicating the relationship between the visitor and the resident. Furthermore, the inquiry image may include an operation image for not permitting unlocking (non-permission operation image).

[0064] The "operation image" is an image that is displayed on the user interface (UI) of a terminal (stakeholder terminal device 40) and that allows the terminal to perform some function by operating the operation image. The "operation image" includes, for example, an operation button displayed on the user interface of the terminal. When the user (stakeholder) operates the button, some operation is executed. An "operation" is, for example, an operation such as pressing, clicking, touching, or tapping on an operation image (such as an operation button) displayed on the user interface by the user (stakeholder).

[0065] By visually checking the inquiry image, the relevant person can determine whether or not the visitor of the displayed face image is authorized to visit the facility, even though the face image has not been registered in advance. For example, if the visitor is a person who the relevant person himself requested to visit the facility (such as picking up the visitor), the relevant person can determine that the visitor's visit to the facility is authorized. Also, if the visitor is a family member or acquaintance of the relevant person, the relevant person can determine that the visitor's visit to the facility is authorized. With this configuration, the relevant person can inform the facility that the visitor's visit to the facility is authorized. This allows the staff to take appropriate measures against the visitor even if the matching result shows a mismatch. This makes it possible to improve the convenience of the relevant person and the staff.

[0066] Furthermore, if the person concerned judges that the visitor is legitimate to visit the facility, the person concerned can operate the permission operation image. In this case, the person concerned terminal device 40 transmits permission information indicating that unlocking is permitted to the service providing device 100. By receiving the permission information, the unlocking control unit 152 performs control to unlock the gate. With this configuration, a legitimate visitor can smoothly visit the facility even if he / she is not registered in advance. Furthermore, the person concerned does not need to inform the facility that a person not registered in advance will visit the facility. Furthermore, the staff of the facility can appropriately deal with the legitimate visitor even if the collation result shows a mismatch. This makes it possible to improve the convenience of the person concerned and the staff.

[0067] Also, when the related person operates the permission operation image, the related person may operate the name input operation image to input the name of the visitor. Also, the related person may operate the relationship input operation image to input the name of the resident related to the visitor and the relationship between the resident and the visitor. In such a case, the permission information may include identification information of the related person who has authorized the unlocking, the name of the visitor, and relationship information between the visitor and the resident. When the service providing device 100 receives the permission information from any of the related person terminal devices 40, the unlocking control unit 152 performs control to unlock the gate of the facility. Also, in this case, the registration control unit 156 described later operates.

[0068] On the other hand, if the related person does not determine that the visitor's visit to the facility is legitimate, the related person can prevent the related person from operating the permitted operation image. In this case, the related person may operate the disallowed operation image. In this case, the related person terminal device 40 transmits information indicating that unlocking is not permitted (disallowed information) to the service providing device 100. In this case, the facility notification control unit 158 ​​described later operates.

[0069] The registration control unit 156 performs control to newly register the face image of the visitor when the matching result indicates a mismatch and unlocking of the gate is permitted. As a result, the related person registration unit 120 newly registers the face image of the visitor. Specifically, the registration control unit 156 performs control to newly register the face image of the visitor as the face image of a related person related to the facility resident when unlocking of the gate is permitted. In addition, the registration control unit 156 performs control to register the visitor as a related person related to the facility resident using permission information including the visitor's name and related information. As a result, the related person registration unit 120 registers the visitor as a related person related to the facility resident. With this configuration, even if the visitor has not been registered as a related person in advance, the visitor can be efficiently registered as a related person. Therefore, the convenience of the related person is improved.

[0070] In addition, due to problems such as the accuracy of matching and the clarity of the face image in the captured image, even if a related person who has been registered in advance visits, the matching result between the captured face image and the registered face image of the related person may not show a match. Even in such a case, the above-mentioned configuration allows the related person to visit the facility smoothly. Furthermore, the registration control unit 156 can perform control so that the face image of the visitor who has been registered in advance but for which the matching result shows a mismatch is added to the previously registered face image and registered. This allows the related person registration unit 120 to newly register the visitor's face image as another face image of the related person who has been registered in advance. This can improve the accuracy of matching.

[0071] When the result of the comparison indicates a mismatch and unlocking of the gate is not permitted, the facility notification control unit 158 ​​performs control to notify the facility that unlocking of the gate is not permitted. Specifically, when unlocking is not permitted within a predetermined time after the related person notification control unit 154 notifies the related person, the facility notification control unit 158 ​​performs control to notify that unlocking is not permitted. The "predetermined time" may be about several minutes (for example, 5 minutes). The facility notification control unit 158 ​​performs control to notify the facility when permission information is not received from any related person terminal device 40 before a predetermined time has elapsed since a notification inquiring whether or not to permit unlocking of the gate is sent to the related person terminal device 40. The facility notification control unit 158 ​​may also perform control to notify the facility when non-permission information is received from all related person terminal devices 40 of the related person even within a predetermined time after the related person notification control unit 154 notifies the related person.

[0072] At this time, the facility notification control unit 158 ​​may control the facility terminal device 32 to display a message indicating that unlocking was not permitted. The service provision control unit 150 may also cause the facility terminal device 32 to display a message indicating that an inquiry is being made as to whether unlocking is permitted until a predetermined time has elapsed since the related person notification control unit 154 notifies the related person. With this configuration, the facility staff can take appropriate measures when the matching result shows a mismatch and unlocking of the gate is not permitted. For example, the staff can ask the visitor what kind of person the visitor is, while recognizing that the visitor may be a suspicious person. This allows the staff to deal with the visitor smoothly.

[0073] 6 and 7 are flowcharts showing an example of processing executed by the service providing system 20 according to the present disclosure. FIG. 6 and FIG. 7 show a service providing method executed by the service providing system 20 according to the present disclosure. FIG. 6 and FIG. 7 can be mainly executed by the service providing device 100. Note that, when each component shown in FIG. 5 is realized by cloud computing or a plurality of computers, the processing of FIG. 6 and FIG. 7 can be executed by the service providing device 100 realized by cloud computing or a plurality of computers. Note that the processing described in FIG. 6 and FIG. 7 is merely an example. The same applies to other embodiments.

[0074] The service providing device 100 registers related person information in advance (step S100). Specifically, as described above, the related person registration unit 120 registers the related person information before the related person visits the facility. At this time, the service providing device 100 may perform control so as to cause the facility terminal device 32 to display the related person information registered in advance.

[0075] When a visitor comes to the facility, the photographing device 30 photographs the visitor (step S106). Note that the visitor is not necessarily a related person registered in advance. Then, as described above, the face authentication device 50 compares the face image of the visitor to the facility with the face images of related people registered in advance (step S108).

[0076] The service providing device 100 acquires the matching result (step S110). Specifically, the matching result acquisition unit 140 acquires the matching result from the face authentication device 50. Then, the matching result determination unit 142 determines whether the acquired matching result indicates a match or a mismatch (step S112).

[0077] If the matching result indicates a match ("Match" in S112), the service providing device 100 causes the facility terminal device 32 to display the matching result (step S114). The service providing device 100 also performs control to unlock the gate of the facility (step S116). Specifically, as described above, the service providing control unit 150 performs control to cause the facility terminal device 32 to display the matching result indicating a match, the related party information of the related party who is the visitor, and the resident information of the resident related to the related party who is the visitor. As a result, the facility terminal device 32 displays information indicating that the matching result indicates a match, the related party information of the related party who is the visitor, and the resident information of the resident related to the related party who is the visitor. With this configuration, the staff of the facility can easily grasp which related party visited the facility and which resident the related party is related to. The unlocking control unit 152 also performs control to unlock the gate of the facility, as described above. Then, the processing flow may end, or may return to the processing of S100 or S106.

[0078] On the other hand, if the comparison result indicates a mismatch ("Mismatch" in S112), the service providing device 100 performs control to notify the related person and the facility (step S120). The service providing device 100 also performs control to confirm with the related person whether to permit unlocking of the gate (step S122). Specifically, the service provision control unit 150 performs control to display a notification indicating that a visitor not registered in advance may have visited the facility on the facility terminal device 32. As described above, the related person notification control unit 154 also performs control to display a notification indicating that a visitor not registered in advance may have visited the facility, together with a face image of the visitor, on the related person terminal device 40 of the related person registered in advance. As described above, the related person notification control unit 154 also performs control to display an inquiry image, which is an image for inquiring whether to permit unlocking of the gate, on the related person terminal device 40.

[0079] The service providing device 100 judges whether unlocking is permitted (step S124). Specifically, the service providing control unit 150 judges whether the permitted operation image is operated in any of the related party terminal devices 40. More specifically, the service providing control unit 150 judges whether permission information is received from any of the related party terminal devices 40 as a result of the operation of the permitted operation image. At this time, the service providing control unit 150 may judge that unlocking is not permitted if permission information is not received from any of the related party terminal devices 40 until a predetermined time has elapsed since the processing of S122. On the other hand, the service providing control unit 150 may judge that unlocking is permitted if permission information is received from any of the related party terminal devices 40 before the predetermined time has elapsed since the processing of S122.

[0080] If unlocking is permitted (YES in S124), the service providing device 100 performs control to unlock the gate (step S126). The service providing device 100 also performs control to register a face image of the visitor (step S128). Specifically, the unlocking control unit 152 performs control to unlock the gate of the facility in the same manner as the processing of S116. The registration control unit 156 also performs control to register the visitor as a related person related to the resident of the facility, using the permission information including the visitor's name and related information, as described above. As a result, the related person registration unit 120 registers the visitor as a related person related to the resident of the facility. Then, the processing flow may end, or may return to the processing of S100 or S106.

[0081] On the other hand, if unlocking is not permitted (YES in S124), the service providing device 100 performs control to notify the facility that unlocking is not permitted (step S130). Specifically, the facility notification control unit 158 ​​performs control to cause the facility terminal device 32 to output a notification indicating that unlocking is not permitted. Then, the processing flow may end, or may return to the processing of S100 or S106.

[0082] FIG. 8 is a diagram illustrating a pre-registration image Im1 displayed when registration is performed by the related person registration unit 120 according to the present disclosure. The pre-registration image Im1 may be displayed on the related person terminal device 40 in the processing of S100. The pre-registration image Im1 may be, for example, an image of a website for registering related person information. The pre-registration image Im1 may be displayed on the related person terminal device 40 under the control of the related person registration unit 120. The resident information and related person information may be displayed on the pre-registration image Im1. The related person information may include information about multiple related persons (related persons #1, #2, ...).

[0083] The resident information may include a facial image of the resident, the resident's name, and the resident's identification information. The resident information may be displayed in advance in the pre-registered image Im1 by an operation by a staff member of the facility. Alternatively, the resident information may be displayed in the pre-registered image Im1 by a related person performing an input operation on the related person terminal device 40.

[0084] The related party information may include, for each related party, a facial image of the related party, the name of the related party, the identification information of the related party, and the relationship information of the related party. The related party may upload his / her own facial image onto the website by manipulating the "Facial Image" field in the related party information displayed in the pre-registered image Im1. The related party may also upload his / her own name onto the website by manipulating the "Name" field in the related party information displayed in the pre-registered image Im1. The related party may also upload his / her own identification information onto the website by manipulating the "Identification Information" field in the related party information displayed in the pre-registered image Im1. The related party may also upload relationship information indicating the relationship between the related party and the resident related to the related party and proving the relationship onto the website by manipulating the "Relationship Information" field in the related party information displayed in the pre-registered image Im1.

[0085] FIG. 9 is a diagram illustrating a display image Im2 displayed when the matching result indicates a match in the present disclosure. The display image Im2 may be displayed on the facility terminal device 32 in the processes of S114 and S116. The display image Im2 displays a message indicating "Matching result: Matching". The display image Im2 may display a message such as "Matched with the pre-registered related party" as a message indicating "Matching result: Matching". The display image Im2 also displays a message such as "Please unlock" as a message to prompt the staff to unlock the gate. The display image Im2 also displays visitor information. The visitor information displayed on the display image Im2 corresponds to related party information of the visitor who is a related party registered in advance. The visitor information may include the "face image", "name", "identification information", and "related information" of the visitor who is a related party. The display image Im2 also displays resident information of the resident related to the visitor who is a related party.

[0086] For example, if the facility is a facility (such as a nursery school) that temporarily takes care of children (kindergarteners), the visitor information in the display image Im2 may correspond to related party information about the guardians that has been registered in advance. In this case, the resident information in the display image Im2 corresponds to information about the children related to the guardians. Furthermore, the "face image" of the visitor information corresponds to the face image of the guardian. Furthermore, the "related information" of the visitor information indicates information indicating the relationship between the guardian and the children (for example, "mother")

[0087] FIG. 10 is a diagram illustrating a display image Im3 displayed when the matching result indicates a mismatch in the present disclosure. The display image Im3 may be displayed on the facility terminal device 32 in the process of S120. The display image Im3 displays a message indicating "Matching result: mismatch". The display image Im3 may display a message such as "No match with pre-registered related party" as a message indicating "Matching result: mismatch". The display image Im3 may also display a message such as "An unregistered visitor may have visited". The display image Im3 may also display a message such as "Enquiring with registered related party".

[0088] FIG. 11 is a diagram illustrating an example of an inquiry image Im4 displayed by the processing of the related person notification control unit 154 according to the present disclosure. The inquiry image Im4 may be displayed on the related person terminal device 40 by the processing of the related person notification control unit 154 in the processing of S120 and S122. The inquiry image Im4 may display a message such as "An unregistered visitor may have visited." The inquiry image Im4 also displays a face image of the visitor who visited the facility. The inquiry image Im4 also displays a message such as "Are you sure you want to unlock the gate?" as a message asking whether to allow the gate to be unlocked. The inquiry image Im4 also displays an allowed operation image Im42 and a not allowed operation image Im44. The inquiry image Im4 also displays a name input field Im46 for inputting the visitor's name and a relationship information input field Im48 for inputting relationship information indicating the relationship between the visitor and the resident.

[0089] When the related person operates the permitted operation image Im42, as described above, the unlock control unit 152 controls the gate to be unlocked. At this time, the related person can input the name of the visitor by operating the name input field Im46. The related person can input information about the resident related to the visitor and the relationship between the resident and the visitor by operating the relationship information input field Im48. Through these operations, the visitor's face image is newly registered as the related person's face image under the control of the registration control unit 156. On the other hand, when the related person operates the disallowed operation image Im44, the related person terminal device 40 transmits disallowed information to the service providing device 100.

[0090] FIG. 12 is a diagram illustrating a display image Im5 displayed when the matching result indicates a mismatch and unlocking is permitted in the present disclosure. The display image Im5 may be displayed on the facility terminal device 32 in the process of S126. The display image Im5 displays a message indicating "Matching result: Mismatch". The display image Im5 also displays a message such as "Unlocking permitted" as a message indicating that unlocking is permitted. The display image Im5 also displays related party information regarding the related party who permitted unlocking. The display image Im5 also displays visitor information regarding the visitor. The visitor information displayed in the display image Im5 includes a face image photographed by the photographing device 30. The visitor information also includes the visitor's name and related information input by the related party who permitted unlocking. The display image Im5 also displays resident information of the resident related to the visitor.

[0091] 13 is a diagram illustrating a display image Im6 displayed by the processing of the facility notification control unit 158 ​​according to the present disclosure. The display image Im6 may be displayed on the facility terminal device 32 in the processing of S130. The display image Im6 displays a message indicating "Match result: Mismatch". The display image Im6 may also display a message such as "An unregistered visitor may have visited". The display image Im6 also displays a message such as "Unlocking not permitted" as a message indicating that unlocking is not permitted.

[0092] (Embodiment 3) Next, the third embodiment will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same symbols, and repeated explanations are omitted as necessary. Note that the configuration of the service providing system 20 according to the third embodiment is substantially similar to that shown in FIG. 3, and therefore the explanation is omitted. Also, the hardware configuration of the device according to the third embodiment is substantially similar to that shown in FIG. 4, and therefore the explanation is omitted.

[0093] Fig. 14 is a diagram illustrating a functional configuration of the service providing device 100 according to the present disclosure. The service providing device 100 has, as components, a related person registration unit 220, a related person information storage unit 122, a photographed image acquisition unit 130, a face image transmission unit 132, a matching result acquisition unit 140, and a matching result determination unit 142. The service providing device 100 also has, as components, a service provision control unit 150. The service provision control unit 150 also has an unlocking control unit 152, a related person notification control unit 154, a registration control unit 156, and a facility notification control unit 158. Note that the operations of the components other than the related person registration unit 220 are substantially similar to those described above with reference to Fig. 5, and therefore will not be described.

[0094] The related person registration unit 220 functions as related person registration means. Like the related person registration unit 120 described above, the related person registration unit 220 registers people (related persons) related to residents of the facility. The related person registration unit 220 registers at least a facial image of the related person in advance before the visit. The related person registration unit 220 also registers related person information on the related person. The related person information is substantially the same as that according to the second embodiment described above, and therefore description thereof will be omitted. The related person registration unit 220 registers the related person for each of a plurality of related persons related to the resident.

[0095] The related person registration unit 220 registers related person information in advance by operation of the related person, similar to the related person registration unit 120 described above. The related person registration unit 220 may register the related person information, for example, via a website. Specifically, the related person registration unit 220 makes the website for registering related person information viewable on the terminal of the related person. The related person operates the terminal to upload the related person information (such as a facial image) to the website.

[0096] Here, the related party registration unit 220 registers facial images of multiple related parties in response to an operation on the terminal (related party terminal device 40) of a representative (first related party) among the multiple related parties. Specifically, the related party registration unit 220 registers one or more other related parties (second related parties) in response to an operation on the related party terminal device 40 of the representative (first related party). At this time, the related party registration unit 220 first registers information other than the facial images of the other related parties other than the representative. In other words, the related party registration unit 220 provisionally registers the other related parties in response to an operation on the terminal of the representative. Then, the related party registration unit 220 registers a facial image of the registered second related party in response to an operation on the related party terminal device 40 of the second related party.

[0097] More specifically, the related person registration unit 220 transmits a registration request to the related person terminal device 40 of the registered second related person to request registration of a facial image. As a result, a registration image of a website for registering the facial image of the second related person is displayed on the related person terminal device 40 of the second related person. Then, when the second related person operates the registration image displayed on the related person terminal device 40 to upload his / her own facial image, the related person registration unit 220 registers the facial image of the second related person. In other words, the related person registration unit 220 registers the facial image of the second related person in response to the related person terminal device 40 of the second related person being operated in response to the registration request.

[0098] FIG. 15 is a flowchart showing an example of processing executed by the service providing apparatus 100 according to the present disclosure. FIG. 15 shows a registration method executed by the related person registration unit 220 according to the present disclosure. FIG. 15 corresponds to the processing of S100 shown in FIG. 6. The related person registration unit 220 registers related person information of the representative in response to an operation of the representative (step S202). Specifically, the related person registration unit 220 makes a website for registering related person information viewable on the related person terminal device 40 of the representative. The representative operates the related person terminal device 40 to upload related person information including his / her own facial image onto the website. As a result, the related person registration unit 220 registers related person information of the representative including his / her facial image.

[0099] The related person registration unit 220 registers the other related persons in response to the operation of the representative (step S204). Specifically, the related person registration unit 220 makes a website for registering related person information viewable on the related person terminal device 40 of the representative. The representative operates the related person terminal device 40 to upload information other than facial images of the other related persons (such as names, identification information, related information, etc.) onto the website. As a result, the related person registration unit 220 registers information other than facial images of the other related persons, that is, related person information not including facial images. In other words, the related person registration unit 220 provisionally registers the other related persons.

[0100] The related person registration unit 220 performs control for transmitting a registration request for a face image to the terminal of the other related person (step S206). Specifically, the related person registration unit 220 performs control for transmitting a registration request for registering the face image of the other related person to the related person terminal device 40 of the other related person, using the identification information included in the related person information of the registered other related person. As a result, the related person terminal device 40 of the other related person displays a registration image of a website for registering the face image of the other related person.

[0101] The related person registration unit 220 registers the facial images of the other related persons in response to the operations of the other related persons (step S208). Specifically, when the other related persons operate the registered image displayed on the related person terminal device 40 to upload their own facial images, the related person registration unit 220 registers the facial images of the other related persons.

[0102] With the above-mentioned configuration, the parties other than the representative are not required to register information other than the face image by their own operation. Also, with the above-mentioned configuration, the representative is not required to obtain the face images of the other parties when registering them. Therefore, the convenience of the parties is improved.

[0103] FIG. 16 is a diagram illustrating a pre-registration image Im11 displayed when registration is performed by the related person registration unit 220 according to the present disclosure. The pre-registration image Im11 may be displayed on the related person terminal device 40 of the representative (representative related person #1) in the processing of S202 and S204. The pre-registration image Im11 may be, for example, an image of a website for registering related person information. The pre-registration image Im11 may be displayed on the related person terminal device 40 of the representative related person #1 under the control of the related person registration unit 220. The pre-registration image Im11 may display the resident information and related person information. The related person information includes information about the representative related person #1 and information about one or more other related persons (related person #2, ...).

[0104] The representative related party #1 operates the "Facial Image" field in the representative related party #1 of the related party information displayed in the pre-registered image Im11 to upload his / her own facial image onto the website. The representative related party #1 also operates the "Name" field in the representative related party #1 of the related party information displayed in the pre-registered image Im11 to upload his / her own name onto the website. The representative related party #1 also operates the "Identification Information" field in the representative related party #1 of the related party information displayed in the pre-registered image Im11 to upload his / her own identification information onto the website. The representative related party #1 also operates the "Relationship Information" field in the representative related party #1 of the related party information displayed in the pre-registered image Im11 to show the relationship between himself / herself and the resident related to him / her and upload relationship information proving the relationship onto the website.

[0105] Furthermore, the representative related party #1 operates the "Name" column for related party #2 in the related party information displayed in the pre-registered image Im11 to upload the name of related party #2 onto the website. The representative related party #1 also operates the "Identification Information" column for related party #2 in the related party information displayed in the pre-registered image Im11 to upload the identification information of related party #2 onto the website. The representative related party #1 also operates the "Relationship Information" column for related party #2 in the related party information displayed in the pre-registered image Im11 to show the relationship between related party #2 and the resident related to related party #2 and upload relationship information proving the relationship onto the website. Note that the representative related party #1 does not have to upload the relationship information of related party #2 onto the website. In this case, the relationship information of related party #2 can be uploaded by the operation of related party #2.

[0106] 17 is a diagram illustrating a face registration image Im12 displayed when registration is performed by the related person registration unit 220 according to the present disclosure. In response to the processing of S206, the face registration image Im12 may be displayed on the related person terminal device 40 of the other related person, related person #2, in the processing of S208. The face registration image Im12 may be, for example, an image of a website for registering related person information. The face registration image Im12 may be displayed on the related person terminal device 40 of the related person #2 under the control of the related person registration unit 220.

[0107] The face registration image Im12 may display a message such as "There is a registration request from the representative related party #1" and a message such as "Please register your face image" as a message to encourage the related party #2 to register his / her own face image. The face registration image Im12 may also display related party information of the related party #2. The face registration image Im12 may display in advance the name, identification information, and relationship information of the related party #2 input by the operation of the representative related party #1. The related party #2 operates the "Face Image" field for the related party #2 displayed in the face registration image Im12 to upload his / her own face image to the website. This causes the face image of the related party #2 to be registered.

[0108] (Embodiment 4) Next, the fourth embodiment will be described with reference to the drawings. For clarity of explanation, the following description and drawings have been omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same symbols, and repeated explanations are omitted as necessary. Note that the configuration of the service providing system 20 according to the fourth embodiment is substantially similar to that shown in FIG. 3, and therefore explanations are omitted. Also, the hardware configuration of the device according to the fourth embodiment is substantially similar to that shown in FIG. 4, and therefore explanations are omitted.

[0109] FIG. 18 is a diagram illustrating a functional configuration of the service providing device 100 according to the present disclosure. The service providing device 100 has, as components, a related person registration unit 120, a related person information storage unit 122, a visit schedule registration unit 310, and a visit schedule notification unit 312. The service providing device 100 also has, as components, a photographed image acquisition unit 130, a face image transmission unit 332, a matching result acquisition unit 340, and a matching result determination unit 142. The service providing device 100 also has, as components, a service provision control unit 150. The service provision control unit 150 also has an unlocking control unit 152, a related person notification control unit 154, a registration control unit 156, and a facility notification control unit 158. Note that the operations of the components other than the visit schedule registration unit 310, the visit schedule notification unit 312, the face image transmission unit 332, and the matching result acquisition unit 340 are substantially similar to those described above with reference to FIG. 5, and therefore will not be described.

[0110] The visit schedule registration unit 310 functions as a visit schedule registration means. The visit schedule notification unit 312 functions as a visit schedule notification means. The face image transmission unit 332 functions as a face image transmission means. The match result acquisition unit 340 functions as a match result means.

[0111] The visit schedule registration unit 310 registers visit schedule information, which is information about a related person's plan to visit the facility. Specifically, the visit schedule registration unit 310 registers, as the visit schedule information, the scheduled visit date and time, information about the related person who is scheduled to visit, and information about the resident who is the target of the visit. Note that the information about the related person who is scheduled to visit and registered by the visit schedule registration unit 310 does not need to include a facial image of the related person.

[0112] The visit schedule registration unit 310 registers the visit schedule information in advance through the operation of the related person. The visit schedule registration unit 310 may register the visit schedule information through a website, for example. Specifically, the visit schedule registration unit 310 makes the website for registering the visit schedule information viewable on the terminal of the related person (related person terminal device 40). The related person operates the terminal to upload the visit schedule information to the website.

[0113] When visit schedule information is registered, the visit schedule notifying unit 312 notifies the visited facility. Specifically, when visit schedule information is registered, the visit schedule notifying unit 312 causes the facility terminal device 32 of the visited facility to output (display) a notification indicating the visit schedule information. Note that the timing at which the notification indicating the visit schedule information is output may be any timing.

[0114] The facial image transmission unit 332, like the facial image transmission unit 132, transmits the photographed image acquired from the photographing device 30 to the facial authentication device 50 as a facial image of a visitor to the facility. In addition, the facial image transmission unit 332 transmits a facial image (registered facial image) registered by the related person registration unit 120 to the facial authentication device 50. Here, the facial image transmission unit 332 transmits to the facial authentication device 50 a registered facial image of a related person indicated in the visit schedule information corresponding to a scheduled visit date and time near the date and time when the visitor visited the facility. Here, the "scheduled visit date and time near the date and time when the visitor visited the facility" is, for example, a scheduled visit date and time within about T minutes before and after the date and time when the visitor visited the facility. Note that the time T can be set in advance by the user.

[0115] The matching result acquisition unit 340 corresponds to the acquisition unit 12 in FIG. 1 described above. The matching result acquisition unit 340 receives a matching result between a face image shown in a photographed image and a registered face image from the face authentication device 50. Here, in the fourth embodiment, the face authentication device 50 matches a face image shown in a photographed image with a registered face image of a related person shown in the visit schedule information corresponding to a scheduled visit date and time near the date and time when the visitor visited the facility. Then, the matching result acquisition unit 340 acquires a matching result between a face image shown in a photographed image and a registered face image of a related person shown in the visit schedule information corresponding to a scheduled visit date and time near the date and time when the visitor visited the facility. In other words, the matching result acquisition unit 340 acquires a matching result between a face image of a visitor and a face image of a related person related to the visit schedule information corresponding to the date and time when the visitor visited the facility.

[0116] With the above-mentioned configuration, the facility staff can easily know the date and time when the related person is scheduled to visit. Therefore, the convenience of the staff is improved. In addition, when the face image is matched, the face authentication device 50 performs the match using the registered face image of the related person related to the visit schedule information corresponding to the scheduled visit date and time near the date and time when the visitor visited the facility. Therefore, the time required for the match can be reduced and the accuracy of the match can be improved. That is, in the other embodiment described above, the face authentication device 50 matches all registered face images with the face image of the visitor. As a result, the number of registered face images to be matched may become enormous, so the time required for the match may increase and the accuracy of the match may decrease. In contrast, as in the fourth embodiment, the number of registered face images used for the match can be narrowed down by performing the match using the registered face image of the related person related to the visit schedule information corresponding to the scheduled visit date and time near the date and time when the visitor visited the facility. Therefore, the time required for the match may be reduced and the accuracy of the match may be improved.

[0117] Fig. 19 is a flowchart showing an example of processing executed by the service providing system 20 according to the present disclosure. Fig. 19 shows a service providing method executed by the service providing system 20 according to the present disclosure. Fig. 19 can be mainly executed by the service providing device 100. The service providing device 100 registers related person information in advance (step S300), similar to the processing of S100.

[0118] The service providing device 100 registers visit schedule information (step S302). Specifically, the visit schedule registering unit 310 registers the visit schedule information in advance, as described above. The service providing device 100 notifies the visit schedule information (step S304). Specifically, when the visit schedule information is registered, the visit schedule notifying unit 312 notifies the terminal of the facility to be visited of the visit schedule information, as described above.

[0119] When a visitor visits the facility, the photographing device 30 photographs the visitor (step S306). Then, the face authentication device 50, as described above, compares the face image of the visitor to the facility with face images of related parties registered in advance (step S308). Here, as described above, the face authentication device 50 compares the face image shown in the photographed image with the registered face images of related parties shown in the visit schedule information corresponding to the planned visit date and time near the date and time when the visitor visited the facility.

[0120] The service providing device 100 acquires the matching result (step S310). Specifically, the matching result acquisition unit 340 acquires the matching result from the face authentication device 50. At this time, as described above, the matching result acquisition unit 340 acquires the matching result between the face image of the visitor and the face images of the related parties related to the visit schedule information corresponding to the date and time when the visitor visited the facility. Then, the matching result determination unit 142 determines whether the acquired matching result indicates a match or a mismatch (step S312).

[0121] If the comparison result indicates a match ("Match" in S312), the service providing device 100 causes the facility terminal device 32 to display the match (step S314), similar to the other embodiments described above. Also, the service providing device 100 performs control to unlock the gate of the facility (step S316), similar to the other embodiments described above. On the other hand, if the comparison result indicates a mismatch ("Mismatch" in S312), the service providing device 100 performs control to notify the relevant parties and the facility (step S120), similar to the other embodiments described above. The processing from S120 onwards is substantially similar to that illustrated in FIG. 7, and therefore will not be described.

[0122] In the above-mentioned configuration, the face authentication device 50 compares the visitor's face image with the registered face image of the related person related to the visit schedule information corresponding to the scheduled visit date and time close to the date and time when the visitor visited the facility, but the configuration is not limited to this. The face authentication device 50 may compare the visitor's face image with all registered face images registered regardless of the scheduled visit date and time. Then, the service providing device 100 may notify the facility when the difference between the scheduled visit date and time of the related person corresponding to the registered face image determined to match the visitor's face image as a result of the comparison and the date and time when the visitor visited the facility is greater than a predetermined threshold. The threshold may be set in advance by the user.

[0123] FIG. 20 is a diagram illustrating a visit schedule registration image Im21 displayed when registration is performed by the visit schedule registration unit 310 according to the present disclosure. The visit schedule registration image Im21 may be displayed on the related party terminal device 40 in the process of S302. The visit schedule registration image Im21 may be, for example, an image of a website for registering related party information. The visit schedule registration image Im21 may be displayed on the related party terminal device 40 under the control of the visit schedule registration unit 310. The visit schedule registration image Im21 may display a message such as "Please register your visit schedule" as a message encouraging the related party to register a visit schedule.

[0124] The visit schedule information may include related party information of the related party scheduled to be visited, the scheduled visit date and time, and the resident information of the resident to be visited. The related party may operate the "related party information" field displayed in the visit schedule registration image Im21 to upload the information of the related party scheduled to be visited (such as name, identification information, etc.) onto the website. The related party may also operate the "scheduled visit date and time" field displayed in the visit schedule registration image Im21 to upload the scheduled visit date and time onto the website. The related party may also operate the "resident information" field displayed in the visit schedule registration image Im21 to upload the information of the resident to be visited (such as name, identification information, etc.) onto the website. The visit schedule notification unit 312 may also notify the facility of the visit schedule information registered using the visit schedule registration image Im21.

[0125] (Modification) Note that, if the visitor is a registered related person, when the related person visits the facility, the related person terminal device 40 of the related person may transmit information indicating which resident the related person visited to the service providing device 100 by short-range wireless communication or the like. In this case, the face image transmitting unit may transmit a face image of the registered related person related to the resident to the face authentication device 50. Then, the matching result acquiring unit may acquire a matching result between the face image of the visitor and the face image of the related person related to the resident indicated in the above information.

[0126] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.

[0127] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing may be combined with features or steps shown in one or more other drawings to create an embodiment not expressly shown or described, for example. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0128] The above-mentioned program includes a set of instructions (or software code) for making the computer perform one or more functions described in the embodiments when the program is loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or the tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disk (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or the communication medium includes electrical, optical, acoustic, or other forms of propagating signals.

[0129] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) An acquisition means for acquiring a comparison result between a facial image of a visitor to the facility and a pre-registered facial image of one or more related persons who are pre-registered as persons related to the occupants of the facility; a control means for controlling unlocking of a gate of the facility when the collation result indicates a match, and for controlling notifying the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility when the collation result indicates a mismatch; A service providing device having the above configuration. (Appendix 2) The control means performs control to ask the person concerned whether to permit unlocking of the gate when the collation result indicates a mismatch. 2. A service providing apparatus as described in claim 1. (Appendix 3) The control means performs control for unlocking the gate when the collation result indicates a mismatch and unlocking of the gate is permitted. 3. A service providing apparatus as described in claim 2. (Appendix 4) the control means performs control for newly registering a face image of the visitor when the collation result indicates a mismatch and unlocking of the gate is permitted. 3. A service providing apparatus as described in claim 2. (Appendix 5) The control means performs control to notify the facility that unlocking of the gate is not permitted when the collation result indicates a mismatch and unlocking of the gate is not permitted. 3. A service providing apparatus as described in claim 2. (Appendix 6) the control means performs control to display a facial image of the visitor on the terminal of the related person when the comparison result indicates a mismatch. 6. A service providing device according to any one of claims 1 to 5. (Appendix 7) a related person registration means for registering in advance at least a facial image of each of a plurality of related people associated with the resident of the facility; 2. The service providing device of claim 1, further comprising: (Appendix 8) the related person registration means registers face images of the plurality of related persons in response to an operation on a terminal of a first related person among the plurality of related persons; 8. A service providing apparatus as described in claim 7. (Appendix 9) the related person registration means registers one or more second related persons other than the first related person in response to an operation on the terminal of the first related person, and registers a face image of the registered second related person in response to an operation on the terminal of the second related person; 9. A service providing apparatus as described in appendix 8. (Appendix 10) the related person registration means transmits a registration request to the terminal of the registered second related person to request registration of a facial image, and registers the facial image of the second related person in response to an operation of the terminal of the second related person in response to the registration request; 10. A service providing apparatus as described in appendix 9. (Appendix 11) a visit schedule registration means for registering visit schedule information which is information regarding a schedule for the related person to visit the facility; 2. The service providing device of claim 1, further comprising: (Appendix 12) a visit schedule notifying means for notifying the facility of the registered visit schedule information; 12. The service providing device of claim 11, further comprising: (Appendix 13) the acquiring means acquires a collation result between a facial image of the visitor and a facial image of the related person related to the visit schedule information corresponding to a date and time when the visitor visited the facility; 13. The service providing device according to claim 11 or 12. (Appendix 14) Obtaining a matching result between a facial image of a visitor to the facility and a pre-registered facial image of one or more related persons who are pre-registered as persons related to an occupant of the facility; When the collation result indicates a match, control is performed to unlock the gate of the facility, and when the collation result indicates a mismatch, control is performed to notify the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility. How we provide services. (Appendix 15) Obtaining a matching result between a facial image of a visitor to the facility and a pre-registered facial image of one or more related persons who are pre-registered as persons related to an occupant of the facility; a step of performing control for unlocking a gate of the facility when the collation result indicates a match, and performing control for notifying the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility when the collation result indicates a mismatch; A program that causes a computer to execute the following.

[0130] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 13 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 14 and 15 in the same dependent relationship as Supplementary Notes 2 to 13. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]

[0131] 1 Service provision equipment 12 Acquisition Department 14 Control section 20 Service Delivery System 30 Imaging Equipment 32 Facility terminal equipment 40 Terminal equipment for related parties 50 Face Recognition Device 100 Service providing device 120 Stakeholder Registration Department 122 Related Person Information Storage Unit 130 Image capture unit 132 Facial image transmission unit 140 Matching result acquisition unit 142 Matching result judgment unit 150 Service provision control section 152 Unlock control unit 154 Related Party Notification Control Unit 156 Registration control section 158 Facility Notification Control Section 220 Stakeholder Registration Department 310 Visit Schedule Registration Department 312 Visit Schedule Notification Department 332 Facial image transmission unit 340 Matching result acquisition unit

Claims

1. An acquisition means for acquiring a comparison result between a facial image of a visitor to the facility and a facial image registered in advance of one or more related persons who are registered in advance as persons related to the occupants of the facility; a control means for controlling unlocking of a gate of the facility when the collation result indicates a match, and for controlling notifying the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility when the collation result indicates a mismatch; A service providing device having the above configuration.

2. The control means performs control to ask the person concerned whether to permit unlocking of the gate when the collation result indicates a mismatch. The service providing device according to claim 1 .

3. The control means performs control for unlocking the gate when the collation result indicates a mismatch and unlocking of the gate is permitted. The service providing device according to claim 2 .

4. the control means performs control for newly registering a face image of the visitor when the collation result indicates a mismatch and unlocking of the gate is permitted. The service providing device according to claim 2 .

5. The control means performs control to notify the facility that unlocking of the gate is not permitted when the collation result indicates a mismatch and unlocking of the gate is not permitted. The service providing device according to claim 2 .

6. the control means performs control to display a facial image of the visitor on the terminal of the related person when the comparison result indicates a mismatch. The service providing device according to any one of claims 1 to 5.

7. a related person registration means for registering in advance at least a facial image of each of a plurality of related people associated with the resident of the facility; The service providing device according to claim 1 , further comprising:

8. the related person registration means registers face images of the plurality of related persons in response to an operation on a terminal of a first related person among the plurality of related persons; The service providing device according to claim 7.

9. Obtaining a matching result between a facial image of a visitor to the facility and a pre-registered facial image of one or more related persons who are pre-registered as persons related to the occupants of the facility; When the collation result indicates a match, control is performed to unlock the gate of the facility, and when the collation result indicates a mismatch, control is performed to notify the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility. How we provide services.

10. Obtaining a matching result between a facial image of a visitor to the facility and a pre-registered facial image of one or more related persons who are pre-registered as persons related to an occupant of the facility; a step of performing control for unlocking a gate of the facility when the collation result indicates a match, and performing control for notifying the related person who is registered in advance that a visitor who is not registered in advance may have visited the facility when the collation result indicates a mismatch; A program that causes a computer to execute the following.

Images