Service providing device, service providing method, and program

Abstract

To provide a service providing device capable of suppressing the occurrence of trouble.SOLUTION: A service providing device includes acquisition means and control means. The acquisition means acquires a result of matching a face image of a visitor to the residence with a face image registered in advance. When the matching result indicates a mismatch, the control means controls a terminal of a resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a service providing device, a service providing method, and a program. [Background technology]

[0002] Patent Document 1 discloses an apartment block intercom system. The system in Patent Document 1 has a company information registration unit in which personal authentication information of delivery companies is registered. The system in Patent Document 1 also has an authentication unit that authenticates whether the delivery company operating the collective entrance unit is a registered delivery company, and a delivery notification control unit that notifies the room parent unit that the delivery company has arrived. When the authentication unit authenticates that the person operating the collective entrance unit is a delivery company, the delivery notification control unit notifies the room parent unit of the dwelling unit entered on the delivery destination input screen that the delivery company has arrived. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-127177 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology of Patent Document 1 does not disclose any action to be taken for the resident when the person who operates the collective entrance device is not authenticated as a delivery person, that is, when the face image matching result shows a mismatch. Therefore, with the technology of Patent Document 1, even if the visitor is suspect, the resident may not be able to take appropriate action. Therefore, with the technology of Patent Document 1, even if the face image matching result shows a mismatch, the occurrence of trouble may not be prevented.

[0005] The present disclosure has been made in order to solve such problems, and has an object to provide a service providing device, a service providing method, and a program that are capable of suppressing the occurrence of problems. [Means for solving the problem]

[0006] The service providing device according to the present disclosure includes an acquisition means for acquiring a matching result between a facial image of a visitor to a residence and a facial image registered in advance, and a control means for controlling a terminal of a resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence when the matching result indicates a mismatch.

[0007] The service provision method disclosed herein obtains a comparison result between a facial image of a visitor to a residence and a facial image registered in advance, and if the comparison result indicates a mismatch, controls so that an operation image for performing an operation to prevent the visitor from entering the residence is displayed on a terminal of a resident of the residence.

[0008] The program disclosed herein causes a computer to execute the steps of obtaining a comparison result between a facial image of a visitor to a residence and a facial image registered in advance, and, if the comparison result indicates a mismatch, controlling a terminal of a resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence. Effect of the Invention

[0009] According to the present disclosure, it is possible to provide a service providing device, a service providing method, and a program capable of suppressing the occurrence of problems. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating a configuration of a service providing device according to the present disclosure. [Diagram 2] 1 is a flowchart illustrating a service providing method executed by a service providing device according to the present disclosure. [Diagram 3] 1 is a diagram illustrating an example of a configuration of a service providing system according to the present disclosure. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a service providing device according to the present disclosure. [Diagram 5] 1 is a diagram illustrating an example of a functional configuration of a service providing device according to the present disclosure. [Figure 6] 1 is a flowchart illustrating an example of a process executed by a service providing system according to the present disclosure. [Figure 7] 1 is a flowchart illustrating an example of a process executed by a service providing system according to the present disclosure. [Figure 8] 13 is a diagram illustrating an example of a pre-registration image displayed when registration is performed by a visitor registration unit according to the present disclosure. FIG. [Figure 9] 13A and 13B are diagrams illustrating examples of visitor information notification images displayed by the processing of a visitor information notification unit according to the present disclosure. [Figure 10] 11 is a diagram illustrating an example of a display image that is displayed when a comparison result indicates a match in the present disclosure. [Figure 11] 11 is a diagram illustrating an example of an operation image displayed when a comparison result indicates a mismatch in the present disclosure. FIG. [Figure 12] 13 is a diagram illustrating a visit history notification image displayed by processing of a visit history notification unit according to the present disclosure. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary. In addition, although the following description will be made using the drawings, the drawings used in the description of a certain embodiment do not apply only to that embodiment. Each drawing may be applied to all embodiments.

[0012] (Embodiment 1) 1 is a diagram showing the configuration of a service providing device 1 according to the present disclosure. The service providing device 1 has an acquisition unit 12 and a control unit 14. The acquisition unit 12 functions as an acquisition means. The control unit 14 functions as a control means. The service providing device 1 provides services to residents of a residence using these components.

[0013] The service providing device 1 may be realized by a computer. The service providing device 1 may be realized by, for example, cloud computing. The service providing device 1 may also be realized by, for example, a plurality of computers communicably connected to each other. The components of the service providing device 1 may also be distributed and realized on a plurality of computers. That is, the computer that realizes the acquisition unit 12 and the computer that realizes the control unit 14 may be physically separate. The functions of each of the plurality of components may also be realized by a plurality of computers.

[0014] FIG. 2 is a flowchart showing a service providing method executed by the service providing device 1 according to the present disclosure. The acquisition unit 12 acquires a matching result between a face image of a visitor to the residence and a face image registered in advance (step S12). Here, a "visitor" refers to a person who visits the residence. "Visiting a residence" corresponds to an act of calling a resident in order to enter the residence. For example, "visiting a residence" includes calling a resident by operating an intercom system installed in the residence. In addition, the "matching result" is generated by, for example, a face recognition device equipped with a face recognition system that performs face recognition, but is not limited to this. The face recognition device corresponds to a face recognition device 50 described later. The face recognition device will be described later.

[0015] In addition, in the present disclosure, a "face image" corresponds to an image in which a person's face is captured. In other words, the face image includes the person's face. Note that the "face image" may mean image data indicating a face image that is the subject of information processing. Furthermore, a "face image of a visitor to a residence" is acquired, for example, by a photographing device capable of photographing the visitor's face. The photographing device is, for example, a camera installed on a gate or the like of the residence, but is not limited to this. The photographing device corresponds to the photographing device 30 described later. The photographing device will be described later.

[0016] Furthermore, the "pre-registered face image" corresponds to a face image of a person who is scheduled to visit the residence. The "pre-registered face image" may be registered in advance, for example, by the person who is scheduled to visit or the organization to which the person belongs. Furthermore, the "organization to which the person who is scheduled to visit the residence belongs" may be, for example, but is not limited to, a delivery company. Furthermore, the "person who is scheduled to visit" may be, for example, but is not limited to, a delivery person who delivers packages to the residence. Furthermore, a "residence" refers to a facility where a person stays and lives. A "residence" may be, for example, but is not limited to, a house or a room in a collective housing such as an apartment building. A "residence" may include a facility where a person stays temporarily (for example, a hotel, etc.).

[0017] If the comparison result indicates a mismatch, the control unit 14 controls the terminal of the resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence (step S14). Here, the "terminal of the resident of the residence" is a terminal owned by the resident. The terminal is, for example, a smartphone, a mobile phone, or a tablet terminal, but is not limited to these. The terminal corresponds to a terminal device 40 described later.

[0018] An "operation image" is an image that is displayed on a user interface (UI) of a terminal, and that allows the terminal to perform some function by operating the operation image. An "operation image" includes, for example, an operation button displayed on the user interface of the terminal. When a user (resident) operates the button, some operation is executed. An "operation" is, for example, an operation such as pressing, clicking, touching, or tapping an operation image (operation button, etc.) displayed on the user interface by the user (resident). An operation image includes, for example, a report button, which is a report operation image for making a report, and an ignore button, which is a no-response operation image for not responding to a visitor, but is not limited to these. The report operation image (report button) and the no-response operation image (ignore button) will be described later.

[0019] The service providing device 1 according to the present disclosure, being configured as described above, can suppress the occurrence of trouble when the facial image matching result shows a mismatch. That is, when the facial image matching result shows a mismatch, the visitor may be a suspicious person whose identity is unknown. For example, the suspicious visitor (suspicious person) may be a person who induces trouble, such as a person who may commit an illegal act. If such a suspicious person visits disguised as a delivery person, for example, it is difficult for a resident to determine whether the visitor is a legitimate delivery person. Therefore, the resident may end up interacting with the visitor disguised as a delivery person, which may cause trouble such as an incident.

[0020] In response to this, the service providing device 1 according to the present disclosure, when the result of matching between the face image of a visitor to the residence and a face image registered in advance shows a mismatch, displays an operation image on the resident's terminal, assuming that the visitor may be a suspicious person. This allows the resident to take appropriate measures by operating the operation image. For example, when the resident operates the "report button", the resident can report to a security organization such as the police. Also, for example, when the resident operates the "ignore button", the resident can not respond to a visitor who is likely to be a suspicious person. In this way, the service providing device 1 according to the present disclosure allows the resident to take appropriate measures when the result of matching shows a mismatch, assuming that the visitor is a suspicious person, thereby making it possible to prevent the occurrence of troubles such as incidents.

[0021] Incidentally, as described later, a service providing system including the service providing device 1 also makes it possible to suppress the occurrence of trouble. Also, a service providing method executed by the service providing device 1 also makes it possible to suppress the occurrence of trouble. Also, a program that executes the service providing method also makes it possible to suppress the occurrence of trouble.

[0022] (Embodiment 2) Next, the second embodiment will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same reference numerals, and repeated explanations are omitted as necessary.

[0023] 3 is a diagram illustrating a configuration of a service providing system 20 according to the present disclosure. The service providing system 20 includes one or more image capturing devices 30, one or more terminal devices 40, one or more face authentication devices 50, and a service providing device 100. The image capturing device 30, the terminal device 40, the face authentication device 50, and the service providing device 100 each have a function as, for example, a computer.

[0024] The photographing device 30, the terminal device 40, the face authentication device 50, and the service providing device 100 are communicatively connected via a network. The network may be, for example, a wireless network or a wired network. That is, the service providing device 100 is connected to the photographing device 30, the terminal device 40, and the face authentication device 50 wirelessly or wired. The wireless network may be, for example, a network using a communication line standard such as LTE (Long Term Evolution), or may be a network used in a specific area such as WiFi (registered trademark) or local 5G. The wired network may be, for example, a LAN (Local Area Network) or optical fiber.

[0025] The photographing device 30 is, for example, a camera. The photographing device 30 photographs a subject and generates image data showing the photographed image. The image data may show a still image or a moving image. As described above, the photographing device 30 may be installed, for example, at the entrance or gate of a residence. In this case, the photographing device 30 may be built into an entrance slave unit of an intercom system installed in the residence. In this case, the photographing device 30 may start photographing when a visitor to the residence operates the entrance slave unit. In the present disclosure, the photographing device 30 photographs a visitor and generates a photographed image in which at least the visitor's face is photographed. Then, the photographing device 30 transmits the photographed image (image data) in which the visitor's face is photographed to the service providing device 100 together with identification information of the residence in which the photographing device 30 is installed. The identification information of the residence may indicate, for example, the address of the residence or an identification number assigned to each residence.

[0026] The terminal device 40 is a terminal owned by a user. For example, the terminal device 40 may be carried by a user who is a resident of a residence. The terminal device 40 presents necessary information to the user. The terminal device 40 may be, for example, a smartphone, a mobile phone, a tablet terminal, a smart watch, or a wearable device. The terminal device 40 may also be a PC (Personal Computer) such as a desktop computer or a laptop computer. The terminal device 40 may also be incorporated into, for example, an intercom system installed in a residence. In this case, the terminal device 40 may be, for example, a room master unit of the intercom system.

[0027] The face recognition device 50 performs a comparison as to whether at least two face images show the face of the same person. The face recognition device 50 may perform the comparison based on, for example, the positions of feature points such as the eyes, nose, and mouth, the position of the face area, and the size of the face area in each of the two face images. For example, the face recognition device 50 may calculate the degree of match between the two face images. Then, the face recognition device 50 may generate a comparison result based on the calculated degree of match. If the degree of match is equal to or greater than a predetermined threshold, the face recognition device 50 may generate a comparison result of "match" indicating that the faces shown by the two face images are the faces of the same person. On the other hand, if the degree of match is less than a predetermined threshold, the face recognition device 50 may generate a comparison result of "mismatch" indicating that the faces shown by the two face images are not the faces of the same person. The face recognition device 50 may perform the comparison using, for example, a machine learning algorithm.

[0028] In the present disclosure, the face authentication device 50 acquires a captured image including a face image of a visitor captured by the photographing device 30. The face authentication device 50 also acquires a registered face image from the service providing device 100. The "registered face image" is obtained by registering a face image of a person who is scheduled to visit the residence in advance in the service providing device 100. The face authentication device 50 compares the captured image (the face image of the visitor) with the registered face image (the face image registered in advance). The face authentication device 50 generates a comparison result based on the calculated degree of match. That is, the face authentication device 50 generates a comparison result between the face image of the visitor to the residence and the face image registered in advance. If the face image of the visitor to the residence shows the same person as the face image registered in advance, the face authentication device 50 generates a comparison result indicating "match". On the other hand, if the face image of the visitor to the residence shows a person different from the face image registered in advance, the face authentication device 50 generates a comparison result indicating "mismatch". The face authentication device 50 transmits the generated matching result to the service providing device 100.

[0029] The service providing device 100 corresponds to the service providing device 1 shown in FIG. 1. The service providing device 100 may be, for example, a server. The service providing device 100 may be, for example, an information terminal. The service providing device 100 may be realized by, for example, cloud computing. The service providing device 100 may be realized by, for example, a plurality of computers connected to each other so as to be able to communicate with each other. Each component of the service providing device 100 described later may be realized by a plurality of computers.

[0030] Any of a plurality of devices constituting the service providing system 20 may be physically integrated. For example, the photographing device 30 and the terminal device 40 may be physically integrated. The photographing device 30 and the face authentication device 50 may be physically integrated. The photographing device 30 and the service providing device 100 may be physically integrated. The terminal device 40 and the service providing device 100 may be physically integrated. The face authentication device 50 and the service providing device 100 may be physically integrated. The photographing device 30, the terminal device 40, and the service providing device 100 may be physically integrated. The photographing device 30, the face authentication device 50, and the service providing device 100 may be physically integrated.

[0031] 4 is a diagram illustrating a hardware configuration of the service providing device 100 according to the present disclosure. As shown in FIG. 4, the service providing device 100 has a control unit 102, a storage unit 104, a communication unit 106, and an interface unit 108 (IF; Interface) as main hardware components. The control unit 102, the storage unit 104, the communication unit 106, and the interface unit 108 are connected to each other via a data bus or the like. Note that the above-mentioned photographing device 30, the terminal device 40, and the face authentication device 50 may also have the hardware configuration of the service providing device 100 shown in FIG. 4.

[0032] The control unit 102 is a processor such as a CPU (Central Processing Unit). The control unit 102 has a function as a calculation device that performs control processing and calculation processing. The control unit 102 may have multiple processors. The storage unit 104 is a storage device such as a memory or a hard disk. The storage unit 104 is a read only memory (ROM) or a random access memory (RAM). The storage unit 104 has a function for storing a control program and a calculation program executed by the control unit 102. That is, the storage unit 104, which is a memory, stores one or more instructions. The storage unit 104 also has a function for temporarily storing processing data and the like. The storage unit 104 may include a database. The storage unit 104 may also have multiple memories.

[0033] The communication unit 106 performs processing required for the service providing device 100 to communicate with other devices via a network. The communication unit 106 may include a communication port, a router, a firewall, and the like. The interface unit 108 (IF; Interface) is, for example, a user interface (UI). The interface unit 108 has an input device such as a keyboard, a touch panel, or a mouse, and an output device such as a display or a speaker. The interface unit 108 may be configured such that the input device and the output device are integrated, such as a touch screen or a touch panel. The interface unit 108 accepts data input operations by a user such as an operator or a worker, and outputs information to the user.

[0034] FIG. 5 is a diagram illustrating a functional configuration of the service providing device 100 according to the present disclosure. The service providing device 100 has, as components, a visitor registration unit 120, a visit information storage unit 122, a photographed image acquisition unit 130, a face image transmission unit 132, a matching result acquisition unit 140, and a matching result determination unit 142. The service providing device 100 also has, as components, a service provision control unit 150, a suspicious person registration unit 160, a visit number counting unit 162, a visitor information notification unit 170, a visit history acquisition unit 180, and a visit history notification unit 182. The service provision control unit 150 also has a matching result display control unit 152, a visitor information display control unit 154, an operation image display control unit 156, and a report control unit 158. As described above, the service providing device 100 does not need to be physically configured as one device. In this case, each of the above-mentioned components may be realized by multiple physically separate devices.

[0035] The service providing device 100 provides a service according to the result of matching the face image of the visitor to the residence with the face image registered in advance, using these components. Furthermore, when the matching result shows a mismatch, the service providing device 100 controls the terminal device 40 to display an operation image for performing an operation to prevent the visitor from entering the residence.

[0036] The visitor registration unit 120 has a function as a visitor registration means. The visit information storage unit 122 has a function as a visit information storage means. The captured image acquisition unit 130 has a function as a captured image acquisition means. The face image transmission unit 132 has a function as a face image transmission means. The matching result acquisition unit 140 has a function as a matching result acquisition means (acquisition means). The matching result determination unit 142 has a function as a matching result determination means. The service provision control unit 150 has a function as a service provision control means (control means). The suspicious person registration unit 160 has a function as a suspicious person registration means. The visit number counting unit 162 has a function as a visit number counting means. The visitor information notification unit 170 has a function as a visitor information notification means. The visit history acquisition unit 180 has a function as a visit history acquisition means. The visit history notification unit 182 has a function as a visit history notification means. The matching result display control unit 152 has a function as a matching result display control means. The visitor information display control unit 154 functions as a visitor information display control unit. The operation image display control unit 156 functions as an operation image display control unit. The report control unit 158 ​​functions as a report control unit.

[0037] Each of the above-mentioned components can be realized, for example, by executing a program under the control of the control unit 102. More specifically, each of the components can be realized by the control unit 102 executing a program (instruction) stored in the storage unit 104. Each of the components may be realized by recording a necessary program in an arbitrary non-volatile recording medium and installing it as necessary. Each of the components may be realized not only by software using a program, but also by a combination of hardware, firmware, and software. Each of the components may be realized by using an integrated circuit programmable by a user, such as a field-programmable gate array (FPGA) or a microcomputer. In this case, the integrated circuit may be used to realize a program composed of each of the above-mentioned components.

[0038] The visitor registration unit 120 registers in advance at least a face image of a person who is scheduled to visit the residence (a planned visitor). Specifically, the visitor registration unit 120 registers visit information regarding the visit of the planned visitor. The visit information may include visitor information, visit destination information, and planned visit date and time, as described below.

[0039] The visitor registration unit 120 registers visitor information, which is information about a prospective visitor, by an operation of the prospective visitor (or a person in the prospective visitor's organization) before the prospective visitor visits the residence. The visitor registration unit 120 may register the visitor information by, for example, a website. Specifically, the visitor registration unit 120 makes a website for registering visitor information viewable on the terminal of the prospective visitor. The prospective visitor operates the terminal to upload the visitor information onto the website. The visitor information includes at least a facial image (registered facial image). The visitor information may also include personal information (such as name, telephone number, and name of organization) of the prospective visitor. Here, the prospective visitor related to the visitor information registered in the visitor registration unit 120 can be said to be a visitor registered in advance. And the visitor information can be said to be information about a visitor registered in advance. In this way, by registering at least a facial image of the prospective visitor in advance, it is possible to check whether or not a person who actually visits the residence is a legitimate visitor.

[0040] Furthermore, the visitor registration unit 120 may determine the authenticity of the face image by using, for example, certification information to prove that the face image included in the visitor information truly shows the face of the person planning to visit. The visitor information may include the certification information. The certification information may be information written on an official certificate. The official certificate may be, for example, an identification card such as a passport, a driver's license, or a personal identification number card. This configuration makes it possible to prevent impersonation by a third party different from the person planning to visit.

[0041] The visitor registration unit 120 may also register destination information, which is information about a residence that the prospective visitor plans to visit. The destination information may indicate, for example, information (such as an address) that identifies the location of the residence to be visited, the name of the resident of the residence to be visited, and the telephone number of the residence to be visited. The destination information may be registered by an operation of the prospective visitor, or may be registered by an operation of the resident of the residence to be visited. Here, the destination information may include identification information of the terminal device 40 of the resident of the residence to be visited in order to transmit information to the terminal device 40 of the resident of the residence to be visited and display the information. For example, the destination information may be associated with the ID of a message application of the resident of the residence to be visited. The message application may be, for example, an email or a social networking service (SNS). The "message application ID" may be, for example, an email address. In addition, when the terminal device 40 is a room master unit of an intercom system, the identification information of the terminal device 40 may not be the ID of the message application.

[0042] The visitor registration unit 120 may also register the date and time when the prospective visitor plans to visit the destination (scheduled visit date and time). The planned visit date and time may be registered by an operation of the prospective visitor, or may be registered by an operation of a resident of the residence of the destination. The visitor registration unit 120 may also register the reason why the prospective visitor visits the destination (reason for visiting). The reason for visiting may be registered by an operation of the prospective visitor. The reason for visiting may be, for example, "repairing a leaking toilet."

[0043] The visit information storage unit 122 stores the visit information registered by the visitor registration unit 120. The visit information storage unit 122 may store the visit information using the storage unit 104. The visit information storage unit 122 may store the visit information in association with an ID of a message application corresponding to visited destination information included in the visit information.

[0044] The photographed image acquisition unit 130 acquires a photographed image associated with the identification information of the residence from the photographing device 30. The face image transmission unit 132 transmits the photographed image acquired from the photographing device 30 to the face authentication device 50 as a face image of the visitor. The face image transmission unit 132 also transmits a face image (registered face image) registered by the visitor registration unit 120 to the face authentication device 50. At this time, the face image transmission unit 132 transmits to the face authentication device 50 a registered face image included in visit information related to the residence corresponding to the identification information of the residence associated with the photographed image. This enables the face authentication device 50 to compare the photographed image (the face image of the visitor) with the registered face image (a face image registered in advance).

[0045] The matching result acquisition unit 140 corresponds to the acquisition unit 12 in Fig. 1 described above. The matching result acquisition unit 140 receives the matching result between the face image shown in the captured image and the registered face image from the face authentication device 50. In other words, the matching result acquisition unit 140 acquires the matching result between the face image of the visitor to the residence and the face image registered in advance. The matching result determination unit 142 determines whether the acquired matching result indicates "match" or "mismatch."

[0046] The service provision control unit 150 corresponds to the control unit 14 in Fig. 1 described above. The service provision control unit 150 performs control to provide a service according to the matching result to the terminal device 40 of the resident corresponding to the matching result. Note that the "resident corresponding to the matching result" is a resident of a residence in which the photographing device 30 that captured the photographed image corresponding to the matching result is installed, and is a resident related to visit information including a registered face image corresponding to the matching result.

[0047] Specifically, the service provision control unit 150 transmits a command required for providing the service to the terminal device 40 using the ID (email address, etc.) of the message application associated with the visit information. This allows a predetermined service to be executed on the terminal device 40. For example, when the service provision control unit 150 causes the terminal device 40 to execute an operation, the service provision control unit 150 transmits a command for executing the operation to the terminal device 40. Furthermore, when the service provision control unit 150 causes the terminal device 40 to display an image, the service provision control unit 150 transmits a command for displaying the image to the terminal device 40.

[0048] The matching result display control unit 152 performs control to display the matching result on the terminal device 40. When the matching result indicates a match, the matching result display control unit 152 performs control to display information indicating that the matching result indicates a match on the terminal device 40 of the resident regarding the matching result. When the matching result indicates a mismatch, the matching result display control unit 152 performs control to display information indicating that the matching result indicates a mismatch on the terminal device 40 of the resident regarding the matching result. In this way, the terminal device 40 displays the matching result. Therefore, the resident can easily recognize whether or not a visitor to the residence is a visitor who has been registered in advance. Note that when the matching result indicates a match, the matching result display control unit 152 may perform control to display information indicating that the matching result indicates a match on the terminal carried by the visitor. In this way, the visitor can easily recognize that matching has been performed appropriately on his or her face image.

[0049] The visitor information display control unit 154 performs control to display the visitor information registered in advance on the terminal device 40. Specifically, when the matching result indicates a match, the visitor information display control unit 154 performs control to display the visitor information corresponding to the visitor on the terminal device 40. The visitor information displayed by the visitor information display control unit 154 corresponds to the visitor information related to the registered face image used in the matching related to the matching result. That is, the visitor information displayed by the visitor information display control unit 154 corresponds to the visitor information registered in advance. As a result, the terminal device 40 displays the visitor information. As a result, the resident can easily confirm what kind of person the visitor to the residence is. In addition, the visitor information display control unit 154 may perform control to display the reason for the visit on the terminal device 40 together with the visitor information. As a result, the terminal device 40 displays the reason for the visit. As a result, the resident can easily confirm what reason the visitor plans to visit the residence. Therefore, the service providing device 100 according to the present disclosure can give the resident a sense of security. In addition, such a configuration can suppress the occurrence of trouble.

[0050] The operation image display control unit 156 performs control to display an operation image on the terminal device 40. Specifically, the operation image display control unit 156 performs control to display, on the terminal device 40, an operation image for performing an operation to prevent a visitor from entering the residence when the collation result indicates a mismatch. More specifically, the operation image display control unit 156 performs control to display an operation button on the user interface of the terminal device 40.

[0051] For example, the operation image display control unit 156 may perform control to display a report button, an ignore button, and a response button on the user interface of the terminal device 40. The report button is a report operation image for reporting that a visitor is likely to be a suspicious person. The ignore button is a no-response operation image for not responding to the visitor. In other words, the operation image display control unit 156 performs control to display a report operation image for reporting as an operation image on the terminal device 40. In addition, the operation image display control unit 156 performs control to display a no-response operation image for not responding to the visitor as an operation image on the terminal device 40.

[0052] For example, if a resident wishes a visitor who has visited without registering in advance to leave quickly, the resident can operate the report button. When the report button is operated, a process is performed by the report control unit 158, which will be described later. Also, for example, if a resident wishes not to respond to a visitor who has visited without registering in advance, the resident can operate the ignore button. When the ignore button is operated, a process is performed by the suspicious person registration unit 160 and the visit number count unit 162, which will be described later. Note that, when the ignore button is operated, the service provision control unit 150 may perform control so that an operation is performed so that the resident does not respond to the visitor. For example, the service provision control unit 150 may perform control so that the function of the intercom system for communicating between the resident and the visitor is prohibited from being used. Also, for example, the service provision control unit 150 may perform control so that an automatic voice such as "Please leave" is output to the terminal device 40 or the intercom system of the residence. With such a configuration, the resident can take appropriate measures against a visitor who has visited without registering in advance. Therefore, the occurrence of trouble can be suppressed.

[0053] On the other hand, if a visitor who has not been registered in advance is an acquaintance of the resident and the resident decides that it is okay to respond to the visitor, the resident can operate the response button. In this case, the service provision control unit 150 may end the process.

[0054] When the report button (report operation image) displayed on the terminal device 40 is operated, the report control unit 158 ​​performs control to report that the visitor is highly likely to be a suspicious person. Specifically, when the report button (report operation image) is operated, the report control unit 158 ​​performs control to report to a security organization registered in advance. The "security organization" is, for example, the police or a security company contracted by the resident, but is not limited thereto. The security organization to be reported may be registered in advance by, for example, the resident. The report control unit 158 ​​may perform control to call the telephone number of the security organization. In this case, the report control unit 158 ​​may control the terminal device 40 to call the security organization. Alternatively, the report control unit 158 ​​may perform control to cause the terminal device 40 to display the telephone number of the security organization on the terminal device 40 and to display a message on the terminal device 40 urging the resident to call the security organization. With such a configuration, it becomes possible for the resident to take appropriate measures when he or she wishes to report. In particular, when a suspicious person visits, the resident may panic, but even in such a case, the service providing device 100 according to the present disclosure can notify a predetermined security organization of the suspicious person's visit. Therefore, the occurrence of trouble can be suppressed.

[0055] Furthermore, the notification control unit 158 ​​may perform control so as to make a notification when a predetermined condition is satisfied, even if the ignore button (no response operation image) is operated. This will be described in detail later.

[0056] When the no-response operation image (ignore button) is operated, the suspicious person registration unit 160 registers the face image of the visitor as a suspicious person face image. As a result, the face image of the visitor who visited the residence when the no-response operation image (ignore button) was operated is registered as the face image of the suspicious person. In other words, the fact that the no-response operation image was operated means that the resident judged that the visitor is highly likely to be a suspicious person even if there is no need to report it. Therefore, the face image of the visitor can be registered as the suspicious person face image. In addition, the suspicious person registration unit 160 may register the suspicious person face image together with the suspicious person's identification information. In addition, the suspicious person registration unit 160 may register the suspicious person face image for each residence (each resident). In this way, the face image of the visitor is registered as a suspicious person face image, so that the face of the suspicious person who visited the residence can be easily grasped.

[0057] The visit counting unit 162 counts the number of visits of a visitor whose face image matches the suspicious person face image registered by the suspicious person registration unit 160. That is, the visit counting unit 162 counts the number of visits when a visitor whose face image is registered visits the residence again. The visit counting unit 162 may set the number of visits to one when the suspicious person face image is registered by the suspicious person registration unit 160. Specifically, when a no-response operation image (ignore button) is operated, the visitor's face image is matched with the registered suspicious person face image. This matching may be performed by the face authentication device 50. The visit counting unit 162 increments the number of visits by one every time a visitor whose face image matches the registered suspicious person face image visits. The visit counting unit 162 may count the number of visits of a suspicious person for each residence (each resident).

[0058] Then, when the number of visits counted by the visit counting unit 162 is equal to or greater than a predetermined threshold, the report control unit 158 ​​may perform control to make a report as described above. This threshold may be set by the resident as appropriate. In this case, the report may be a report that a suspicious person frequently visits the residence. In addition, the report control unit 158 ​​may perform control to make a report to a security organization registered in advance as described above when the number of visits is equal to or greater than the threshold. With this configuration, it becomes possible to easily make a report when a suspicious person frequently visits the residence. Therefore, the occurrence of trouble can be suppressed.

[0059] The visitor information notification unit 170 performs a process for notifying at least one of the resident and the resident's family of the visitor information registered in advance. Specifically, when the visitor information is registered, the visitor information notification unit 170 controls the terminal device 40 owned by at least one of the resident and the resident's family to output the visitor information. The timing of the visitor information notification unit 170 to notify may be immediately after the visitor information is registered, or may be a predetermined time before the scheduled visit date and time related to the visitor information. The timing of the visitor information notification unit 170 to notify may be when the resident requests notification of the visitor information using the terminal device 40. With this configuration, the resident and his / her family can easily confirm what kind of person is scheduled to visit the residence. The visitor information notification unit 170 may also perform control to display the scheduled visit date and time on the terminal device 40 together with the visitor information. With this configuration, the resident and his / her family can easily confirm when the scheduled visitor is scheduled to visit the residence. The visitor information notification unit 170 may also control the display of the reason for the visit on the terminal device 40 together with the visitor information. This configuration allows the resident and his / her family to easily confirm the reason why the visitor is planning to visit the residence. This configuration also makes it possible to prevent the occurrence of trouble.

[0060] The ID of the message application of the family of the resident may be associated with the visitor information. In this case, the visitor information notification unit 170 may use the ID of the message application of the family to control the terminal device 40 of the family of the resident to output the visitor information. This also applies to the visit history notification unit 182 described later.

[0061] The visit history acquisition unit 180 acquires the visit history of visitors to the residence. Specifically, the visit history acquisition unit 180 updates the visit history every time a visitor visits the residence of a resident who uses the service providing system 20. The visit history may include, for example, the date and time of a visit by a given visitor, a facial image of the visitor, a comparison result between a facial image registered in advance and the facial image of the visitor, and the like.

[0062] The visit history notification unit 182 performs processing for notifying at least one of the resident and the resident's family of the visit history acquired by the visit history acquisition unit 180. Specifically, the visit history notification unit 182 controls the terminal device 40 owned by at least one of the resident and the resident's family to output the visit history. The timing of the visit history notification unit 182 to notify may be immediately after the visit history is updated, or may be when the resident or the family requests notification of the visit history using the terminal device 40. With this configuration, it is possible to easily check what kind of person has visited the residence in the past. Furthermore, with this configuration, it is possible to easily check what kind of person has visited the residence even when the resident is away.

[0063] 6 and 7 are flowcharts showing an example of processing executed by the service providing system 20 according to the present disclosure. FIG. 6 and FIG. 7 show a service providing method executed by the service providing system 20 according to the present disclosure. FIG. 6 and FIG. 7 may be executed mainly by the service providing device 100. Note that when each component shown in FIG. 5 is realized by cloud computing or multiple computers, FIG. 6 and FIG. 7 may be executed by the service providing device 100 realized by cloud computing or multiple computers. Note that the processing described in FIG. 6 and FIG. 7 is merely an example.

[0064] The service providing device 100 registers visitor information in advance (step S102). Specifically, the visitor registration unit 120 registers the visitor information before the visitor comes to the residence, as described above. Then, the service providing device 100 notifies the visitor information registered in advance (step S104). Specifically, the visitor information notification unit 170 notifies at least one of the resident and the family of the visitor information registered in advance, as described above.

[0065] When a visitor comes to the residence, the photographing device 30 photographs the visitor (step S106). Note that the visitor is not necessarily a visitor who has been registered in advance. Then, as described above, the face authentication device 50 compares the face image of the visitor to the residence with the face images registered in advance (step S108).

[0066] The service providing device 100 acquires the matching result (step S110). Specifically, the matching result acquisition unit 140 acquires the matching result from the face authentication device 50. Then, the matching result determination unit 142 determines whether the acquired matching result indicates a match or a mismatch (step S112).

[0067] If the matching result indicates a match ("Match" in S112), the service providing device 100 causes the terminal device 40 of the resident of the residence to display the matching result (step S114). The service providing device 100 also causes the terminal device 40 of the resident of the residence to display the visitor information (step S116). Specifically, as described above, the matching result display control unit 152 performs control to cause the terminal device 40 of the resident regarding the matching result to display information indicating that the matching result indicates a match. Furthermore, the visitor information display control unit 154 performs control to cause the terminal device 40 of the resident regarding the matching result to display visitor information corresponding to the visitor. As a result, the terminal device 40 of the resident displays information indicating that the matching result indicates a match and the visitor information corresponding to the visitor. Then, the process flow may end, or may return to the process of S102 or S106.

[0068] On the other hand, if the matching result indicates a mismatch ("Mismatch" in S112), the service providing device 100 causes the terminal device 40 of the resident of the residence to display an operation image (step S120). Specifically, the operation image display control unit 156 performs control to cause the terminal device 40 of the resident to display an operation image including a report operation image (report button) and a no-response operation image (ignore button). As a result, the terminal device 40 of the resident displays the operation image. As described above, the terminal device 40 may display a response button as the operation image. Then, when the resident operates the response button, the process flow may end or may return to the process of S102 or S106. Also, in the process of S120, the matching result display control unit 152 may perform control to cause the terminal device 40 of the resident to display information indicating that the matching result indicates a mismatch, regarding the matching result, as described above.

[0069] The service providing device 100 judges whether or not an operation has been performed on the report operation image (step S122). If an operation has been performed on the report operation image (YES in S122), the service providing device 100 performs control for reporting (step S124). Specifically, the report control unit 158 ​​performs control for reporting to a security organization registered in advance, as described above. Then, the processing flow may end, or may return to the processing of S102 or S106.

[0070] On the other hand, if no operation is performed on the report operation image (NO in S122), the service providing device 100 judges whether or not an operation is performed on the no-response operation image (step S130). If no operation is performed on the no-response operation image (NO in S130), the process flow returns to S120. On the other hand, if an operation is performed on the no-response operation image (YES in S130), the service providing device 100 performs control so that the resident does not respond to the visitor (step S132). Specifically, the service provision control unit 150 performs control so that an operation is performed so that the resident does not respond to the visitor, as described above.

[0071] The service provision control unit 150 judges whether the face image of the visitor matches the registered suspicious person face image (step S140). Specifically, the service provision control unit 150 judges whether the face image of the visitor when the no-response operation image is operated matches any of the suspicious person face images registered by the suspicious person registration unit 160. More specifically, the service provision control unit 150 acquires a collation result between the face image of the visitor when the no-response operation image is operated and the suspicious person face image registered by the suspicious person registration unit 160. Note that the face image transmission unit 132 (or the service provision control unit 150) may transmit the face image of the visitor when the no-response operation image is operated and the suspicious person face image registered by the suspicious person registration unit 160 to the face authentication device 50. In this case, the face authentication device 50 performs collation between the face image of the visitor and the suspicious person face image to generate a collation result. Then, the face authentication device 50 transmits the collation result to the service provision device 100. The match result determination unit 142 (or the service provision control unit 150) determines whether the match result indicates a match or a mismatch.

[0072] If the visitor's facial image does not match the registered suspicious person facial image (NO in S140), the visitor's facial image at the time when the no-response operation image was operated has not yet been registered as a suspicious person facial image. Therefore, the service providing device 100 registers the visitor's facial image as a suspicious person facial image (step S142). Specifically, the suspicious person registration unit 160 registers the visitor's facial image as a suspicious person facial image by attaching identification information different from the identification information of the suspicious person facial image already registered. At this time, the visit number counting unit 162 may set the number of visits of the suspicious person to one. Then, the processing flow may end, or may return to the processing of S102 or S106.

[0073] On the other hand, if the visitor's face image matches the registered suspicious person's face image (YES in S140), it means that the person registered as a suspicious person has visited the residence again. Therefore, the service providing device 100 increments the number of visits by the suspicious person (step S144). Specifically, the visit number counting unit 162 increments the number of visits by the suspicious person by one, and updates the number of visits.

[0074] The service providing device 100 judges whether or not the number of visits of the suspicious individual is equal to or greater than a threshold (step S146). Specifically, the service providing control unit 150 judges whether or not the number of visits to a certain residence of the suspicious individual whose face image is registered by the suspicious individual registration unit 160 is equal to or greater than a predetermined threshold. If the number of visits is not equal to or greater than the threshold (NO in S146), the process flow may end or may return to the process of S102 or S106.

[0075] On the other hand, if the number of visits is equal to or greater than the threshold (YES in S146), the service providing device 100 performs control for reporting (step S148). Specifically, the reporting control unit 158 ​​performs control for reporting to a security organization registered in advance, as described above. Then, the processing flow may end, or may return to the processing of S102 or S106.

[0076] 8 is a diagram illustrating a pre-registration image Im1 displayed when registration is performed by the visitor registration unit 120 according to the present disclosure. The pre-registration image Im1 may be displayed on the terminal of the prospective visitor in the process of S102. The pre-registration image Im1 may be, for example, an image of a website for registering visitor information. The pre-registration image Im1 may be displayed on the terminal of the prospective visitor under the control of the visitor registration unit 120. The pre-registration image Im1 may display visitor information, destination information, planned visit date and time, and reason for visit.

[0077] The prospective visitor may operate the "Facial Image" field in the visitor information displayed in the pre-registration image Im1 to upload his / her facial image onto the website. The prospective visitor may also operate the "Certification Information" field in the visitor information displayed in the pre-registration image Im1 to upload his / her certification information (such as a personal identification number) onto the website. The prospective visitor may also operate the "Company Name" field in the visitor information displayed in the pre-registration image Im1 to upload the name of the organization to which he / she belongs onto the website. The prospective visitor may also operate the "Name" field in the visitor information displayed in the pre-registration image Im1 to upload his / her name onto the website. The prospective visitor may also operate the "Telephone Number" field in the visitor information displayed in the pre-registration image Im1 to upload his / her telephone number onto the website.

[0078] The visiting destination information displayed in the pre-registered image Im1 may include an "address", a "name", and a "phone number". The visiting destination information displayed in the pre-registered image Im1 may be registered in advance by an operation of a resident of the visiting residence. As described above, the visiting destination information may be associated with the ID of the resident's message application (identification information of the resident's terminal device 40). The person who plans to visit may operate the "scheduled visit date and time" field displayed in the pre-registered image Im1 to upload the date and time of the planned visit to the residence whose address is indicated in the visiting destination information onto a website. The person who plans to visit may operate the "reason for visit" field displayed in the pre-registered image Im1 to upload the reason for visiting the residence whose address is indicated in the visiting destination information onto a website.

[0079] 9 is a diagram illustrating a visitor information notification image Im2 displayed by the processing of the visitor information notification unit 170 according to the present disclosure. The visitor information notification image Im2 may be displayed on the terminal device 40 of a resident or the like associated with the visitor information in the processing of S104. The visitor information displayed in the visitor information notification image Im2 may include the "face image", "company name", "name", and "telephone number" of the person scheduled to visit. The visitor information notification image Im2 may also display the scheduled date and time of the visit. The visitor information notification image Im2 may also display the reason for the visit.

[0080] FIG. 10 is a diagram illustrating a display image Im3 displayed when the matching result indicates a match in the present disclosure. The display image Im3 may be displayed on the terminal device 40 of the resident or the like associated with the visitor information in the processes of S114 and S116. The display image Im3 displays a message indicating "matching result: match". The display image Im3 may display a message such as "matched with the pre-registered visitor" as a message indicating "matching result: match". The display image Im3 also displays the visitor information. The visitor information displayed on the display image Im3 may include the visitor's "face image", "company name", "name", and "phone number". The display image Im3 may also display the reason for the visit. The display image Im3 may be displayed not only on the resident's terminal device 40 but also on the visitor's terminal.

[0081] FIG. 11 is a diagram illustrating an example of an operation image Im4 displayed when the comparison result indicates a mismatch in the present disclosure. The operation image Im4 may be displayed on the terminal device 40 of the resident or the like associated with the visitor information in the process of S120. Even when the resident is not at home, the operation image Im4 may be displayed on the terminal device 40 in the same manner. This allows the resident to take some kind of action in response to the visit even when he or she is away from home. Also, when the resident is not at home, for example, the resident may operate the terminal device 40 to display the operation image Im4 on the terminal of the resident's family member.

[0082] The operation image Im4 displays a message indicating "Matching result: Mismatch". The operation image Im4 may display a message such as "Did not match the pre-registered visitor" as a message indicating "Matching result: Mismatch". In addition, the operation image Im4 displays a report operation image Im42, a no-response operation image Im44, and a response operation image Im46.

[0083] When the report operation image Im42 is operated, as described above, the process for reporting is performed under the control of the report control unit 158. For example, the terminal device 40 may display a message of "Reporting" and call a security organization registered in advance. Also, for example, the terminal device 40 may display a message such as "Please report to security organization (phone number)."

[0084] When the no-response operation image Im44 is operated, the service provision control unit 150 controls the resident to perform an operation to not respond to the visitor, as described above. Furthermore, the visitor is registered as a suspicious person by the processing of the suspicious person registration unit 160. Furthermore, when the response operation image Im46 is operated, the processing of the service providing device 100 ends, and the terminal device 40 may stop displaying the operation image Im4.

[0085] FIG. 12 is a diagram illustrating a visit history notification image Im5 displayed by the processing of the visit history notification unit 182 according to the present disclosure. The visit history notification image Im5 may be displayed on the terminal device 40 of a resident or the like by the processing of the visit history notification unit 182. The visit history notification image Im5 may display the date and time of the visit by the visitor, the face image of the visitor, the collation result of the face image of the visitor with a face image registered in advance, and the identification information of the visitor as a visit history. The visit history notification image Im5 may also display the number of visits by a suspicious person. The visit history notification image Im5 may also display the face image of the visitor as a thumbnail image.

[0086] In the example of FIG. 12, the visit history notification image Im5 indicates that a visitor represented by face image #1 visited at date and time #1, that the matching result at that time indicates a match, and that the visitor is a "registered visitor A" registered in advance. The visit history notification image Im5 also indicates that a visitor represented by face image #2 visited at date and time #2, that the matching result at that time indicates a mismatch, and that the visitor is a "suspicious person A". The visit history notification image Im5 also indicates that a visitor represented by face image #3 visited at date and time #3, that the matching result at that time indicates a match, and that the visitor is a "registered visitor B" registered in advance. The visit history notification image Im5 also indicates that a visitor represented by face image #4 visited at date and time #4, that the matching result at that time indicates a mismatch, and that the visitor is a "suspicious person A". In this case, the resident can see that the same suspicious person A visited at date and time #2 and date and time #4 by checking the visit history notification image Im5.

[0087] (Modification) If multiple people are scheduled to visit a certain residence, multiple pieces of visitor information may be registered for the residence. In this case, face images may be collated using face images included in the visitor information (registered face images) in order of the visitor's planned visit date and time closest to the current time.

[0088] Furthermore, the photographed image generated by the photographing device 30 may be directly transmitted from the photographing device 30 to the face authentication device 50. In this case, the photographing device 30 may transmit the photographed image (image data) of the visitor's face together with the identification information of the residence where the photographing device 30 is installed to the face authentication device 50. In this case, the face authentication device 50 may transmit the identification information of the residence to the service providing device 100. Then, the service providing device 100 may transmit the registered face image included in the visit information corresponding to the identification information of the residence to the face authentication device 50. Furthermore, the service providing device 100 may transmit one or more pieces of visitor information for a predetermined number of days to the face authentication device 50 in advance. In this case, the face authentication device 50 may compare the registered face image included in each of the one or more pieces of visitor information for the predetermined number of days with the face image included in the photographed image transmitted from the photographing device 30.

[0089] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.

[0090] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but to one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing may be combined with features or steps shown in one or more other drawings to create an embodiment not explicitly shown or described, for example. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0091] The above-mentioned program includes a set of instructions (or software code) for making the computer perform one or more functions described in the embodiment when the program is loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or the tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disk (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or the communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0092] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) An acquisition means for acquiring a result of matching a face image of a visitor to the residence with a face image registered in advance; a control means for controlling a terminal of a resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence when the comparison result indicates a mismatch; and A service providing device having the above configuration. (Appendix 2) The control means performs control to display, on the terminal as the operation image, a report operation image for making a report when the comparison result indicates a mismatch. 2. A service providing apparatus as described in claim 1. (Appendix 3) The control means performs control for notifying a pre-registered security organization when the notification operation image is operated. 3. A service providing apparatus as described in claim 2. (Appendix 4) The control means performs control to display, on the terminal as the operation image, a no-response operation image for not responding to the visitor when the comparison result indicates a mismatch. 2. A service providing apparatus as described in claim 1. (Appendix 5) a suspicious person registration means for registering a face image of the visitor as a suspicious person face image when the no-response operation image is operated; 5. The service providing device according to claim 4, further comprising: (Appendix 6) the control means performs control to issue a report when the number of visits of a visitor whose face image matches the registered suspicious person face image becomes equal to or exceeds a predetermined threshold value. 6. A service providing apparatus as described in appendix 5. (Appendix 7) The control means performs control to notify a pre-registered security organization when the number of visits is equal to or greater than the threshold value. 7. A service providing apparatus as described in appendix 6. (Appendix 8) When the comparison result indicates a match, the control means performs control to display visitor information, which is information about the visitor that has been registered in advance, on the terminal. 2. A service providing apparatus as described in claim 1. (Appendix 9) a visitor registration means for registering in advance at least a face image of a person who is scheduled to visit the residence; 2. The service providing device of claim 1, further comprising: (Appendix 10) a visitor information notifying means for performing a process for notifying at least one of the resident and the resident's family of visitor information, which is information about a visitor registered in advance; 2. The service providing device of claim 1, further comprising: (Appendix 11) a visit history notifying means for performing processing for notifying at least one of the resident and the family of the resident of the visitor history of the visitor to the residence; 2. The service providing device of claim 1, further comprising: (Appendix 12) Obtaining a match between the facial image of the visitor to the residence and a pre-registered facial image, and when the comparison result indicates a mismatch, controlling the display of an operation image on a terminal of a resident of the residence to allow the resident to perform an operation to prevent the visitor from entering the residence. How we provide services. (Appendix 13) Obtaining a match between a face image of a visitor to the residence and a pre-registered face image; performing control so that, when the comparison result indicates a mismatch, an operation image for performing an operation to prevent the visitor from entering the residence is displayed on a terminal of a resident of the residence; A program that causes a computer to execute the following.

[0093] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 11 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 12 and 13 in the same dependent relationship as Supplementary Notes 2 to 11. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]

[0094] 1 Service provision equipment 12 Acquisition Department 14 Control section 20 Service Delivery System 30 Imaging Equipment 40 Terminal Equipment 50 Face Recognition Device 100 Service providing device 120 Visitor Registration Department 122 Visit information storage section 130 Image capture unit 132 Facial image transmission unit 140 Matching result acquisition unit 142 Matching result judgment unit 150 Service provision control section 152 Matching result display control unit 154 Visitor information display control section 156 Operation image display control unit 158 Reporting Control Unit 160 Suspicious Persons Registration Department 162 Visit Counting Department 170 Visitor Information Notification Department 180 Visit History Acquisition Department 182 Visit History Notification Department

Claims

1. An acquisition means for acquiring a result of matching a face image of a visitor to the residence with a face image registered in advance; a control means for controlling a terminal of a resident of the residence to display an operation image for performing an operation to prevent the visitor from entering the residence when the comparison result indicates a mismatch; and A service providing device having the above configuration.

2. The control means performs control to display, on the terminal as the operation image, a report operation image for making a report when the comparison result indicates a mismatch. The service providing device according to claim 1 .

3. The control means performs control for notifying a pre-registered security organization when the notification operation image is operated. The service providing device according to claim 2 .

4. The control means performs control to display, on the terminal as the operation image, a no-response operation image for not responding to the visitor when the comparison result indicates a mismatch. The service providing device according to claim 1 .

5. a suspicious person registration means for registering a face image of the visitor as a suspicious person face image when the no-response operation image is operated; The service providing device according to claim 4 , further comprising:

6. the control means performs control to issue a report when the number of visits of a visitor whose face image matches the registered suspicious person face image becomes equal to or exceeds a predetermined threshold value. The service providing device according to claim 5 .

7. When the comparison result indicates a match, the control means performs control to display visitor information, which is information about the visitor that has been registered in advance, on the terminal. The service providing device according to claim 1 .

8. a visitor registration means for registering in advance at least a face image of a person who is scheduled to visit the residence; The service providing device according to claim 1 , further comprising:

9. Obtaining a match between the facial image of the visitor to the residence and a pre-registered facial image, and when the comparison result indicates a mismatch, controlling the display of an operation image on a terminal of a resident of the residence for performing an operation to prevent the visitor from entering the residence. How we provide services.

10. Obtaining a match between a face image of a visitor to the residence and a pre-registered face image; performing control so that, when the comparison result indicates a mismatch, an operation image for performing an operation to prevent the visitor from entering the residence is displayed on a terminal of a resident of the residence; A program that causes a computer to execute the following.

Images