Visitor authentication device, visitor authentication method, and program

Abstract

To provide a visitor authentication device that allows a person getting a visit to recognize that a visitor is a regular person in charge of visit.SOLUTION: A visitor authentication device comprises: a biological information acquisition unit that acquires face image data obtained by photographing a face picture attached to an identification card owned by a person in charge of visit, and face image data obtained by photographing the face of a visitor; an authentication unit that authenticates if the visitor is the person in charge of visit by using that face image data of the face picture attached to the identification card and the face image data of the visitor; a notification information generation unit that generates notification information including a result of the authentication; and a transmission unit that transmits the generated notification information to a person-getting-a-visit terminal used by a person getting a visit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a visitor authentication device, a visitor authentication method, and a program. [Background technology]

[0002] The Home Visiting Program for All Infant Families (Hello Baby Program) is an activity in which public health nurses and other staff visit all homes with infants up to four months old. By visiting the target individuals, the staff are able to listen to any anxieties or worries they may have. According to the Home Visiting Program for All Infant Families, by visiting the target individuals, the staff can assess whether or not support is needed for the target families. For families that are determined to need support, appropriate services are provided depending on the situation.

[0003] Patent Document 1 discloses a visit support system in which a visit management device and a staff member terminal are connected via a communications network. The visit management device stores information related to visit schedules, information related to customers, and information related to visiting staff members, correlating them with one another. The visit management device receives information indicating the visit history of the visiting staff member from the staff member terminal via the communications network. The visit management device determines the next destination that the visiting staff member should visit based on the received history information and the stored information. Based on the determined destination, the visit management device acquires map information including a travel route to the destination. The visit management device transmits information related to the determined destination and the acquired map information to the visiting staff member's terminal via the communications network. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-295664 Summary of the Invention [Problem to be solved by the invention]

[0005] Visitors to homes may include suspicious individuals. In the home visit program for all infant households, there have been cases where the visitor was unable to meet with the person being visited because they were unable to prove that they were the visitor, even when the person being visited was at home. If such incidents occurred frequently, the efficiency of visits would decrease. With the method of Patent Document 1, the visitor could not determine whether the person being visited is suspicious, and so there was a possibility that the visitor would be unable to meet with the person being visited, even when the person being visited was at home. If the person being visited could recognize that the visitor was a legitimate visitor, it would be necessary to make visits more efficient.

[0006] An object of the present disclosure is to provide a visitor authentication device, a visitor authentication method, and a program that allow a person to be visited to recognize that the visitor is a legitimate visiting person. [Means for solving the problem]

[0007] A visitor authentication device according to one aspect of the present disclosure includes a biometric information acquisition unit that acquires facial image data of a photograph of the face affixed to an identification card held by the visiting officer and facial image data of a photograph of the visitor's face; an authentication unit that uses the facial image data of the photograph of the face affixed to the identification card and the facial image data of the visitor to authenticate whether the visitor is the visiting officer; a notification information generation unit that generates notification information including the authentication result; and a transmission unit that transmits the generated notification information to a visitor terminal used by the person to be visited.

[0008] In one aspect of the visitor authentication device of the present disclosure, a computer acquires facial image data of a photograph of the face attached to an identification card held by the visiting officer and facial image data of a photograph of the visitor's face, and uses the facial image data of the photograph of the face attached to the identification card and the facial image data of the visitor to authenticate whether the visitor is the visiting officer, generates notification information including the authentication result, and sends the generated notification information to a visitor terminal used by the person to be visited.

[0009] A program according to one embodiment of the present disclosure causes a computer to perform the following processes: acquiring facial image data of a photograph of the face attached to an identification card held by the visiting officer and facial image data of a photograph of the visitor; authenticating whether the visitor is the visiting officer using the facial image data of the photograph of the face attached to the identification card and the facial image data of the visitor; generating notification information including the authentication result; and sending the generated notification information to a visiting person terminal used by the person to be visited. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to provide a visitor authentication device, a visitor authentication method, and a program that allow the person being visited to recognize that the visitor is a legitimate visiting person. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a conceptual diagram for explaining a visitor authentication system including a visitor authentication device according to the present disclosure. [Figure 2] 1 is a block diagram illustrating an example of the configuration of a visitor authentication device according to the present disclosure. [Figure 3] FIG. 10 is a conceptual diagram showing an example of processing and information flow in a visit notification phase. [Figure 4] 10 is a flowchart illustrating an example of a process flow in a visit notification phase. [Figure 5] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 6] FIG. 10 is a conceptual diagram showing an example of processing and information flow in a primary authentication phase. [Figure 7] 10 is a flowchart illustrating an example of a processing flow in a primary authentication phase. [Figure 8] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 9]10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 10] FIG. 10 is a conceptual diagram showing an example of processing and information flow in a secondary authentication phase. [Figure 11] 10 is a flowchart illustrating an example of a processing flow in a secondary authentication phase. [Figure 12] FIG. 10 is a conceptual diagram for explaining an example of capturing and transmitting a face image of a visitor. [Figure 13] FIG. 10 is a conceptual diagram for explaining another example of capturing and transmitting a face image of a visitor. [Figure 14] FIG. 10 is a conceptual diagram for explaining yet another example of capturing and transmitting a face image of a visitor. [Figure 15] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 16] 10 is a conceptual diagram showing an example of notification information displayed on the screen of a management terminal used by a manager of a visiting business. FIG. [Figure 17] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 18] 10 is a conceptual diagram showing an example of notification information displayed on the screen of a management terminal used by a manager of a visiting business. FIG. [Figure 19] 1 is a block diagram illustrating an example of the configuration of a visitor authentication device according to the present disclosure. [Figure 20] FIG. 10 is a conceptual diagram showing an example of processing and information flow in an authentication phase. [Figure 21] 10 is a flowchart illustrating an example of a processing flow in an authentication phase. [Figure 22] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 23] FIG. 10 is a conceptual diagram showing an example of verification of a visiting person using an authentication code. [Figure 24]FIG. 10 is a conceptual diagram showing an example of processing and information flow in an authentication phase. [Figure 25] 10 is a flowchart illustrating an example of a processing flow in an authentication phase. [Figure 26] 10 is a conceptual diagram showing an example of how notification information is displayed on the screen of a target visitor terminal used by the target visitor. FIG. [Figure 27] FIG. 10 is a conceptual diagram showing an example of verification of a visiting person using an authentication code (two-dimensional code). [Figure 28] 1 is a block diagram illustrating an example of the configuration of a visitor authentication device according to the present disclosure. [Figure 29] 10 is a flowchart illustrating an example of the operation of the visitor authentication device according to the present disclosure. [Figure 30] FIG. 2 is a block diagram illustrating an example of a hardware configuration for executing processing according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments for implementing the present disclosure will be described with reference to the drawings. In this disclosure, the drawings used in the description of each embodiment relate to one or more embodiments. Furthermore, elements included in each drawing may apply to one or more embodiments. The embodiments described below are limited in a manner that is technically preferable for implementing the present disclosure, but this does not limit the scope of the disclosure to the following. In all drawings used to describe the following embodiments, similar parts are designated by the same reference numerals unless otherwise specified. In the following embodiments, repeated description of similar configurations and operations may be omitted. The direction of arrows in the drawings is an example and does not limit the direction of signals, etc.

[0013] (First embodiment) First, a visitor authentication device according to a first embodiment will be described with reference to the drawings. The visitor authentication device of this embodiment authenticates whether a visitor to a private residence is a legitimate visiting officer dispatched by a local government or the like. The visitor authentication device of this embodiment notifies the person to be visited of the authentication result regarding the visitor.

[0014] The method of this embodiment can be applied to home visits, which are included in administrative services. In this embodiment, an example is given of a home visit program for all households with infants (Hello Baby Program), which is one of the administrative services led by local governments. In this case, the visitor is a staff member such as a public health nurse. In the home visit program for all households with infants, the people to be visited are residents of households with infants up to four months old. In the following, it is assumed that the visitor and the people to be visited use mobile devices such as smartphones and tablets. It is assumed that application software for the visitor (also referred to as a visitor app) is installed on the mobile device used by the visitor. It is also assumed that application software for the people to be visited (also referred to as a person to be visited app) is installed on the mobile device used by the people to be visited. The method of this embodiment can also be applied to home visits, which are not included in administrative services.

[0015] The following example shows how to identify a visiting officer using a personal authentication system that uses an ID card, such as a personal number card (My Number card). For example, a personal number card contains a set of an individual's personal identification number and facial image data (hereafter referred to as "facial image"). A personal number card is equipped with an integrated circuit (IC) chip. The IC chip in a personal number card records the information printed on the card, matters specified by the Ministry of Internal Affairs and Communications (MIC) regulations, and matters specified by municipal ordinances. The information printed on the card includes the name, date of birth, gender, personal number (My Number), and a photograph of the individual (hereafter referred to as "photo"). The matters specified by the MIC regulations include an electronic certificate related to the Japanese Public Key Infrastructure (JPKI). The matters specified by municipal ordinances record information specific to each municipal ordinance. This embodiment can be applied to a personal authentication system that uses not only an Individual Number Card but also public identification with a photograph, such as a driver's license, passport, photo-attached resident registration card, or residence card. This embodiment can also be applied to a personal authentication system that uses identification cards with a photograph, such as an employee ID or student ID. For example, the method of this embodiment can also be applied to a personal authentication system that uses not only a facial image but also biometric information such as a voiceprint, fingerprint, vein, or iris.

[0016] (composition) FIG. 1 is a conceptual diagram illustrating a visitor authentication system including a visitor authentication device according to the present disclosure. For example, the visitor authentication device 10 is constructed in the cloud or on a server. The visitor authentication device 10 is connected to a terminal device (visitor terminal 160) used by the visiting person via a network such as the Internet. The visitor authentication device 10 is also connected to a terminal device (target visitor terminal 170) used by the person to be visited via a network such as the Internet. The visitor terminal 160 and the target visitor terminal 170 are general-purpose mobile terminals. For example, the visitor terminal 160 and the target visitor terminal 170 are realized as mobile terminals such as smartphones or tablets. The target visitor terminal 170 may also be realized as a desktop personal computer, a laptop personal computer, a dedicated terminal device, or the like.

[0017] 2 is a block diagram showing an example of the configuration of a visitor authentication device according to the present disclosure. Visitor authentication device 10 includes visit information acquisition unit 11, visit information storage unit 12, notification information generation unit 13, transmission unit 14, biometric information acquisition unit 15, and authentication unit 16. Authentication unit 16 is connected to personal authentication system 150. For example, personal authentication system 150 is an authentication system that uses an IC card, such as a personal number card, that can identify an individual. A personal number for identifying an individual and the individual's biometric information are registered as a set in personal authentication system 150. The following describes an example in which a facial image is used as biometric information.

[0018] The visit information acquisition unit 11 acquires information (visit information) including a schedule for the visiting person to be visited by the visiting person. The visit information acquisition unit 11 stores the acquired visit information in the visit information storage unit 12. The visit information includes the date and time when the visiting person will visit the person to be visited, and information about the visiting person (visitor information). The visitor information includes the name of the visiting person. For example, the visitor information may include attributes of the visiting person. For example, the visiting person attributes include gender and age. It is preferable that the visiting person's attributes are characteristics that allow the visiting person to be recognized at a glance.

[0019] For example, the visit information is registered by the visiting officer using the visitor terminal 160. For example, the visit information is read using a card reader that reads information recorded on the IC chip of the visiting officer's personal identification number card. For example, the visit information may be registered using a terminal device other than the visitor terminal 160. For example, the visit information may be entered by an administrator who manages visits by the visiting officer or by an administrative staff member of the visiting business. The visit information may also be automatically entered based on preset rules. For example, the visit information may be registered according to the schedule of the visiting officer engaged in the visiting business. For example, if the same visiting officer is scheduled to visit multiple neighboring people in turn on the same day, the efficiency of visits by the people to be visited can be improved.

[0020] The visit information storage unit 12 stores the visit information acquired by the visit information acquisition unit 11. The visit information stored in the visit information storage unit 12 is used for notifying the person to be visited and for authenticating the visitor.

[0021] The notification information generation unit 13 generates notification information including information about a visit to the person to be visited. The notification information generation unit 13 generates different types of notification information before and during the visit. In the pre-visit phase (visit notification phase), the notification information generation unit 13 generates notification information including a visit notification informing the person to be visited that a visiting person will be visiting. In the visit phase (authentication phase), the notification information generation unit 13 generates notification information including an authentication result indicating whether the visitor is a legitimate visiting person. The authentication phase includes a primary authentication phase and a secondary authentication phase. The primary authentication phase is a phase in which the visiting person is authenticated before the visit. For example, the primary authentication phase is the stage where the visiting person is determined the day before or the day of the visit. In the primary authentication phase, the visitor is authenticated as a legitimate visiting person based on the identification information and facial image sent from the visitor terminal 160 used by the visitor. The authentication result in the primary authentication phase is also called a primary authentication result. In the primary authentication phase, the notification information generation unit 13 generates notification information including primary authentication information according to the primary authentication result. The secondary authentication phase is the stage at which the visiting officer visits the person to be visited. In the secondary authentication phase, the visitor is authenticated as being a legitimate visiting officer based on a facial image of the visitor sent from the person to be visited terminal 170 used by the person to be visited. The authentication result in the secondary authentication phase is also called the secondary authentication result. In the secondary authentication phase, the notification information generation unit 13 generates notification information including secondary authentication information according to the secondary authentication result.

[0022] The transmission unit 14 transmits the notification information generated by the notification information generation unit 13. In each of the visit notification phase, the primary authentication phase, and the secondary authentication phase, the transmission unit 14 transmits the notification information to a predetermined target. In the visit notification phase, the transmission unit 14 transmits the notification information to the person to be visited. In the primary authentication phase, the transmission unit 14 transmits the notification information to the person to be visited. In the secondary authentication phase, the transmission unit 14 transmits the notification information to the person to be visited and the administrator.

[0023] Biometric information acquisition unit 15 acquires a facial image transmitted from visitor terminal 160 or target visitor terminal 170. The biometric information includes the visitor's facial image. The biometric information may also include the visitor's voiceprint, fingerprints, veins, iris, etc.

[0024] The authentication unit 16 performs primary and secondary authentication to authenticate whether the visitor is a visiting officer. In the primary authentication, the authentication unit 16 authenticates whether the visitor is a visiting officer based on a facial image sent from the visitor terminal 160. In the secondary authentication, the authentication unit 16 authenticates whether the visitor is a visiting officer based on a facial image sent from the target visitor terminal 170. The authentication unit 16 outputs the authentication results of the primary and secondary authentication to the notification information generation unit 13.

[0025] For example, the authentication unit 16 uses image recognition AI (Artificial Intelligence) to identify whether the facial image sent from the visitor terminal 160 matches the facial image of the visiting officer. The image recognition AI includes a trained machine learning model. In response to an input facial image, the trained machine learning model outputs an inference result indicating whether the person in the facial image is a legitimate visiting officer. There are no particular limitations on the algorithm used to train the trained machine learning model.

[0026] In the primary authentication, the authentication unit 16 authenticates whether the person in the facial image sent from the visitor terminal 160 is the visiting officer. If the person in the facial image sent from the visitor terminal 160 is the visiting officer, the authentication unit 16 outputs a primary authentication result (OK) indicating that the person is the visiting officer to the notification information generation unit 13. If the person in the facial image sent from the visitor terminal 160 is not the visiting officer, the authentication unit 16 outputs a primary authentication result (NG) indicating that the person is not the visiting officer to the notification information generation unit 13.

[0027] In the secondary authentication, authentication unit 16 authenticates whether the person in the facial image sent from target visitor terminal 170 is the visiting officer. If the person in the facial image sent from target visitor terminal 170 is the visiting officer, authentication unit 16 outputs a secondary authentication result (OK) indicating that the person is the visiting officer to notification information generation unit 13. If the person in the facial image sent from target visitor terminal 170 is not the visiting officer, authentication unit 16 outputs a secondary authentication result (NG) indicating that the person is not the visiting officer to notification information generation unit 13.

[0028] [Visit notification phase] Next, the visit notification phase will be described with reference to the drawings. FIGS. 3 to 5 are conceptual diagrams for explaining the visit notification phase. The following description of the visit notification phase will show the relationship between the visitor terminal 160, visitor authentication device 10, and target visitor terminal 170. In the visit notification phase, the visiting person uses the visitor terminal 160 to register visit information related to the visiting person in the visitor authentication device 10. The visitor authentication device 10 generates notification information including a visit notification according to the registered visit information. The visitor authentication device 10 sends the generated notification information to the target visitor terminal 170.

[0029] FIG. 3 is a conceptual diagram showing an example of the processing and information flow in the visit notification phase. The explanation of FIG. 3 will focus on the components of the visitor authentication device 10. In the visit notification phase, the visit information acquisition unit 11 acquires visit information registered by the visiting person. The notification information generation unit 13 uses information included in the visit information to generate notification information including a visit notification informing the person to be visited that the visiting person will be visiting. For example, the visit notification phase is a stage that is earlier than the scheduled visit date, such as two weeks or one month before the scheduled visit date. The notification information sent to the person to be visited in the visit notification phase includes a visit notification. The visit notification includes at least the date and time of the visit. The visit notification may include the name of the visiting person. The visit notification may also include attributes of the visiting person. The visit notification may also include information other than the date and time of the visit and the name and attributes of the visiting person.

[0030] Figure 4 is a flow diagram illustrating an example of the processing flow in the visit notification phase. Figure 4 shows the processing and information flow by the visitor terminal 160, visitor authentication device 10, and target visitor terminal 170. In the following explanation, the visitor terminal 160, visitor authentication device 10, and target visitor terminal 170 are the main actors in the operations.

[0031] First, visit information about the person to be visited is registered in the visitor terminal 160 in response to an input operation by the person in charge of visiting (step S111). For example, the visit information is registered in the visitor terminal 160 via a user interface of an app for the person to be visited.

[0032] Next, the visitor terminal 160 transmits the registered visit information to the visitor authentication device 10 (step S112). In step S112, the visitor terminal 160 may be configured to store the visit information in a storage area provided in a cloud or server accessible by the visitor authentication device 10 via a network.

[0033] The visitor authentication device 10 acquires the visit information transmitted from the visitor terminal 160 (step S113). In step S113, the visitor authentication device 10 may be configured to acquire the visit information stored in a storage area provided in a cloud or server accessible via a network.

[0034] Next, the visitor authentication device 10 uses the acquired visit information to generate notification information including a visit notification (step S114).

[0035] Next, the visitor authentication device 10 transmits the generated notification information to the target visitor terminal 170 (step S115). In step S115, the visitor authentication device 10 may store the notification information in a storage area provided in a cloud or server that can be accessed by the target visitor terminal 170 via a network.

[0036] The target visitor terminal 170 acquires the notification information transmitted from the visitor authentication device 10 (step S116). In step S116, the target visitor terminal 170 may be configured to acquire the notification information stored in a storage area provided in a cloud or server accessible via a network.

[0037] Next, the target person terminal 170 records the acquired notification information (step S117). The target person terminal 170 may be configured to store a link destination of a site where the notification information stored in a storage area provided in a cloud or server accessible via a network can be viewed.

[0038] Next, the target person terminal 170 displays the recorded notification information on the screen (step S118). The target person can determine whether to make a decision regarding the visit by the visiting person by checking the notification information displayed on the screen of the target person terminal 170.

[0039] FIG. 5 is a conceptual diagram illustrating an example of notification information displayed on the screen of a target visitor terminal used by the target visitor. Notification information including a visit notification is displayed on the screen of the target visitor terminal 170. The screen of the target visitor terminal 170 displays a visit notification stating, "A staff member will visit on MM / DD." The screen of the target visitor terminal 170 also displays the name and attributes of the visiting staff member, "Visiting Staff Member B (female)." While the attributes of the visiting staff member do not necessarily need to be notified, if the visiting staff member's attributes are known, the target visitor can determine whether the visitor is suspicious by recognizing that the attributes are clearly different. Alternatively, a nickname or symbol string indicating the visiting staff member may be displayed instead of the visiting staff member's name. This protects the personal information of the visiting staff member's name. The target visitor can learn the visit notification and the name and attributes of the visiting staff member by checking the information displayed on the screen of the target visitor terminal 170. The screen of the target visitor terminal 170 also displays recommended action information encouraging the target visitor to take action, such as, "Please let us know whether you will visit or not." By responding to the recommended action information displayed on the screen of the target person's terminal 170, the target person can take action in accordance with the visitor's decision regarding the visit.

[0040] [Primary authentication phase] Next, the primary authentication phase will be described with reference to the drawings. FIGS. 6 to 12 are conceptual diagrams for explaining the primary authentication phase. The following description of the primary authentication phase shows the relationship between the visitor terminal 160, visitor authentication device 10, and target visitor terminal 170. In the primary authentication phase, the visitor uses the visitor terminal 160 to take a photo of their own face and the photograph affixed to the visiting officer's personal identification number card. The visitor terminal 160 transmits the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image to the visitor authentication device 10. The visitor authentication device 10 performs primary authentication to determine whether the visitor is a visiting officer using the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image. The visitor authentication device 10 generates notification information including primary authentication information related to the primary authentication result. The visitor authentication device 10 transmits the generated notification information to the target visitor terminal 170. In the primary authentication phase, only the visiting officer scheduled to visit may be authenticated. In this case, notification information does not need to be sent to the target visitor terminal 170.

[0041] FIG. 6 is a conceptual diagram illustrating an example of the processing and information flow during the primary authentication phase. The explanation of FIG. 6 will focus on the components of the visitor authentication device 10. During the primary authentication phase, the biometric information acquisition unit 15 acquires a facial image captured using the visitor terminal 160. The facial image includes an image of the photograph attached to the personal identification number card and an image of the visitor. For example, the authentication unit 16 uses image recognition AI to identify whether the facial image transmitted from the visitor terminal 160 matches the facial image of the visiting officer. For example, the authentication unit 16 may be configured to authenticate the person in the facial image using the personal authentication system 150. The notification information generation unit 13 generates notification information containing primary authentication information according to the primary authentication result. The primary authentication information includes a primary authentication result indicating whether the facial image in the photograph attached to the visitor's personal identification number card matches the facial image of the visitor. That is, the primary authentication information includes an authentication result based on the facial image captured using the visitor terminal 160 used by the visitor. If the visitor is a legitimate visiting officer, the primary authentication result is OK. If the visitor is not a legitimate visiting officer, the primary authentication result is NG. The primary authentication information also includes recommended action information that encourages the visitor's biometric information to be acquired. For example, the recommended action information includes a comment instructing the visitor to acquire the visitor's biometric information. For example, the recommended action information may include a comment instructing the visitor to photograph the visitor's face as the visitor's biometric information. For example, the recommended action information may include a comment instructing the visitor to record the visitor's voice as the visitor's biometric information.

[0042] Figure 7 is a flow diagram illustrating an example of the processing flow in the primary authentication phase. Figure 7 shows the processing and information flow by visitor terminal 160, visitor authentication device 10, and target visitor terminal 170. In the following explanation, the visitor terminal 160, visitor authentication device 10, and target visitor terminal 170 are the main actors in the operations.

[0043] First, in response to the visitor's photographing operation, the visitor terminal 160 captures a facial image of the visitor and a facial image of the visitor in a photograph affixed to the visitor's personal identification number card (step S121). For example, the facial image is captured using an app for the visiting officer. The facial image in the photograph affixed to the personal identification number card may be acquired by a dedicated reading device having the function of reading information recorded on an IC chip and the function of taking a photograph. In this case, the information recorded on the IC chip and the facial image are linked. The facial image linked to the personal identification number card may also be the facial image recorded on the IC chip.

[0044] Next, the visitor terminal 160 transmits the captured facial image to the visitor authentication device 10 (step S122). In step S122, the visitor terminal 160 may be configured to store the facial image in a storage area provided in a cloud or server that is accessible by the visitor authentication device 10 via a network.

[0045] The visitor authentication device 10 acquires the facial image transmitted from the visitor terminal 160 (step S123). In step S123, the visitor authentication device 10 may be configured to acquire the facial image stored in a storage area provided in a cloud or server accessible via a network.

[0046] Next, the visitor authentication device 10 performs primary authentication using the acquired face image (step S124).

[0047] Next, the visitor authentication device 10 generates notification information including the primary authentication information (step S125).

[0048] Next, the visitor authentication device 10 transmits notification information including the primary authentication information to the target visitor terminal 170 (step S126). The notification information is transmitted in accordance with the scheduled visit time of the visiting person. For example, the notification information is transmitted to the target visitor terminal 170 immediately (5 to 60 minutes before) the scheduled visit time. In this case, the target visitor can be aware that the visiting person is coming in a timely manner. For example, the notification information is transmitted to the target visitor terminal 170 on the morning of the scheduled visit date of the visiting person. In this case, the target visitor can be aware that the visiting person is coming on the morning of the scheduled visit date. For example, the notification information is transmitted to the target visitor terminal 170 on the day before the scheduled visit date. In this case, the target visitor can prepare for the visiting person's visit the day before. In step S126, the visitor authentication device 10 may store the notification information in a storage area provided in a cloud or server accessible by the target visitor terminal 170 via a network.

[0049] The target visitor terminal 170 acquires the notification information transmitted from the visitor authentication device 10 (step S127). In step S127, the target visitor terminal 170 may be configured to acquire the notification information stored in a storage area provided in a cloud or server accessible via a network.

[0050] Next, the target visitor terminal 170 displays the acquired notification information on its screen (step S128). The target visitor can recognize the primary authentication result for the visitor by checking the notification information displayed on the screen of the target visitor terminal 170. In this phase, there is a possibility that the visitor is not the visiting person. For example, a suspicious person may be using a stolen visitor terminal 160 to impersonate the visiting person. Furthermore, after the primary authentication by the authorized visiting person is completed, a suspicious person may be using a visitor terminal 160 stolen from the visiting person who has already been primarily authenticated to impersonate the visiting person. In the primary authentication phase, only the visiting person scheduled to visit may be authenticated. In this case, the processes of steps S126, S127, and S128 are omitted.

[0051] FIG. 8 is a conceptual diagram showing an example of how notification information is displayed on the screen of the person to be visited terminal used by the person to be visited. FIG. 8 shows an example in which the visitor is a legitimate visiting officer. Notification information including primary authentication information is displayed on the screen of the person to be visited terminal 170. Primary authentication information including the primary authentication result "Authentication result OK" is displayed on the screen of the person to be visited terminal 170. The name and attributes of the visiting officer, "Scheduled visiting staff member B (female)," are also displayed on the screen of the person to be visited terminal 170. If the attributes of the visiting officer are known, the person to be visited can recognize that the attributes are clearly different and determine whether the visitor is suspicious. The person to be visited can learn the primary authentication result and the name and attributes of the visiting officer by checking the information displayed on the screen of the person to be visited terminal 170.

[0052] FIG. 9 is a conceptual diagram showing an example of how notification information is displayed on the screen of the person to be visited terminal used by the person to be visited. FIG. 9 shows an example in which the visitor is not the authorized visiting person. Notification information including primary authentication information is displayed on the screen of the person to be visited terminal 170. Primary authentication information including the primary authentication result "Authentication result NG" is displayed on the screen of the person to be visited terminal 170. The name and attributes of the visiting person, "Scheduled visiting staff member B (female)," are also displayed on the screen of the person to be visited terminal 170. If the attributes of the visiting person are known, the person to be visited can recognize that the attributes are clearly different and determine whether the visitor is suspicious. The person to be visited can know the primary authentication result and the name and attributes of the visiting person by checking the information displayed on the screen of the person to be visited terminal 170.

[0053] In the example of FIGS. 8 and 9, the screen of the visitee terminal 170 displays the message, "When the visitor arrives, The app displays recommended actions to encourage the visitor to take action, saying, "Please launch the app and take a photo of the visitor's face." For example, the visitor may take a photo of the visitor in the image displayed on the intercom screen in response to the visitor's arrival. For example, the visitor may take a photo of the visitor through a door scope or window.

[0054] [Secondary authentication phase] Next, the secondary authentication phase will be described with reference to the drawings. FIGS. 10 to 18 are conceptual diagrams for explaining the secondary authentication phase. The following description of the secondary authentication phase shows the relationship between the management terminal 180, visitor authentication device 10, and target visitor terminal 170. In the secondary authentication phase, the visitor photographs his or her face using the target visitor terminal 170. The target visitor terminal 170 sends the visitor's facial image to the visitor authentication device 10. The visitor authentication device 10 uses the visitor's facial image to perform secondary authentication to determine whether the visitor is a visiting officer. The visitor authentication device 10 generates notification information including secondary authentication information regarding the secondary authentication result. The visitor authentication device 10 sends the generated notification information to the target visitor terminal 170 and the management terminal 180. In the secondary authentication phase, it is possible to omit contacting the administrator and only authenticate the visiting officer. In this case, notification information does not need to be sent to the management terminal 180.

[0055] FIG. 10 is a conceptual diagram illustrating an example of the processing and information flow in the secondary authentication phase. The explanation of FIG. 10 will focus on the components of the visitor authentication device 10. In the secondary authentication phase, the biometric information acquisition unit 15 acquires a facial image captured using the target visitor terminal 170. The facial image includes an image of the visitor. The authentication unit 16 performs secondary authentication of the person in the facial image. The notification information generation unit 13 generates notification information including secondary authentication information according to the secondary authentication result. The secondary authentication information includes a secondary authentication result indicating whether the facial image of the visitor captured using the target visitor terminal 170 matches or does not match the facial image of the visiting person. That is, the secondary authentication information includes an authentication result based on the facial image captured using the target visitor terminal 170. If the visitor is a legitimate visiting person, the secondary authentication result is OK. If the visitor is not a legitimate visiting person, the secondary authentication result is NG. The secondary authentication information also includes recommended action information that encourages the target visitor to take action. For example, the recommended action information includes a comment requesting a meeting with the visiting person. For example, the action recommendation information includes a comment requesting the user to wait for a response from the manager of the visiting business.

[0056] Fig. 11 is a flow diagram illustrating an example of the processing flow in the secondary authentication phase. Fig. 11 shows the processing and information flow by the management terminal 180, visitor authentication device 10, and target visitor terminal 170. In the following explanation, the management terminal 180, visitor authentication device 10, and target visitor terminal 170 are the main actors in the operations.

[0057] First, the target visitor terminal 170 captures a facial image of the visitor in response to a photographing operation by the target visitor (step S131). For example, the facial image is captured using an app for the target visitor.

[0058] Next, the target visitor terminal 170 transmits the captured facial image to the visitor authentication device 10 (step S132). In step S132, the target visitor terminal 170 may be configured to store the facial image in a storage area provided in a cloud or server that can be accessed by the visitor authentication device 10 via a network.

[0059] The visitor authentication device 10 acquires the facial image transmitted from the target visitor terminal 170 (step S133). In step S133, the visitor authentication device 10 may be configured to acquire the facial image stored in a storage area provided in a cloud or server accessible via a network.

[0060] Next, the visitor authentication device 10 performs secondary authentication using the acquired face image (step S134).

[0061] Next, the visitor authentication device 10 generates notification information including the secondary authentication information (step S135).

[0062] Next, the visitor authentication device 10 transmits notification information including the secondary authentication information to the target visitor terminal 170 and the management terminal 180 (step S136). In step S136, the visitor authentication device 10 may store the notification information in a storage area provided in a cloud or server that can be accessed by the target visitor terminal 170 and the management terminal 180 via a network.

[0063] The target visitor terminal 170 acquires the notification information transmitted from the visitor authentication device 10 (step S137). In step S137, the target visitor terminal 170 may be configured to acquire the notification information stored in a storage area provided in a cloud or server accessible via a network.

[0064] Next, the target visitor terminal 170 displays the acquired notification information on the screen (step S138). The target visitor can recognize the primary authentication result for the visitor by checking the notification information displayed on the screen of the target visitor terminal 170. In this phase, it is determined whether the visitor is the visiting person. In the secondary authentication phase, only the visiting person may be authenticated. In this case, the processes of steps S139 and S140 are omitted.

[0065] FIG. 12 is a conceptual diagram illustrating an example of capturing and transmitting a visitor's facial image. FIG. 12 shows an example of capturing an image of a visitor appearing in an image displayed on an intercom screen. An image of the visitor is displayed on the screen of intercom 175. For example, recommended behavior information urging the visitor to capture the screen of intercom 175 is displayed on the screen of target visitor terminal 170. Recommended behavior information stating, "Please press the button below to send the visitor's facial image," is displayed on the screen of target visitor terminal 170. For example, target visitor terminal 170 is configured to transmit the visitor's facial image to visitor authentication device 10 in response to selection of a "send" button displayed at the bottom of the screen.

[0066] FIG. 13 is a conceptual diagram illustrating another example of capturing and transmitting a visitor's facial image. FIG. 13 illustrates an example of capturing a visitor in an image displayed on an intercom screen and recording the visitor's voice. The image of the visitor is displayed on the screen of the intercom 175. For example, the screen of the visitee terminal 170 displays recommended behavior information encouraging the visitor to capture the screen of the intercom 175. Furthermore, the screen of the visitee terminal 170 displays recommended behavior information encouraging the visitor to speak. For example, the screen of the visitee terminal 170 may display recommended behavior information encouraging the visitor to speak a password, passcode, or the like. The screen of the visitee terminal 170 displays recommended behavior information stating, "Please press the button below to send the visitor's facial image and voice data." For example, the visitee terminal 170 is configured to transmit the visitor's facial image and voice data to the visitor authentication device 10 in response to selection of a "send" button displayed at the bottom of the screen.

[0067] FIG. 14 is a conceptual diagram illustrating yet another example of capturing and transmitting a visitor's facial image. FIG. 14 shows an example in which a capturing function is implemented in an intercom. The intercom 176 has a capturing function and a communication function. An image of the visitor is displayed on the screen of the intercom 176. For example, recommended action information urging the visitor to press the capture button on the intercom is displayed on the screen of the visitor terminal 170. Recommended action information stating "Please press the capture button on the intercom" is displayed on the screen of the visitor terminal 170. For example, in response to selection of the "Send" button displayed at the bottom of the screen of the visitor terminal 170, the intercom 176 captures an image of the visitor. The intercom 176 is configured to transmit the captured facial image of the visitor to the visitor authentication device 10.

[0068] 15 and 16 are conceptual diagrams showing examples of notification information displayed when the secondary authentication result is OK. That is, Fig. 15 and Fig. 16 show examples of notification information displayed when the visitor has been authenticated as the authorized visiting person.

[0069] FIG. 15 is a conceptual diagram showing an example of how notification information is displayed on the screen of the person to be visited terminal used by the person to be visited. Notification information including secondary authentication information is displayed on the screen of the person to be visited terminal 170. Secondary authentication information including a secondary authentication result saying "Authentication result OK" is displayed on the screen of the person to be visited terminal 170. Secondary authentication information saying "The visitor is a regular staff member" is displayed on the screen of the person to be visited terminal 170. The name and attributes of the visitor, "Scheduled visiting staff member B (female)," are displayed on the screen of the person to be visited terminal 170. The primary authentication information includes behavior recommendation information encouraging the visitor to meet with the visitor. The screen of the person to be visited terminal 170 displays secondary authentication information including behavior recommendation information saying "Please meet with a staff member." The person to be visited who views the notification information displayed on the screen of the person to be visited terminal 170 can meet with the regular visitor with peace of mind.

[0070] FIG. 16 is a conceptual diagram showing an example of notification information displayed on the screen of a management terminal used by the manager of a home visit business. Notification information including secondary authentication information is displayed on the screen of the management terminal 180. Secondary authentication information according to the secondary authentication result, "A staff member has visited Mr. C's home," is displayed on the screen of the management terminal 180. The name of the visiting person, "Scheduled Visiting Staff B," is displayed on the screen of the management terminal 180. The manager who views the notification information displayed on the screen of the management terminal 180 can confirm that the legitimate visiting person has visited the person to be visited.

[0071] 17 and 18 are conceptual diagrams showing examples of how notification information is displayed when the secondary authentication result is NG. That is, Fig. 17 and Fig. 18 show examples of how notification information is displayed when there is a possibility that a visitor is a suspicious person.

[0072] FIG. 17 is a conceptual diagram showing an example of notification information displayed on the screen of a target visitor terminal used by the target visitor. Notification information including secondary authentication information is displayed on the screen of target visitor terminal 170. Secondary authentication information including a secondary authentication result of "Authentication Result NG" is displayed on the screen of target visitor terminal 170. Secondary authentication information stating "The visitor may be a suspicious person" is displayed on the screen of target visitor terminal 170. The secondary authentication information includes recommended behavior information recommending not meeting with the visitor. Secondary authentication information including recommended behavior information stating "Please do not open the door and wait for a call from the administrator" is displayed on the screen of target visitor terminal 170. The target visitor who views the notification information displayed on the screen of target visitor terminal 170 can confirm that the visitor may be a suspicious person. If the visitor is actually a suspicious person, the target visitor can avoid the risks that may be posed by the suspicious person.

[0073] FIG. 18 is a conceptual diagram showing an example of notification information displayed on the screen of a management terminal used by the manager of a home visit business. Notification information including secondary authentication information is displayed on the screen of the management terminal 180. The screen of the management terminal 180 displays secondary authentication information according to the secondary authentication result, stating, "A suspicious person claiming to be a staff member has visited Mr. C's home." The screen of the management terminal 180 also displays secondary authentication information including action recommendation information, stating, "Please notify the police and inform the person to be visited that the visitor is suspicious." The manager who views the notification information displayed on the screen of the management terminal 180 can confirm that the suspicious person has visited the person to be visited. Then, the manager can ensure the safety of the person to be visited by notifying the police that the suspicious person has visited the person to be visited.

[0074] As described above, the visitor authentication device according to this embodiment includes a visit information acquisition unit, a visit information storage unit, a biometric information acquisition unit, an authentication unit, a notification information generation unit, and a transmission unit. The visit information acquisition unit acquires visit information including the visit schedule of the visiting officer. The visit information storage unit stores the acquired visit information. The biometric information acquisition unit acquires facial image data of a photograph of the face attached to the identification card held by the visiting officer and facial image data of a photograph of the visitor. The authentication unit uses the facial image data of the photograph of the face attached to the identification card and the facial image data of the visitor to authenticate whether the visitor is a visiting officer. The notification information generation unit generates notification information including the authentication result. The transmission unit transmits the generated notification information to the visitor terminal used by the person to be visited.

[0075] The visitor authentication device of this embodiment authenticates whether the visitor is a visiting officer by using facial image data of the face photograph affixed to the identification card and facial image data of the visitor. The visitor authentication device of this embodiment sends notification information including the authentication result to the visitor terminal used by the person to be visited. According to this embodiment, the person to be visited can recognize that the visitor is a legitimate visiting officer by checking the notification information sent to the visitor terminal. Therefore, the person to be visited can meet with the visiting officer with peace of mind compared to when the person to be visited is unable to recognize that the visitor is a legitimate visiting officer.

[0076] In one aspect of the present embodiment, in a phase in which a visitor visits the person to be visited, the biometric information acquisition unit acquires facial image data of the visitor captured by the person to be visited terminal. The authentication unit uses the acquired facial image data of the visitor to authenticate whether the visitor is a visiting person. The notification information generation unit generates notification information including the authentication result. According to this aspect, the person to be visited can recognize whether the visitor is a legitimate visiting person in a situation in which the visitor has arrived. Therefore, according to this aspect, if the visitor is a legitimate visiting person, the person to be visited can meet with the visiting person with peace of mind. Furthermore, according to this aspect, if the visitor is not a legitimate visiting person, the person to be visited can refuse to meet with the visitor, thereby ensuring the safety of the person to be visited.

[0077] In one aspect of the present embodiment, when the authentication result indicates that the visitor is a visiting officer, the notification information generation unit generates notification information including action recommendation information encouraging the person to be visited to meet with the visitor. The transmission unit transmits the notification information including the action recommendation information encouraging the person to be visited to the person to be visited used by the person to be visited. According to this aspect, in a situation where a visiting officer has visited, the person to be visited can recognize the action recommendation information encouraging the person to meet with the legitimate visiting officer. According to this aspect, the motivation of the person to be visited to meet with the visiting officer is increased in accordance with the action recommendation information, thereby improving the efficiency of the visiting officer's visit.

[0078] In one aspect of this embodiment, when the authentication result indicates that the visitor is not the person in charge of visiting, the notification information generation unit generates notification information including recommended behavior information recommending the person to be visited not to meet with the visitor. The transmission unit transmits the notification information including the recommended behavior information recommending the person to be visited not to meet with the visitor to the visitor terminal used by the visitor. According to this aspect, in a situation where a visitor who is not the person in charge of visiting has arrived, the person to be visited can recognize the recommended behavior information recommending the person not to meet with the visitor. According to this aspect, the person to be visited becomes cautious about meeting with the visitor in accordance with the recommended behavior information, thereby reducing the risk of the person to be visited encountering a suspicious person.

[0079] A visitor authentication device according to one aspect of this embodiment includes an authentication code issuing unit that issues an authentication code shared between the visiting officer and the person being visited. The notification information generating unit generates notification information including the issued authentication code. The transmitting unit transmits the notification information including the authentication code to a visitor terminal used by the visiting officer. If the authentication result indicates that the visitor is not the visiting officer, the notification information generating unit generates notification information including action recommendation information that recommends the visitor to request presentation of the authentication code. The transmitting unit transmits the notification information including the action recommendation information that recommends the visitor to request presentation of the authentication code to a visitor terminal used by the person being visited. According to this aspect, if the visitor cannot be authenticated by facial authentication, the person being visited can recognize whether the visitor is a visiting officer or not by the authentication code. According to this aspect, in a case where a legitimate visiting officer is identified as not a visiting officer by facial authentication, a situation in which the visiting officer has to revisit the person being visited can be avoided.

[0080] In one aspect of this embodiment, the biometric information acquisition unit acquires voice data of the visitor. The authentication unit uses the voice data of the visitor to authenticate whether the visitor is a visiting officer. According to this aspect, authentication can be performed using the voice data of the visitor in situations where it is difficult to capture facial image data of the visitor, thereby improving the efficiency of visits by visiting officers. Furthermore, authentication using both facial image data and voice data improves the level of security.

[0081] This embodiment is premised on the registration of visit information by a visiting officer. For example, the system may be configured so that visit information is registered in response to a request from a household with an infant to be visited. With this configuration, appropriate services can be provided in a timely manner in response to the request of the household with an infant. Also, the system may be configured so that visit information is automatically registered in response to the age of the infant to be visited. With this configuration, there will be no omission of registration by the visiting officer, and appropriate services can be reliably provided.

[0082] If a meeting with the person being visited determines that support is needed, the household in which the person is being visited will be required to provide some form of support. Therefore, the app for the person being visited may be configured to include functions for receiving notifications regarding support and for applying for support. For example, the app for the person being visited may be configured to display a list of government services available in the local government where the person being visited lives, along with links to those government services. Linking the personal identification number card (My Number Card) with the app for the person being visited enables electronic applications for government services for household support, simplifying cumbersome procedures. For example, the app for the person being visited may be linked with a portal site such as My Number Portal, which is an online portal for administrative procedures such as childcare and nursing care. Linking the app for the person being visited with My Number Portal ensures that notifications from government agencies and other organizations are received, and makes it easier to use services such as online applications.

[0083] The method of this embodiment authenticates that a visitor is a visiting person even if the person being visited does not refer to the visiting person's facial photograph. If the visiting person's facial photograph (personal information) were to be circulated, it could be misused. With the method of this embodiment, the visiting person's facial photograph is not circulated, so the visiting person's personal information can be protected.

[0084] The method of this embodiment can be applied to services other than administrative services led by local governments, such as home visits to all households with infants. For example, the method of this embodiment can be applied to services that deliver goods to private homes, such as postal services, shipping services, and parcel delivery services. If the method of this embodiment is applied to these services, it can be used to deal with crimes in which people pose as delivery people or the like and target private homes.

[0085] The method of this embodiment can be applied to authenticating not only people but also goods. For example, by using an image of a product purchased via the Internet, the purchaser can immediately check whether the product has been replaced with another product or whether it has been damaged during the logistics process.

[0086] (Second embodiment) Next, a visitor authentication device according to a second embodiment will be described with reference to the drawings. In this embodiment, the person to be visited is notified of the visiting person's authentication code, and the visitor is authenticated as the visiting person using the authentication code. The method of this embodiment can be combined with the method of the first embodiment.

[0087] (composition) 19 is a block diagram showing an example of the configuration of a visitor authentication device according to the present disclosure. Visitor authentication device 20 includes a visit information acquisition unit 21, a visit information storage unit 22, a notification information generation unit 23, a transmission unit 24, a biometric information acquisition unit 25, an authentication unit 26, and an authentication code issuance unit 27. Authentication unit 26 is connected to a personal authentication system 250. Personal authentication system 250 has the same configuration as personal authentication system 150 of the first embodiment.

[0088] The visit information acquisition unit 21 has the same configuration as the visit information acquisition unit 11 of the first embodiment. The visit information acquisition unit 21 acquires information (visit information) including a schedule for the visiting person to be visited by the visiting person. The visit information acquisition unit 21 stores the acquired visit information in the visit information storage unit 22. The visit information includes the date and time when the visiting person will visit the person to be visited, and information about the visiting person (visitor information). The visitor information includes the name of the visiting person. For example, the visitor information may include attributes of the visiting person. For example, the visiting person attributes include gender and age. It is preferable that the visiting person's attributes are characteristics that allow the visiting person to be recognized at a glance.

[0089] The visit information storage unit 22 has the same configuration as the visit information storage unit 12 of the first embodiment. The visit information storage unit 22 stores the visit information acquired by the visit information acquisition unit 21. The visit information stored in the visit information storage unit 22 is used to notify the person to be visited and to authenticate the visitor.

[0090] The notification information generation unit 23 generates notification information including information about a visit to the person to be visited. Before the visit and at the time of the visit, the notification information generation unit 23 generates notification information with different configurations. In the pre-visit phase (visit notification phase), the notification information generation unit 23 generates notification information including a visit notification informing the person to be visited that the visiting person will be visiting. In the visit phase (authentication phase), the notification information generation unit 23 causes the authentication code issuance unit 27 to issue an authentication code for the visiting person. The notification information generation unit 23 adds the issued authentication code to the notification information. The notification information may also include the issuance time and expiration date of the authentication code.

[0091] The transmission unit 24 has the same configuration as the transmission unit 14 of the first embodiment. The transmission unit 24 transmits the notification information generated by the notification information generation unit 23. In each of the visit notification phase and the authentication phase, the transmission unit 24 transmits the notification information to the target visitor terminal.

[0092] The biometric information acquisition unit 25 has the same configuration as the biometric information acquisition unit 15 of the first embodiment. The biometric information acquisition unit 25 acquires a facial image transmitted from the visitor terminal. The biometric information includes the visitor's facial image. The biometric information may also include the visitor's voiceprint, fingerprints, veins, iris, etc.

[0093] The authentication unit 26 authenticates whether the visitor is the visiting officer based on the facial image sent from the visitor terminal. The authentication unit 26 outputs the authentication result to the notification information generation unit 23.

[0094] For example, the authentication unit 26 uses image recognition AI (Artificial Intelligence) to identify whether a facial image sent from the visitor terminal matches the facial image of the visiting officer. The image recognition AI includes a trained machine learning model. In response to an input facial image, the trained machine learning model outputs an inference result indicating whether the person in the facial image is a legitimate visiting officer. There are no particular limitations on the algorithm used to train the trained machine learning model.

[0095] The authentication unit 26 authenticates whether the person in the facial image sent from the visitor terminal is the visiting officer. If the person in the facial image sent from the visitor terminal is the visiting officer, the authentication unit 26 outputs an authentication result (OK) indicating that the person is the visiting officer to the notification information generation unit 23. If the person in the facial image sent from the visitor terminal is not the visiting officer, the authentication unit 26 outputs an authentication result (NG) indicating that the person is not the visiting officer to the notification information generation unit 23.

[0096] The authentication code issuing unit 27 issues an authentication code for the person to be visited to confirm that the visitor is the visiting person. The authentication code issuing unit 27 issues the authentication code in response to an instruction from the notification information generating unit 23. For example, the authentication code is a passcode that is a combination of letters, numbers, and symbols. For example, the authentication code may be a password that is a combination of a question posed by the person to be visited to the visiting person and an answer from the visiting person. Note that the authentication code, such as a passcode or a password, is assumed to be issued to the visiting person in advance. For example, the authentication code may be a symbol (code symbol) such as a one-dimensional code such as a barcode or a two-dimensional code such as a QR code (registered trademark). The code symbol may be issued to the visiting person in advance or may be issued during the authentication phase.

[0097] [Authentication phase] Next, the authentication phase according to this embodiment will be described with reference to the drawings. The visit notification phase is the same as in the first embodiment. A description of the visit notification phase will be omitted. FIGS. 20 to 27 are conceptual diagrams for explaining the authentication phase. The following description shows the relationship between the visitor terminal 260, visitor authentication device 20, and target visitor terminal 270. FIGS. 20 to 23 show an example in which a visitor is authenticated using an authentication code shared between the visiting person and the target visitor. FIGS. 24 to 27 show an example in which a visitor is authenticated using a two-dimensional code as the authentication code. In the following description of the authentication phase, an example in which a common authentication code is used and an example in which a two-dimensional code is used will be described separately.

[0098] <Common authentication code> In the authentication phase, the visitor uses the visitor terminal 260 to take a photo of the photograph affixed to the visiting officer's personal identification number card and their own face. The visitor terminal 260 sends the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image to the visitor authentication device 20. The visitor authentication device 20 uses the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image to authenticate whether the visitor is the visiting officer. The visitor authentication device 20 generates notification information including authentication information regarding the authentication result. The visitor authentication device 20 also issues an authentication code for the visiting officer. The visitor authentication device 20 adds the issued authentication code to the notification information. The visitor authentication device 20 sends the notification information to the target visitor terminal 270.

[0099] FIG. 20 is a conceptual diagram illustrating an example of the processing and information flow in the authentication phase. The explanation of FIG. 20 will focus on the components of the visitor authentication device 20. During the authentication phase, the biometric information acquisition unit 25 acquires a facial image captured using the visitor terminal 260. The facial image includes an image of the photograph affixed to the visitor's personal identification number card and an image of the visitor. The authentication unit 26 uses image recognition AI to identify whether the facial image transmitted from the visitor terminal 260 matches the facial image of the visiting officer. For example, the authentication unit 26 may be configured to authenticate the person in the facial image using the personal authentication system 250. The notification information generation unit 23 generates notification information including authentication information according to the authentication result. The authentication information includes an authentication result indicating whether the facial image in the photograph affixed to the visitor's personal identification number card matches or does not match the visitor's facial image. That is, the authentication information includes the authentication result based on the facial image captured using the visitor terminal 260 used by the visitor. An authentication code is added to the notification information. The notification information also includes recommended action information that prompts the visitor to present the authentication code. For example, the recommended action information includes a comment requesting the visitor to request the target visitor to present the authentication code. The visitor authentication device 20 transmits the notification information including the authentication code to the target visitor terminal 270.

[0100] Figure 21 is a flow diagram illustrating an example of the processing flow in the authentication phase. Figure 21 shows the processing and information flow by the visitor terminal 260, visitor authentication device 20, and target visitor terminal 270. In the following explanation, the visitor terminal 260, visitor authentication device 20, and target visitor terminal 270 are the main actors in the operations.

[0101] First, in response to the visitor's photographing operation, the visitor terminal 260 photographs a facial image of the visitor and a facial image of the visitor in the photograph affixed to the visitor's personal identification number card (step S211). For example, the facial image is photographed using an app for the visiting officer.

[0102] Next, the visitor terminal 260 transmits the captured facial image to the visitor authentication device 20 (step S212). In step S212, the visitor terminal 260 may be configured to store the facial image in a storage area provided in a cloud or server that is accessible by the visitor authentication device 20 via a network.

[0103] The visitor authentication device 20 acquires the facial image transmitted from the visitor terminal 260 (step S213). In step S213, the visitor authentication device 20 may be configured to acquire the facial image stored in a storage area provided in a cloud or server accessible via a network.

[0104] Next, the visitor authentication device 20 performs authentication using the acquired face image (step S214).

[0105] Next, the visitor authentication device 20 generates notification information including the authentication code (step S215).

[0106] Next, the visitor authentication device 20 transmits notification information including the authentication code to the target visitor terminal 270 (step S216). In step S216, the visitor authentication device 20 may store the notification information in a storage area provided in a cloud or server that can be accessed by the target visitor terminal 270 via a network.

[0107] The target visitor terminal 270 acquires the notification information transmitted from the visitor authentication device 20 (step S217). In step S217, the target visitor terminal 270 may be configured to acquire the notification information stored in a storage area provided in a cloud or server accessible via a network.

[0108] Next, the target visitor terminal 270 displays the acquired notification information on the screen (step S218). The target visitor can recognize the authentication code that should be confirmed for the visitor by checking the notification information displayed on the screen of the target visitor terminal 270.

[0109] FIG. 22 is a conceptual diagram showing an example of notification information displayed on the screen of the person to be visited terminal used by the person to be visited. Notification information including an authentication code is displayed on the screen of the person to be visited terminal 270. The name and attributes of the person in charge of visiting, "Scheduled Visiting Staff B (Female)," are displayed on the screen of the person to be visited terminal 270. If the attributes of the person in charge of visiting are known, the person to be visited can recognize that the attributes are clearly different and determine whether the visitor is suspicious or not. The screen of the person to be visited terminal 270 displays recommended action information encouraging the person to be visited, saying, "Ask the person in charge of visiting for the authentication code." The authentication code is also displayed on the screen of the person to be visited terminal 270. The screen of the person to be visited terminal 270 also displays a warning, saying, "Do not tell the visitor the authentication code below." If the authentication code is told to the visitor, it will be impossible to determine whether the visitor is suspicious or not. Therefore, it is safer for the person to be visited if the warning is displayed.

[0110] FIG. 23 is a conceptual diagram illustrating an example of identifying a visiting person using an authentication code. For example, the person being visited asks the visitor for an authentication code in response to the recommended behavior information displayed on the screen of the person being visited terminal 270. In the example of FIG. 23, the person being visited requests the visitor to read out the authentication code, asking, "Please tell me your authentication code," in accordance with the recommended behavior information displayed on the screen of the person being visited terminal 270. At this time, the person being visited may also ask the visitor's name. In response to the request from the person being visited, the visiting person reads out the authentication code, saying, "This is AZBC." If the authentication code read out by the visitor matches the authentication code displayed on the screen of the person being visited terminal 270, the visitor can be identified as the visiting person. In this situation, the visitor can meet with the visiting person with peace of mind. On the other hand, if the authentication codes do not match, the person being visited recognizes that the visitor may be suspicious. In such a case, the person being visited can ensure their own safety by contacting the visiting service provider or reporting the incident to the police.

[0111] <Two-dimensional code> In the authentication phase, the visitor uses the visitor terminal 260 to take a photo of their own face and the photograph affixed to the visiting officer's personal identification number card. The visitor terminal 260 sends the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image to the visitor authentication device 20. The visitor authentication device 20 authenticates whether the visitor is a visiting officer using the facial image in the photograph affixed to the visiting officer's personal identification number card and their own facial image. The visitor authentication device 20 generates notification information including authentication information related to the authentication result. The visitor authentication device 20 also issues an authentication code (two-dimensional code) for the person to be visited. The visitor authentication device 20 adds the issued authentication code (two-dimensional code) to the notification information. The visitor authentication device 20 sends the notification information to the visitor terminal 260 and the target visitor terminal 270. If the visitor authentication device 20 identifies the two-dimensional code, the notification information sent to the target visitor terminal 270 does not need to include the two-dimensional code.

[0112] FIG. 24 is a conceptual diagram showing an example of the processing and information flow in the authentication phase. The explanation of FIG. 24 will focus on the components of the visitor authentication device 20. In the authentication phase, the biometric information acquisition unit 25 acquires a facial image captured using the visitor terminal 260. The facial image includes an image of the photograph attached to the personal identification number card and an image of the visitor. The authentication unit 26 authenticates the person in the facial image using the personal identification number system 250. The notification information generation unit 23 generates notification information including authentication information according to the authentication result. The authentication information includes an authentication result indicating whether the facial image in the photograph attached to the personal identification number card owned by the visitor matches or does not match the facial image of the visitor. In other words, the authentication information includes the authentication result based on the facial image captured using the visitor terminal 260 used by the visitor. An authentication code (two-dimensional code) is added to the notification information. The notification information also includes recommended action information that prompts the visitor to present the authentication code (two-dimensional code). For example, the behavior recommendation information includes a comment instructing the target visitor to present an authentication code (two-dimensional code). The visitor authentication device 20 transmits notification information including the authentication code (two-dimensional code) to the visitor terminal 260 and the target visitor terminal 270. If the visitor authentication device 20 identifies the two-dimensional code, the notification information transmitted to the target visitor terminal 270 does not need to include the two-dimensional code.

[0113] Figure 25 is a flow diagram illustrating an example of the processing flow in the authentication phase. Figure 25 shows the processing and information flow by the visitor terminal 260, visitor authentication device 20, and target visitor terminal 270. In the following explanation, the visitor terminal 260, visitor authentication device 20, and target visitor terminal 270 are the main actors in the operations.

[0114] First, in response to the visitor's photographing operation, the visitor terminal 260 photographs a facial image of the visitor and a facial image of the visitor in the photograph affixed to the visitor's personal identification number card (step S221). For example, the facial image is photographed using an app for the visiting officer.

[0115] Next, the visitor terminal 260 transmits the captured facial image to the visitor authentication device 20 (step S222). In step S222, the visitor terminal 260 may be configured to store the facial image in a storage area provided in a cloud or server accessible by the visitor authentication device 20 via a network.

[0116] The visitor authentication device 20 acquires the facial image transmitted from the visitor terminal 260 (step S223). In step S223, the visitor authentication device 20 may be configured to acquire the facial image stored in a storage area provided in a cloud or server accessible via a network.

[0117] Next, the visitor authentication device 20 performs authentication using the acquired face image (step S224).

[0118] Next, the visitor authentication device 20 generates notification information including an authentication code (two-dimensional code) (step S225).

[0119] Next, the visitor authentication device 20 transmits notification information including the authentication code to the target visitor terminal 270 (step S226). In step S226, the visitor authentication device 20 may store the notification information in a storage area provided in a cloud or server that can be accessed by the target visitor terminal 270 via a network.

[0120] The target visitor terminal 270 acquires the notification information transmitted from the visitor authentication device 20 (step S227). If the two-dimensional code is identified in the target visitor app of the target visitor terminal 270, the two-dimensional code is included in the notification information. If the two-dimensional code is identified in the visitor authentication device 20, the notification information transmitted to the visitor terminal 260 does not need to include the two-dimensional code. In step S227, the target visitor terminal 270 may be configured to acquire the notification information stored in a memory area provided in a cloud or server accessible via a network.

[0121] The visitor terminal 260 acquires the notification information sent from the visitor authentication device 20 (step S228). The notification information sent to the visitor terminal 260 includes a two-dimensional code. In step S228, the target visitor terminal 270 may be configured to acquire the notification information stored in a memory area provided in a cloud or server accessible via a network.

[0122] FIG. 26 is a conceptual diagram illustrating an example of notification information displayed on the screen of the visitee terminal used by the visitor. Notification information including authentication information is displayed on the screen of the visitee terminal 270. Authentication information including an authentication result of "Authentication Result NG" is displayed on the screen of the visitee terminal 270. Information corresponding to the authentication result (NG) of "May not be staff member" is displayed on the screen of the visitee terminal 270. Action recommendation information encouraging the visitor to take action is displayed on the screen of the visitee terminal 270, such as "Request the visitor to present their authentication code and press the button below to photograph the authentication code." For example, the visitor requests the visitor to present the authentication code to the intercom camera. For example, the visitor touches the "Photograph" button displayed at the bottom of the screen of the visitee terminal 270 to photograph the two-dimensional code displayed on the intercom screen. For example, the visitor may photograph the two-dimensional code through a peephole or a window.

[0123] FIG. 27 is a conceptual diagram showing an example of verifying the visiting person using an authentication code (two-dimensional code). For example, the person to be visited has the visitor present a two-dimensional code in response to the recommended action information displayed on the screen of the person to be visited terminal 270. The person to be visited terminal 270 transmits an authentication code corresponding to the captured two-dimensional code to the visitor authentication device 20. The visitor authentication device 20 identifies the authentication code as being an authentication code issued to the person to be visited. The two-dimensional code may be identified as being a two-dimensional code issued to the person to be visited using an app for the person to be visited installed on the person to be visited terminal 270. Using the two-dimensional code can prevent the person to be visited from mishearing the authentication code.

[0124] As described above, the visitor authentication device according to this embodiment includes a visit information acquisition unit, a visit information storage unit, a biometric information acquisition unit, an authentication unit, an authentication code issuance unit, a notification information generation unit, and a transmission unit. The visit information acquisition unit acquires visit information including the visit schedule of the visiting officer. The visit information storage unit stores the acquired visit information. The biometric information acquisition unit acquires facial image data of a photograph of the face attached to the identification card held by the visiting officer and facial image data of a photograph of the visitor. The authentication unit uses the facial image data of the photograph of the face attached to the identification card and the facial image data of the visitor to authenticate whether the visitor is a visiting officer. The authentication code issuance unit issues an authentication code to be shared between the visiting officer and the person to be visited. The notification information generation unit generates notification information including the issued authentication code. The transmission unit transmits the notification information including the authentication code to a person to be visited terminal used by the person to be visited.

[0125] The visitor authentication device of this embodiment authenticates whether the visitor is a visiting officer by using facial image data of a facial photograph affixed to the identification card and facial image data of the visitor. The visitor authentication device of this embodiment also issues an authentication code shared between the visiting officer and the person being visited. The visitor authentication device of this embodiment sends notification information including the authentication code to the person being visited's terminal used by the person being visited. According to this embodiment, the person being visited requests the authentication code from the visitor, and by checking the authentication code sent to the person being visited's terminal, the person being visited can recognize that the visitor is a legitimate visiting officer. This allows the person being visited to meet with the visiting officer with more peace of mind than if the person being visited were unable to recognize that the visitor is a legitimate visiting officer.

[0126] In one aspect of this embodiment, the authentication code issuing unit issues a code symbol as an authentication code. The notification information generating unit generates notification information including the issued code symbol. The transmitting unit transmits the notification information including the code symbol to a visitor terminal used by the visitor. According to this aspect, visitor authentication via the code symbol can be achieved.

[0127] In one aspect of this embodiment, the biometric information acquisition unit acquires an image of a code symbol displayed on the visitor terminal from the intended visitor terminal. The authentication unit uses the code symbol to authenticate whether the visitor is the visiting officer. The notification information generation unit generates notification information including the authentication result using the code symbol. The transmission unit transmits the notification information including the authentication result using the code symbol to the intended visitor terminal. In this aspect, visitor authentication can be performed by displaying the code symbol on the screen of the visitor terminal and reading the code symbol with the intended visitor terminal.

[0128] (Third embodiment) Next, a visitor authentication device according to a third embodiment will be described with reference to the drawings. The visitor authentication device of this embodiment has a simplified configuration of the visitor authentication devices according to the first and second embodiments.

[0129] (composition) 28 is a block diagram showing an example of the configuration of a visitor authentication device according to the present disclosure. The visitor authentication device 30 includes a biometric information acquisition unit 35, an authentication unit 36, a notification information generation unit 33, and a transmission unit 34.

[0130] The biometric information acquisition unit 35 acquires facial image data of a photograph of the face attached to the identification card held by the visiting officer and facial image data of the visitor. The authentication unit 36 ​​uses the facial image data of the photograph of the face attached to the identification card and the facial image data of the visitor to authenticate whether the visitor is a visiting officer. The notification information generation unit 33 generates notification information including the authentication result. The transmission unit 34 transmits the generated notification information to the person to be visited terminal used by the person to be visited.

[0131] The biometric information acquisition unit 35, authentication unit 36, notification information generation unit 33, and transmission unit 34 can be realized by the functions of the respective components described in the first and second embodiments.

[0132] (operation) Next, the operation of the visitor authentication device 30 will be described with reference to the drawings. Fig. 29 is a flowchart illustrating an example of the operation of the visitor authentication device according to the present disclosure. In describing the processing according to the flowchart of Fig. 29, the components of the visitor authentication device 30 will be described as the subject of the operations. The subject of the processing according to the flowchart of Fig. 29 may also be the visitor authentication device 30.

[0133] In FIG. 29, first, the biometric information acquisition unit 35 acquires facial image data of the photograph of the face attached to the identification card held by the visiting officer and facial image data of the visitor's face (step S31).

[0134] Next, the authentication unit 36 ​​uses the facial image data of the face photograph attached to the identification card and the facial image data of the visitor to authenticate whether the visitor is the visiting officer (step S32).

[0135] Next, the notification information generating unit 33 generates notification information including the authentication result (step S33).

[0136] Next, the transmitting unit 34 transmits the generated notification information to the target visitor terminal used by the target visitor (step S34).

[0137] The visitor authentication device of this embodiment authenticates whether the visitor is a visiting officer by using facial image data of the face photograph affixed to the identification card and facial image data of the visitor. The visitor authentication device of this embodiment sends notification information including the authentication result to the visitor terminal used by the person to be visited. Therefore, according to this embodiment, the person to be visited can recognize that the visitor is a legitimate visiting officer by checking the notification information sent to the visitor terminal.

[0138] (Hardware) Next, a hardware configuration for executing the control and processing in the present disclosure will be described with reference to the drawings. Here, an information processing device 90 (computer) in FIG. 30 is given as an example of such a hardware configuration. The information processing device 90 in FIG. 30 is an example of a configuration for executing the control and processing in the present disclosure and does not limit the scope of the present disclosure.

[0139] As shown in Fig. 30, an information processing device 90 includes a processor 91, a memory 92, an auxiliary storage device 93, an input / output interface 95, and a communication interface 96. In Fig. 30, interface is abbreviated as I / F (Interface). The processor 91, memory 92, auxiliary storage device 93, input / output interface 95, and communication interface 96 are connected to each other via a bus 98 so as to be able to communicate data with each other. The processor 91, memory 92, auxiliary storage device 93, and input / output interface 95 are also connected to a network such as the Internet or an intranet via the communication interface 96.

[0140] The processor 91 loads a program (instructions) stored in an auxiliary storage device 93 or the like into the memory 92. For example, the program is a software program for executing the control and processing in the present disclosure. The processor 91 executes the program loaded into the memory 92. The processor 91 executes the program to execute the control and processing in the present disclosure.

[0141] The memory 92 is a storage device having an area in which a program is loaded. The processor 91 loads a program stored in an auxiliary storage device 93 or the like into the memory 92. The memory 92 is realized by a volatile memory such as a DRAM (Dynamic Random Access Memory). Alternatively, a non-volatile memory such as an MRAM (Magnetoresistive Random Access Memory) may be used as the memory 92.

[0142] The auxiliary storage device 93 stores various data such as programs. For example, the auxiliary storage device 93 is realized by a local disk such as a hard disk or flash memory. Note that it is also possible to configure the system so that various data is stored in the memory 92, and omit the auxiliary storage device 93.

[0143] The input / output interface 95 is an interface for connecting the information processing device 90 to peripheral devices based on standards and specifications. The communication interface 96 is an interface for connecting to external systems and devices via a network such as the Internet or an intranet based on standards and specifications. The input / output interface 95 and the communication interface 96 may be a common interface for connecting to external devices.

[0144] Input devices such as a keyboard, mouse, and touch panel may be connected to the information processing device 90 as needed. These input devices are used to input information and settings. When a touch panel is used as the input device, a screen having the function of the touch panel serves as the interface. The processor 91 and the input devices are connected via an input / output interface 95.

[0145] The information processing device 90 may be equipped with a display device for displaying information. When a display device is equipped, the information processing device 90 is equipped with a display control device (not shown) for controlling the display of the display device. The information processing device 90 and the display device are connected via an input / output interface 95.

[0146] The information processing device 90 may be equipped with a drive device. The drive device acts as an intermediary between the processor 91 and a recording medium (program recording medium) to read data and programs stored on the recording medium and to write processing results of the information processing device 90 to the recording medium. The information processing device 90 and the drive device are connected via an input / output interface 95.

[0147] The above is an example of a hardware configuration for enabling the control and processing in the present disclosure. The hardware configuration in Figure 30 is an example of a hardware configuration for executing the control and processing in the present disclosure, and does not limit the scope of the present disclosure. A program that causes a computer to execute the control and processing in the present disclosure is also included in the scope of the present disclosure.

[0148] A program recording medium on which a program for executing the processing in this embodiment is recorded is also included in the scope of the present invention. For example, the program recording medium is a computer-readable non-transitory recording medium. The recording medium can be realized as an optical recording medium such as a CD (Compact Disc) or a DVD (Digital Versatile Disc). The recording medium may also be realized as a semiconductor recording medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) card. The recording medium may also be realized as a magnetic recording medium such as a flexible disk or other recording medium.

[0149] The components in the present disclosure may be combined in any manner. The components in the present disclosure may be realized by software. The components in the present disclosure may be realized by circuits.

[0150] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0151] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) a biometric information acquisition unit that acquires facial image data of a photograph of the face attached to the identification card held by the visiting officer and facial image data of a photograph of the visitor's face; an authentication unit that authenticates whether the visitor is the visiting officer using facial image data of the face photograph attached to the identification card and facial image data of the visitor; a notification information generating unit that generates notification information including an authentication result; A visitor authentication device comprising: a transmitter that transmits the generated notification information to a visitor terminal used by the visitor. (Appendix 2) an authentication code issuing unit that issues an authentication code shared between the visiting person and the person to be visited; The notification information generation unit generating notification information including the issued authentication code; The transmission unit The visitor authentication device according to claim 1, wherein notification information including the authentication code is sent to a visitor terminal used by the visiting staff member. (Appendix 3) The authentication code issuing unit issuing a code symbol as the authentication code; The notification information generation unit generating notification information including the issued code symbol; The transmission unit Sending notification information including the code symbol to a visitor terminal used by the visitor; An image of the code symbol displayed on the visitor terminal is acquired from the target visitor terminal; The authentication unit using the code symbol to authenticate whether the visitor is the visiting agent; The notification information generation unit generating notification information including an authentication result using the code symbol; The transmission unit A visitor authentication device according to claim 2, which sends notification information including an authentication result using the code symbol to the target visitor terminal. (Appendix 4) In the phase in which the visitor visits the visitee, The biometric information acquisition unit Acquire face image data of the visitor photographed by the visitor terminal; The authentication unit Using the acquired facial image data of the visitor, authenticate whether the visitor is the visiting officer; The notification information generation unit 10. A visitor authentication device according to claim 1, which generates notification information including an authentication result. (Appendix 5) The notification information generation unit If the authentication result indicates that the visitor is the visiting person, generating notification information including action recommendation information that encourages the person to visit to meet the visitor; The transmission unit A visitor authentication device as described in Appendix 4, which sends notification information including action recommendation information encouraging the visitor to meet with the visitor to the visitee terminal used by the visitor. (Appendix 6) The notification information generation unit If the authentication result indicates that the visitor is not the visiting person, generating notification information including action recommendation information that recommends the visitor not to meet with the visitor; The transmission unit A visitor authentication device as described in Appendix 4, which sends notification information including behavior recommendation information advising the visitor not to meet with the visitor to a visitor terminal used by the visitor. (Appendix 7) an authentication code issuing unit that issues an authentication code shared between the visiting person and the person to be visited; The notification information generation unit generating notification information including the issued authentication code; The transmission unit Sending notification information including the authentication code to a visitor terminal used by the visiting staff member; The notification information generation unit If the authentication result indicates that the visitor is not the visiting staff member, generating notification information including action recommendation information that recommends that the visitor request the presentation of the authentication code; The transmission unit A visitor authentication device as described in Appendix 4, which sends notification information including behavior recommendation information recommending that the visitor request the presentation of the authentication code to the visitor terminal used by the person to be visited. (Appendix 8) The biometric information acquisition unit Acquire voice data of the visitor; The authentication unit 8. A visitor authentication device according to any one of claims 1 to 7, which uses voice data of the visitor to authenticate whether the visitor is the visiting officer. (Appendix 9) The computer Acquires facial image data of the photograph of the face attached to the identification card held by the visiting officer and facial image data of the visitor's face; Using face image data of the face photograph attached to the identification card and face image data of the visitor, authenticate whether the visitor is the visiting officer; Generate notification information including the authentication result; The visitor authentication method transmits the generated notification information to a visitor terminal used by the visitor. (Appendix 10) A process of acquiring face image data of a photograph of the face attached to an identification card held by the visiting officer and face image data of a photograph of the visitor's face; A process of authenticating whether the visitor is the visiting officer using facial image data of the face photograph attached to the identification card and facial image data of the visitor; A process of generating notification information including an authentication result; and a program that causes a computer to execute a process of transmitting the generated notification information to a target visitor terminal used by the target visitor. Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 10 in the same dependent relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 10, but within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements may also be dependent on various hardware, software, various recording means for recording software, or systems. [Explanation of symbols]

[0152] 10, 20 Visitor authentication device 11, 21 Visit information acquisition department 12, 22 Visit information storage unit 13, 23, 33 Notification information generation section 14, 24, 34 Transmitter 15, 25, 35 Biometric information acquisition unit 16, 26, 36 Authentication Section 27 Authentication Code Issuance Department 150, 250 Personal Authentication System 160 visitor terminals 170 Visitor terminal 175, 176, 275 intercom 180 Management Terminal

Claims

1. a biometric information acquisition unit that acquires facial image data of a photograph of the face attached to the identification card held by the visiting officer and facial image data of a photograph of the visitor's face; an authentication unit that authenticates whether the visitor is the visiting officer using facial image data of the face photograph attached to the identification card and facial image data of the visitor; a notification information generating unit that generates notification information including an authentication result; A visitor authentication device comprising: a transmitter that transmits the generated notification information to a visitor terminal used by the visitor.

2. an authentication code issuing unit that issues an authentication code shared between the visiting person and the person to be visited; The notification information generation unit generating notification information including the issued authentication code; The transmission unit The visitor authentication device according to claim 1 , wherein notification information including the authentication code is sent to a visitor terminal used by the visiting staff member.

3. The authentication code issuing unit issuing a code symbol as the authentication code; The notification information generation unit generating notification information including the issued code symbol; The transmission unit Sending notification information including the code symbol to a visitor terminal used by the visitor; An image of the code symbol displayed on the visitor terminal is acquired from the target visitor terminal; The authentication unit using the code symbol to authenticate whether the visitor is the visiting agent; The notification information generation unit generating notification information including an authentication result using the code symbol; The transmission unit The visitor authentication device according to claim 2 , wherein notification information including an authentication result using the code symbol is sent to the visitor terminal.

4. In the phase in which the visitor visits the visitee, The biometric information acquisition unit Acquire face image data of the visitor photographed by the visitor terminal; The authentication unit Using the acquired facial image data of the visitor, authenticate whether the visitor is the visiting officer; The notification information generation unit The visitor authentication device according to claim 1 , wherein notification information including the authentication result is generated.

5. The notification information generation unit If the authentication result indicates that the visitor is the visiting person, generating notification information including action recommendation information that encourages the person to visit to meet the visitor; The transmission unit The visitor authentication device according to claim 4 , further comprising: transmitting notification information including action recommendation information encouraging the visitor to meet with the visitor to the visitor terminal used by the visitor.

6. The notification information generation unit If the authentication result indicates that the visitor is not the visiting person, generating notification information including action recommendation information that recommends the visitor not to meet with the visitor; The transmission unit The visitor authentication device according to claim 4 , wherein notification information including behavior recommendation information recommending that the visitor not meet with the visitor is transmitted to a visitor terminal used by the visitor.

7. an authentication code issuing unit that issues an authentication code shared between the visiting person and the person to be visited; The notification information generation unit generating notification information including the issued authentication code; The transmission unit Sending notification information including the authentication code to a visitor terminal used by the visiting staff member; The notification information generation unit If the authentication result indicates that the visitor is not the visiting staff member, generating notification information including action recommendation information that recommends that the visitor request the presentation of the authentication code; The transmission unit The visitor authentication device according to claim 4 , wherein notification information including action recommendation information recommending that the visitor request the presentation of the authentication code is transmitted to the visitor terminal used by the person to be visited.

8. The biometric information acquisition unit Acquire voice data of the visitor; The authentication unit The visitor authentication device according to claim 1 , wherein voice data of the visitor is used to authenticate whether the visitor is the visiting officer.

9. The computer Acquires facial image data of the photograph of the face attached to the identification card held by the visiting officer and facial image data of the visitor's face; Using face image data of the face photograph attached to the identification card and face image data of the visitor, authenticate whether the visitor is the visiting officer; Generate notification information including the authentication result; The visitor authentication method transmits the generated notification information to a visitor terminal used by the visitor.

10. A process of acquiring face image data of a photograph of the face attached to an identification card held by the visiting officer and face image data of a photograph of the visitor's face; A process of authenticating whether the visitor is the visiting officer using facial image data of the face photograph attached to the identification card and facial image data of the visitor; A process of generating notification information including an authentication result; and a program that causes a computer to execute a process of transmitting the generated notification information to a target visitor terminal used by the target visitor.

Images