Server device, server device control method, and program

Abstract

To provide a server device capable of pre-notifying whether a user can enjoy a biometric authentication-based service while safeguarding the user's privacy.SOLUTION: A server device comprises storage means, first control means, and second control means. The storage means stores biometric information of each of a plurality of users in association with anonymous information. The first control means acquires the biometric information of an occupant staying in a predetermined area from image data capturing the area, and executes first authentication processing using the acquired biometric information and the stored biometric information. When the first authentication processing is successful, the second control means notifies the occupant identified by the first authentication processing of the fact that the first authentication processing is successful using the anonymous information of the identified occupant.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a server device, a method for controlling a server device, and a program. [Background technology]

[0002] There is a technique for notifying the authenticatee of the authentication result.

[0003] For example, Patent Document 1 describes a notification device that can appropriately notify people passing through a specific location of facial recognition results without setting up a gate at the specific location where many people pass at the same time. The notification device in Patent Document 1 includes a generation unit and a transmission unit. The generation unit represents the facial recognition results of people passing through the passage control area, obtained based on image data from a camera that captures the passage control area, and generates image data of a facial recognition result image to be projected at the feet of people passing through the passage control area. The transmission unit transmits the image data to a projector. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2023-010180 Summary of the Invention [Problem to be solved by the invention]

[0005] Biometric authentication is used as a payment method for goods and other items. When a customer shows up at the cash register for biometric authentication payment, their biometric information is acquired and compared with pre-registered biometric information. However, biometric authentication may fail for some reason. In such cases, customers who thought they could use biometric authentication payment are often confused by the unexpected situation.

[0006] It is difficult to apply the technology disclosed in Patent Document 1 to solve the above problem. The technology in Patent Document 1 allows other people to know the authentication results of the user. With growing awareness of protecting personal privacy, it is difficult to adopt such information provision.

[0007] The main object of the present invention is to provide a server device, a method for controlling a server device, and a program that contribute to protecting the user's privacy while enabling advance notification of whether or not a service using biometric authentication is available. [Means for solving the problem]

[0008] According to a first aspect of the present invention, there is provided a server device comprising: a storage means for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control means for acquiring biometric information of a visitor staying in a specified area from image data showing the specified area and performing a first authentication process using the acquired biometric information and the stored biometric information; and a second control means for, if the first authentication process is successful, notifying the visitor of the fact that the first authentication process was successful, using the anonymous information of the visitor identified by the first authentication process.

[0009] According to a second aspect of the present invention, there is provided a control method for a server device, comprising: a storage step of storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control step of acquiring biometric information of a visitor who is staying in a specified area from image data showing the specified area, and performing a first authentication process using the acquired biometric information and the stored biometric information; and a second control step of, if the first authentication process is successful, notifying the visitor of the fact that the first authentication process was successful, using the anonymous information of the visitor identified by the first authentication process.

[0010] According to a third aspect of the present invention, there is provided a program for causing a computer mounted on a server device to execute the following steps: a storage process for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control process for acquiring biometric information of a visitor staying in a specified area from image data showing the specified area and performing a first authentication process using the acquired biometric information and the stored biometric information; and a second control process for, if the first authentication process is successful, notifying the visitor of the fact that the first authentication process was successful, using the anonymous information of the visitor identified by the first authentication process. [Effects of the Invention]

[0011] According to each aspect of the present invention, a server device, a control method for a server device, and a program are provided that contribute to enabling advance notification of whether or not a service using biometric authentication is available while protecting the privacy of a user. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram for explaining an outline of an embodiment. [Figure 2] FIG. 2 is a flowchart illustrating the operation of one embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram illustrating an example of a schematic configuration inside a store according to an embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram illustrating an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating an example of a member management database according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart illustrating an example of the operation of the visitor control unit according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a flowchart illustrating an example of the operation of the visitor control unit according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of a visitor management database according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a flowchart illustrating an example of the operation of the payment control unit according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating an example of a processing configuration of a payment terminal according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram illustrating an example of a processing configuration of a display device according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0014] A server device 100 according to one embodiment includes a storage unit 101, a first control unit 102, and a second control unit 103 (see FIG. 1). The storage unit 101 stores biometric information and anonymous information of each of a plurality of users in association with each other (step S1 in FIG. 2). The first control unit 102 acquires biometric information of a visitor who is staying in a predetermined area from image data showing the predetermined area, and executes a first authentication process using the acquired biometric information and the stored biometric information (step S2). If the first authentication process is successful, the second control unit 103 notifies the visitor of the success of the first authentication process using the visitor's anonymous information identified by the first authentication process (step S3).

[0015] The server device 100 acquires biometric information of a visitor who stays in a predetermined area and subsequently wishes to receive a service using biometric authentication (e.g., a biometric authentication payment service), and performs a preliminary authentication process using the acquired biometric information. The server device 100 notifies the visitor of the results of the preliminary authentication process using anonymous information (e.g., a nickname or avatar) of the visitor identified by the authentication process. Because the anonymous information is information registered by the user in advance, the user (a user who wishes to receive a service using biometric authentication) can recognize that their preliminary authentication was successful by checking the anonymous information they registered. In other words, the server device 100 can notify the user in advance whether or not they can receive a service using biometric authentication, while protecting the user's privacy.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] [System Configuration] As shown in FIG. 3, the information processing system according to the first embodiment includes a server device 10.

[0019] The server device 10 is managed and operated by a business such as a retail store or a restaurant. The server device 10 is a device that manages customer information and provides the customer with a payment service using biometric information (biometric authentication payment service). The server device 10 may be installed in the business's store or the like, or may be installed on a network (on the cloud).

[0020] A payment terminal 20, a camera device 30, and a display device 40 are installed in the store of the business operator (see FIG. 4).

[0021] The payment terminal 20 is a tablet or a POS (Point of Sale) terminal. The payment terminal 20 is installed at a checkout counter. A salesperson at a retail store or the like uses the payment terminal 20 to pay for a customer's purchase of goods.

[0022] Camera device 30 is a camera installed so that it can capture a predetermined range in front of the cash register. Camera device 30 captures an image of the predetermined area and obtains image data. For example, camera device 30 captures an image of the area surrounded by the dotted line in FIG. 4. In the following description, the area captured by camera device 30 will be referred to as the "capture area."

[0023] The display device 40 is a liquid crystal display or the like that is installed so that it can be seen by customers in the store. In particular, the display device 40 is installed so that it can be seen by customers staying in the photography area. For example, the display device 40 is installed by hanging it from the ceiling of the store. Alternatively, the display device 40 is installed near the payment terminal 20.

[0024] As shown in Fig. 3, a user (a customer of a retail store or the like) has a terminal 50. The user operates the terminal 50 to access the server device 10. The user inputs various pieces of information to the server device 10 and obtains various pieces of information from the server device 10.

[0025] 3 and 4 are connected to a network. Specifically, the server device 10, the payment terminal 20, the camera device 30, the display device 40, and the terminal 50 are connected to the network via wired or wireless communication means.

[0026] The configurations of the information processing system shown in Figures 3 and 4 are examples and are not intended to be limiting. For example, multiple server devices 10 may be included in the information processing system. Load balancing and redundancy may be achieved by using multiple server devices 10. Furthermore, the number of payment terminals 20, camera devices 30, display devices 40, etc. included in the information processing system is not limited to the number shown in Figure 4.

[0027] [General operation] Next, the general operation of the information processing system according to the first embodiment will be described.

[0028] <Membership registration> A user registers as a member and creates an account on the server device 10. By creating an account, the user can enjoy a payment service that uses biometric information (biometric authentication payment service).

[0029] A user operates the terminal 50 to access the server device 10. The server device 10 acquires the user's name, sex, date of birth, address, login information, contact information (telephone number, email address, etc.), biometric information, anonymous information, account information (bank account, credit card information, etc.) and the like on a web page for creating an account.

[0030] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, the biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes the user's physical characteristics. In this disclosure, a case where biometric information related to a person's "face" (a face image or features generated from a face image) is used will be described.

[0031] Anonymous information is information used to conceal a user's identity or personal information (such as name). Examples of anonymous information include nicknames and avatars (anime or animal characters).

[0032] When the server device 10 acquires the name, biometric information, anonymous information, etc. from the user, it registers the user as a member. The server device 10 generates a member ID for identifying the member. The server device 10 associates the generated member ID with the acquired information and stores them in a member management database. The member management database will be described in detail later.

[0033] Furthermore, server device 10 issues the generated member ID to the user. For example, server device 10 issues the member ID to the user as a member number. Specifically, server device 10 transmits the generated member ID to terminal 50. Terminal 50 stores the received member ID (member number).

[0034] <Management of visitors> After selecting the products to purchase in the store, a customer who wishes to pay for the products heads to the cash register. As the customer heads to the cash register, they enter the photography area shown in Figure 4. After passing through the photography area, the customer arrives at the cash register where payment services are provided.

[0035] Here, the server device 10 manages customers who enter and stay in the photography area as "visitors." More specifically, the server device 10 manages information about visitors (visitor information) using a visitor management database. Details of the visitor management database will be described later.

[0036] The camera device 30 takes an image of the photography area periodically or at a predetermined timing, and transmits image data obtained by photography to the server device 10.

[0037] The server device 10 extracts a human region (a region of all or part of a person appearing in the image data) from the received image data. The server device 10 generates a feature that characterizes the extracted human region. In the following description, the feature that characterizes a person appearing in the image data will be referred to as a "person feature."

[0038] The server device 10 assigns a visitor ID to each visitor, and stores the person feature amount, the visitor ID, and the latest detection time of the visitor in the visitor management database.

[0039] Furthermore, the server device 10 determines whether the visitor is a member eligible to receive the biometric authentication payment service. That is, the server device 10 performs a pre-authentication process (biometric authentication) on the visitor before the visitor arrives at the checkout counter (payment terminal 20). In the following description, the biometric authentication performed by the server device 10 in advance will be referred to as "pre-authentication."

[0040] Specifically, the server device 10 performs pre-authentication (first authentication process) using biometric information stored in the member management database and biometric information obtained from the image data.

[0041] The server device 10 stores the result of the pre-authentication (pre-authentication successful, pre-authentication failed) in the visitor management database. Furthermore, if the result of the pre-authentication is successful (if the person to be authenticated is a member), the server device 10 transcribes the member ID and biometric information of the member in question into the visitor management database.

[0042] The server device 10 performs pre-authentication once for each visitor, but does not repeatedly perform pre-authentication for the same visitor.

[0043] When the server device 10 determines that a visitor has left the photographing area by analyzing the image data received from the camera device 30, it deletes the entry corresponding to the person who has left the photographing area from the visitor management database.

[0044] By such operation of the server device 10, visitor information (visitor ID, person feature amount, pre-authentication result, member ID and biometric information when pre-authentication is successful, detection time, etc.) of each person staying in the photography area is stored in the visitor management database.

[0045] The timing at which visitor information is stored in the visitor management database will be described with reference to Fig. 5. Note that character strings such as "T1" written near people in Fig. 5 indicate time.

[0046] For example, when user A enters the photography area at time T1, user A's visitor information (visitor ID, personal features) is stored in the visitor management database at time T1. Furthermore, when server device 10 successfully pre-authenticates user A at time T1, user A's member ID and biometric information are stored in the visitor management database. User A completes the transaction at time T2. User A then leaves the photography area at time T3. In this case, user A's visitor information (visitor ID, personal features, pre-authentication success, member ID, biometric information, detection time, etc.) is deleted from the visitor management database after time T3.

[0047] Furthermore, when user B enters the photography area at time T4, user B's visitor information (visitor ID, personal features) is stored in the visitor management database at time T4. If pre-authentication of user B fails at time T5, server device 10 stores user B's visitor information (visitor ID, personal features, pre-authentication failure, detection time, etc.) in the visitor management database. If user B then leaves the photography area at time T6 without paying, user B's visitor information is deleted from the visitor management database after time T6.

[0048] In this way, the server device 10 detects people who have entered and are staying in a predetermined area in front of the cash register. That is, the server device 10 detects people who are waiting in line to select products to purchase or to pay in the store as visitors. The server device 10 performs pre-authentication on the visitor when the visitor turns toward the camera device 30 (when the visitor's face is photographed). The server device 10 continues to store the results of the pre-authentication while the visitor is staying in the photographing area.

[0049] <Notification of pre-certification results> The server device 10 notifies the visitor of the result of the pre-authentication. Specifically, the server device 10 notifies the visitor of the result of the pre-authentication using the display device 40.

[0050] The server device 10 periodically or at a predetermined timing transmits information about visitors in the photographing area who have been determined to have been successful in pre-authentication (hereinafter referred to as "successful pre-authentication visitors") to the display device 40. For example, the server device 10 transmits information about each successful pre-authentication visitor to the display device 40 when the visitor management database is updated.

[0051] Specifically, the server device 10 transmits a "pre-authentication result notification" including anonymous information of each successful pre-authentication user to the display device 40 (see FIG. 6).

[0052] Upon receiving the pre-authentication result notification, the display device 40 uses the information contained in the notification to display the information as shown in Fig. 7. For example, the display device 40 displays the nicknames and human-like icons of each person who has successfully been pre-authenticated and is staying in the photography area.

[0053] When a customer (visitor) checks the display on the display device 40, the customer (visitor) will see that their pre-registered nickname is displayed, and will therefore be able to recognize that they can pay for the products they wish to purchase using biometric authentication payment.

[0054] In other words, even if a customer is a member of a retail store or the like, the nickname etc. of the customer who fails pre-authentication will not be displayed on the display device 40. In this case, the customer (who is determined to have failed pre-authentication) will recognize that he or she cannot use the biometric authentication payment service because his or her nickname will not be displayed on the display device 40. Therefore, the customer can decide to pay for the product price by a means other than biometric authentication payment before reaching the checkout counter.

[0055] <Payment processing> When a customer arrives in front of the payment terminal 20, a store clerk at the retail store or the like operates the payment terminal 20 to make payment for the merchandise. The store clerk asks the customer which payment method they would like to use (for example, cash, credit card, electronic money, biometric authentication payment, etc.).

[0056] When a purchaser wishes to pay using biometric authentication, the store clerk acquires the purchaser's biometric information by operating the payment terminal 20. The store clerk also uses a barcode reader provided in the payment terminal 20 to read information about the purchased product.

[0057] The payment terminal 20 transmits a payment request including the acquired biometric information (for example, a facial image) and payment information to the server device 10 (see FIG. 8). The payment information includes the name of the purchased product (service), the place of purchase of the product, the price of the product, etc.

[0058] Upon receiving the payment request, the server device 10 performs biometric authentication on the customer (person wishing to purchase a product). The server device 10 performs biometric authentication (second authentication process) accompanying payment of the product price as “main authentication.”

[0059] Specifically, the server device 10 executes a matching process using the biometric information included in the payment request and the biometric information stored in the visitor management database, and identifies the member ID of the person wishing to purchase the product.

[0060] The server device 10 searches the member management database using the identified member ID, and identifies the corresponding entry (account of the person who wishes to purchase the product).

[0061] The server device 10 performs a payment process using the account information (for example, credit card information) and the price of the product included in the payment information described in the specified account.

[0062] The server device 10 notifies the payment terminal 20 of the result of the payment process (payment success, payment failure).

[0063] The payment terminal 20 notifies the store clerk or the like of the result of the received payment process. The store clerk provides services according to the notified result. For example, when the store clerk is notified that the payment is successful, the store clerk packs the product or the like.

[0064] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0065] [Server device] 9 is a diagram illustrating an example of a processing configuration (processing module) of the server device 10 according to the embodiment of the present disclosure. Referring to FIG. 9, the server device 10 includes a communication control unit 201, a member management unit 202, a visitor control unit 203, a notification control unit 204, a payment control unit 205, and a storage unit 206.

[0066] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the payment terminal 20. The communication control unit 201 also transmits data to the payment terminal 20. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0067] The member management unit 202 is a means for controlling and managing member registration and the like.

[0068] The member management unit 202 acquires the user's name, gender, date of birth, address, login information, contact information (telephone number, email address, etc.), biometric information, anonymous information, account information (bank account, credit card information, etc.), etc. on a specified web page, etc.

[0069] When the member management unit 202 acquires a face image as biometric information, it generates a feature from the acquired face image. In the following description, a feature that characterizes a person's face (face image) will be referred to as a "facial feature."

[0070] Since existing technology can be used for the process of generating facial features, a detailed description thereof will be omitted. For example, the member management unit 202 extracts the eyes, nose, mouth, etc. from the face image as feature points. The member management unit 202 then calculates the positions of each feature point and the distances between each feature point as facial feature amounts (generating a feature vector consisting of multiple feature amounts).

[0071] Furthermore, the member management unit 202 generates a member ID for identifying the member. The member ID may be any information that can uniquely identify the member. For example, the member management unit 202 may assign a unique value each time a member is registered as the member ID.

[0072] The member management unit 202 stores the generated member ID, biometric information (facial features), anonymous information, etc. in a member management database (see FIG. 10). Note that the member management database shown in FIG. 10 is an example and is not intended to limit the items to be stored. For example, the member management database may also store facial images of members.

[0073] Furthermore, member management unit 202 issues the generated member ID to the user. Member management unit 202 transmits the generated member ID to terminal 50.

[0074] The visitor control unit 203 is a means (first control means) for managing and controlling visitors staying in a predetermined area.

[0075] The visitor control unit 203 acquires biometric information (facial image) of a visitor staying in a specified area (photography area) from image data showing the specified area, and performs a first authentication process (pre-authentication) using the acquired biometric information and the biometric information stored in the member management database.

[0076] 11 and 12 are flowcharts showing an example of the operation of the visitor control unit 203 according to an embodiment of the present disclosure. The operation of the visitor control unit 203 will be described with reference to FIGS.

[0077] When image data is received from the camera device 30, the visitor control unit 203 attempts to extract a human region from the received image data (step S101).

[0078] Note that the visitor control unit 203 can use existing technology for the process of extracting a human region, and therefore detailed description thereof will be omitted. For example, the visitor control unit 203 may extract a human region from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the visitor control unit 203 may extract a human region using a method such as template matching.

[0079] If extraction of the human region fails (step S102, No branch), the visitor control unit 203 does not execute any particular process and ends the process.

[0080] If the extraction of the human region is successful (step S102, branch Yes), the visitor control unit 203 generates person features from the extracted human region (step S103).

[0081] Note that detailed description will be omitted as existing technology can be used for the process of generating person features by the visitor control unit 203. For example, the visitor control unit 203 generates person features (vector information) including information such as height, shoulder width, proportions of body parts, clothing (shape, color, material, etc.), hairstyle (including hair color), accessories (hat, glasses, accessories, etc.), and belongings (bag, umbrella, cane, etc.).

[0082] Thereafter, the visitor control unit 203 determines whether or not a person feature that is substantially the same as the generated person feature is stored in the visitor management database (determination of person feature; step S104).

[0083] Specifically, the visitor control unit 203 calculates the degree of match between the generated personal feature and at least one personal feature stored in the visitor management database, and makes the above determination using the calculated degree of match. If the calculated degree of match is equal to or greater than a predetermined threshold, the visitor control unit 203 determines that the two personal features are personal features of the same person.

[0084] If the person feature amount is not stored in the visitor management database (step S105, No branch), the visitor control unit 203 adds new visitor information to the visitor management database (step S106).

[0085] Specifically, the visitor control unit 203 assigns a visitor ID to the person feature amount. The visitor control unit 203 creates a new entry in the visitor management database and stores the assigned visitor ID, the person feature amount, and the visitor detection time (the time when the human area was extracted) in the entry.

[0086] FIG. 13 is a diagram illustrating an example of a visitor management database according to an embodiment of the present disclosure. As shown in FIG. 13, the visitor management database stores personal features, pre-authentication results, member IDs and facial features of individuals who have successfully completed pre-authentication, etc. The initial value of the pre-authentication field is "not yet completed." The visitor management database illustrated in FIG. 13 is merely an example and is not intended to limit the items stored therein.

[0087] If the person feature is stored in the visitor management database (step S105, Yes branch), the visitor control unit 203 updates the detection time field of the corresponding entry (updating detection time; step S107). That is, if the same person feature as the person feature previously calculated from image data newly acquired from the camera device 30 is calculated, the visitor control unit 203 determines that the visitor corresponding to the person feature is staying in the photography area, and updates the detection time of the visitor.

[0088] The visitor control unit 203 checks the pre-authentication status of the visitor corresponding to the extracted person area (step S108 in FIG. 12). Specifically, the visitor control unit 203 reads the setting value of the pre-authentication field of the entry (entry in the visitor management database) corresponding to the extracted person area.

[0089] If "success" or "failure" is set in the pre-authentication field, the visitor control unit 203 determines that pre-authentication of the visitor corresponding to the extracted person area has been performed. If "not performed" is set in the pre-authentication field, the visitor control unit 203 determines that pre-authentication of the visitor corresponding to the extracted person area has not been performed.

[0090] If pre-authentication has been performed (step S109, Yes branch), the visitor control unit 203 does not perform any particular process and ends the process.

[0091] If pre-authentication has not been performed (step S109, No branch), the visitor control unit 203 attempts to extract a face region (face image) from the extracted human region (step S110). For example, the visitor control unit 203 attempts to extract the face region using a method similar to the human region extraction process.

[0092] If the extraction of the face region fails (step S111, branch No), the visitor control unit 203 does not execute any particular process and ends the process.

[0093] If the facial area is successfully extracted (step S111, Yes branch), the visitor control unit 203 executes a matching process using the extracted facial area (facial image) and the biometric information stored in the member management database (step S112).

[0094] More specifically, visitor control unit 203 generates facial features from the extracted facial region. Visitor control unit 203 sets the generated facial features as a matching target and performs a matching process (one-to-N matching; N is a positive integer, the same applies hereinafter) with facial features stored in the member management database.

[0095] The visitor control unit 203 calculates the similarity between the facial feature to be matched and each of the multiple facial feature values ​​on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0096] If there is no facial feature among the multiple facial features stored in the member management database that has a similarity with the facial feature to be matched that is equal to or greater than a predetermined value, the visitor control unit 203 determines that the matching process has failed.

[0097] If there is a facial feature among the multiple facial features stored in the member management database that has a similarity to the facial feature to be matched that is equal to or greater than a predetermined value, the visitor control unit 203 determines that the matching process is successful. In this case, the account of the entry with the highest similarity is identified as the account of the person to be authenticated.

[0098] If the matching process fails (step S113, No branch), the visitor control unit 203 stores "failed" in the pre-authentication field of the entry (entry in the visitor management database) corresponding to the extracted person area (step S114).

[0099] If the matching process is successful (step S113, Yes branch), the visitor control unit 203 stores "success" in the pre-authentication field of the entry corresponding to the extracted person area (step S115). Furthermore, the visitor control unit 203 stores the member ID and biometric information written in the account identified by the matching process in the member ID field and biometric information field of the visitor management database.

[0100] When a plurality of human regions are extracted from the image data received from the camera device 30, the visitor control unit 203 executes the above process for each of the extracted human regions.

[0101] In this way, the visitor control unit 203 calculates a person feature that characterizes the visitor from image data that captures the predetermined area. When a person feature that substantially matches the calculated person feature is calculated from newly acquired image data, the visitor control unit 203 determines that the visitor is staying in the predetermined area. Furthermore, the visitor control unit 203 extracts a human region of the visitor from the image data that captures the predetermined area, and acquires biometric information (face image) from the extracted human region that corresponds to the biometric information stored in the member management database. The visitor control unit 203 performs pre-authentication (first authentication process) using the acquired biometric information.

[0102] The visitor control unit 203 accesses the visitor management database periodically or at a predetermined timing, and extracts entries (visitors) for which a predetermined time has elapsed since the detection time. The visitor control unit 203 deletes the extracted entries from the visitor management database.

[0103] For example, the visitor control unit 203 determines that a person whose human region has not been detected for 30 seconds has left the photographing area, and deletes the visitor information of that person from the visitor management database.

[0104] The notification control unit 204 is a means (second control means) that executes control related to notification of the result of pre-authentication.

[0105] If the pre-authentication (first authentication process) is successful, the notification control unit 204 notifies the visitor of the success of the first authentication process using the anonymous information of the visitor identified by the first authentication process. The notification control unit 204 notifies the visitor of the success of the first authentication process (pre-authentication) by transmitting the anonymous information of the visitor identified by the first authentication process to a display device 40 installed in a position visible to the visitor. In other words, the notification control unit 204 notifies the visitor (a customer heading to the cash register) of the result of the pre-authentication via the display device 40.

[0106] The notification control unit 204 accesses the visitor management database periodically or at a predetermined timing. The notification control unit 204 reads data from the visitor management database and determines whether or not it is necessary to send a pre-authentication result notification to the display device 40.

[0107] More specifically, when a new pre-authentication successful individual is added to the visitor management database, the notification control unit 204 determines that a pre-authentication result notification needs to be sent to the display device 40. Alternatively, when a pre-authentication successful individual is deleted from the visitor management database, the notification control unit 204 determines that a pre-authentication result notification needs to be sent to the display device 40.

[0108] When a pre-authentication result notification needs to be sent, the notification control unit 204 reads the member ID of each successful pre-authentication person from the visitor management database. The notification control unit 204 searches the member management database using the read member ID as a key to identify the corresponding entry. The notification control unit 204 reads the anonymous information set in the anonymous information field of the identified entry.

[0109] The notification control unit 204 transmits a pre-authentication result notification including the read anonymous information to the display device 40.

[0110] In this way, while the visitor is registered in the visitor management database as a successful pre-authentication person, the notification control unit 204 continues to transmit the anonymous information of the successful pre-authentication person to the display device 40. That is, the notification of the successful pre-authentication is continued to be sent to the visitor who is staying in the predetermined area. Furthermore, when the successful pre-authentication person is deleted from the visitor management database (when the visitor leaves the photographing area), the notification control unit 204 cancels the notification of the successful pre-authentication.

[0111] The settlement control unit 205 is a means (third control means) for processing a settlement request. The settlement control unit 205 executes "main authentication" of the person who wishes to purchase a product.

[0112] The payment control unit 205 acquires biometric information of the person to be authenticated who has passed through the photographing area and arrived at a predetermined location (e.g., an accounting office) to receive a predetermined service (biometric authentication payment service), and executes a second authentication process (main authentication) using the acquired biometric information of the person to be authenticated. More specifically, the payment control unit 205 executes the second authentication process using the acquired biometric information of the person to be authenticated and the biometric information (facial feature amounts stored in the visitor management database) of a visitor who has been determined to have succeeded in the pre-authentication (first authentication process).

[0113] 14 is a flowchart showing an example of the operation of the payment control unit 205 according to the embodiment of the present disclosure. The operation of the payment control unit 205 will be described with reference to FIG.

[0114] When a payment request is received, the payment control unit 205 executes a matching process using the biometric information included in the request and the biometric information stored in the visitor management database (step S201).

[0115] More specifically, the payment control unit 205 generates facial features from the facial image included in the payment request. The payment control unit 205 sets the generated facial features as a target for matching, and performs a matching process (1:N matching) with the facial features stored in the visitor management database.

[0116] The matching process performed by the payment control unit 205 can be the same as the matching process performed by the visitor control unit 203, so a detailed description of the matching process performed by the payment control unit 205 will be omitted.

[0117] If the matching process fails (step S202, No branch), the payment control unit 205 transmits a negative response indicating that the payment has failed to the payment terminal 20 (step S203).

[0118] If the matching process is successful (step S202, Yes branch), the payment control unit 205 uses the payment information included in the payment request and the member's account information identified by the matching process to make payment for the product (execute the payment process; step S204).

[0119] Specifically, the payment control unit 205 acquires the member ID from the entry in the visitor management database identified by the matching process. The payment control unit 205 searches the member management database using the acquired member ID as a key to identify the corresponding entry. The payment control unit 205 acquires account information (e.g., credit card information) from the identified entry.

[0120] For example, the payment control unit 205 requests the server of the credit card company to settle the price of the product by sending the payment information to the server. The server of the credit card company notifies the server device 10 of the result of the payment process. Note that the configuration and operation of the server of the credit card company are different from the spirit of the disclosure of this application and are obvious to those skilled in the art, so detailed explanation will be omitted.

[0121] If the payment control unit 205 is notified that the payment has been successful, it determines that the payment process has been successful. If the payment has been notified that the payment has failed, it determines that the payment process has failed.

[0122] If the payment fails (step S205, No branch), the payment control unit 205 transmits a negative response indicating that the payment failed to the payment terminal 20 (step S203).

[0123] If the payment is successful (step S205, Yes branch), the payment control unit 205 transmits an affirmative response indicating that the payment is successful to the payment terminal 20 (step S206).

[0124] The storage unit 206 is a means for storing information necessary for the operation of the server device 10. For example, the storage unit 206 stores biometric information and anonymous information of each of a plurality of users (members) in association with each other.

[0125] [Payment terminal] 15 is a diagram illustrating an example of a processing configuration (processing module) of payment terminal 20 according to an embodiment of the present disclosure. Referring to FIG. 15, payment terminal 20 includes a communication control unit 301, a payment control unit 302, and a storage unit 303.

[0126] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 10. The communication control unit 301 also transmits data to the server device 10. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0127] The payment control unit 302 is a means for controlling the payment of product prices and the like.

[0128] The payment control unit 302 acquires biometric information of the purchaser in response to an operation by a store clerk or the like. Specifically, the payment control unit 302 acquires image data from the camera of its own terminal. After acquiring the image data from the camera, the payment control unit 302 extracts a facial image from the acquired image data.

[0129] The payment control unit 302 sends a payment request including the acquired face image and payment information to the server device 10. The payment information is acquired by a store clerk reading a barcode attached to a product or the like.

[0130] The payment control unit 302 receives a response (positive response, negative response) to the payment request.

[0131] If a positive response is received, the payment control unit 302 notifies the store clerk or other person that the payment request has been successfully processed. If a negative response is received, the payment control unit 302 notifies the store clerk or other person that the payment has failed.

[0132] The storage unit 303 is a means for storing information necessary for the operation of the payment terminal 20.

[0133] [Display device] 16 is a diagram illustrating an example of a processing configuration (processing module) of the display device 40 according to the embodiment of the present disclosure. Referring to FIG. 16, the display device 40 includes a communication control unit 401, a display control unit 402, and a storage unit 403.

[0134] The communication control unit 401 is a means for controlling communication with other devices. For example, the communication control unit 401 receives data (packets) from the server device 10. The communication control unit 401 also transmits data to the server device 10. The communication control unit 401 passes data received from other devices to other processing modules. The communication control unit 401 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 401. The communication control unit 401 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0135] The display control unit 402 is a means for controlling the liquid crystal display and the like provided in the display device 40.

[0136] When a preliminary authentication result notification is received from the server device 10, the display control unit 402 uses the anonymous information included in the notification to display a screen such as that shown in Fig. 7 on a liquid crystal display or the like. If a nickname is notified as the anonymous information, the display control unit 402 displays the nickname in combination with an icon resembling a person. Alternatively, if an avatar is notified as the anonymous information, the display control unit 402 displays the notified avatar.

[0137] The storage unit 403 is a means for storing information necessary for the operation of the display device 40 .

[0138] [Camera equipment] The configuration of camera device 30 will be clear to those skilled in the art, and detailed explanation will be omitted. Camera device 30 is installed so as to be able to capture a predetermined area in front of the cash register, and transmits image data obtained from the camera to server device 10 periodically or at predetermined timing.

[0139] [Device] Examples of the terminal 50 include a smartphone, a mobile phone, a game console, a mobile terminal device such as a tablet, a computer (personal computer, laptop computer), etc. The terminal 50 can be any equipment or device that can accept user operations and communicate with the server device 10, etc.

[0140] Next, a modified example of the first embodiment will be described.

[0141] <Variation 1> In the above embodiment, the server device 10 protects the privacy of the user (customer) who receives the notification of successful pre-authentication by using anonymous information. However, various methods can be adopted to protect the privacy.

[0142] For example, the notification control unit 204 may transmit the member ID (membership number) of the person who has succeeded in pre-authentication in addition to the anonymous information (nickname, avatar) to the display device 40. In this case, the display device 40 may notify the visitor of the fact that pre-authentication has been successful using the member number along with the nickname, etc.

[0143] Alternatively, if anonymous information (for example, a nickname or avatar) is not stored in the account of the successful pre-authentication person, the notification control unit 204 may transmit the member ID (member number) of the successful pre-authentication person to the display device 40.

[0144] Alternatively, if both a nickname and an avatar are registered as anonymous information, the notification control unit 204 may transmit either the nickname or the avatar to the display device 40, or may transmit both to the display device 40. In this case, the display device 40 may display a combination of the nickname and the avatar.

[0145] Alternatively, the user may register a predetermined combination of numbers and letters as anonymous information. For example, the user may register a number sequence of about three digits in the server device 10 as anonymous information.

[0146] Alternatively, the notification control unit 204 may generate anonymous information from the information of the registered member. For example, the notification control unit 204 may generate information to be notified to the pre-authentication successful person using part of the phone number or message of the pre-authentication successful person, and transmit the generated information to the display device 40. For example, the notification control unit 204 may transmit the last three digits of the registered phone number to the display device 40. In this case, the display device 40 displays a message indicating that the displayed three-digit number is the last three digits of the phone number of the pre-authentication successful person.

[0147] <Variation 2> In the above embodiment, the server device 10 notifies the visitor (customer) of the result of pre-authentication via the display device 40. However, the server device 10 may also notify the terminal 50 of the visitor (member) identified by pre-authentication that the pre-authentication has been successful.

[0148] In this case, the notification control unit 204 may send a message to the email address of the member identified by the pre-authentication, indicating that the pre-authentication has been successful.

[0149] Alternatively, the notification control unit 204 may notify the terminal 50 that the pre-authentication has been successful via a dedicated application installed on the terminal 50.

[0150] In this case, the user launches a dedicated application before entering a store or the like. The dedicated application transmits the member ID acquired from the server device 10 to the server device 10. The server device 10 identifies the user (member) who has entered the store based on the received member ID.

[0151] When a member entering the store enters the photography area (when the member is photographed in the photography area and pre-authentication is successful), the notification control unit 204 notifies the dedicated application running on the terminal 50 held by the member that pre-authentication has been successful.

[0152] The dedicated application notifies the user that the pre-authentication has been successful by displaying a pop-up or the like.

[0153] As described above, the server device 10 according to the first embodiment pre-authenticates a user in an open area where no gates or other means for restricting user passage are installed. That is, the server device 10 performs gateless authentication, which allows multiple users to be authenticated simultaneously, in an area in front of the checkout booth. The server device 10 notifies the user of the results of the gateless authentication (pre-authentication) using a display device 40 installed on the ceiling or wall or a display device 40 installed near the checkout booth (notifying the user of the authentication results in real time). At this time, the server device 10 notifies the user of the authentication results using anonymous information about the user (e.g., nickname, avatar, etc.).

[0154] A user who recognizes that their authentication result was successful can proceed to the cash register with confidence and pay for the product using biometric authentication. On the other hand, a user who recognizes that their authentication result was unsuccessful can decide to prepare another payment method or, in some cases, abandon the purchase of the product. If a user selects another payment method, the user notifies the cashier of the selected payment method. As a result, the payment for the product is made smoothly.

[0155] The server device 10 also continuously tracks people staying in a predetermined area. Even if the person moves within the predetermined area, the server device 10 stores the results of the pre-authentication and notifies the person in the predetermined area of ​​the results of the pre-authentication via the display device 40. As a result, the pre-authentication results of customers considering products to purchase in the store or customers waiting in line at the cash register are also continuously provided to each customer. For example, even if there are many other customers waiting in line, if many customers are using the biometric authentication payment service, the customer knows that the transaction will be completed smoothly, and can therefore decide to continue waiting in line and purchase a product.

[0156] The above-described operation of the information processing system disclosed herein eliminates stress that users of biometric authentication payment services may experience (psychological stress from being exposed to the public's attention while waiting in line). In other words, users considering using a biometric authentication payment service do not need to wait in line feeling nervous, fearing that they may not be authenticated due to some unexpected problem. As a result, factors that hinder the widespread adoption of biometric authentication payment services are eliminated, improving social acceptance of biometric authentication services and promoting their implementation in society.

[0157] Furthermore, if a problem occurs that prevents the use of biometric authentication payment services, businesses will need to spend time and effort to resolve the issue. However, by adopting the information processing system disclosed in this application, businesses can minimize the amount of time and effort required to resolve the issue. In other words, businesses do not need to issue authentication retry instructions to the system, explain to customers that they should switch to another payment method, or redo sales registration operations.

[0158] Next, the hardware of each device constituting the information processing system will be described. Fig. 17 is a diagram showing an example of the hardware configuration of the server device 10.

[0159] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 17. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0160] 17 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in FIG. 17, and for example, the server device 10 may include multiple processors 311.

[0161] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0162] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0163] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user operations such as a keyboard or a mouse.

[0164] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0165] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0166] The payment terminal 20 and the like can also be configured using an information processing device, similar to the server device 10, and the basic hardware configuration is the same as that of the server device 10, so a description thereof will be omitted. The payment terminal 20 may be equipped with a camera device or the like for taking a picture of the product purchaser.

[0167] The server device 10, which is an information processing device, is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.

[0168] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0169] In the above embodiment, the camera device 30 is described as capturing an image of a predetermined area in front of the cash register, but the camera device 30 may be installed so as to be able to capture an image of the entire store.

[0170] In the above embodiment, the server device 10 acquires image data from a single camera device 30. However, the server device 10 may acquire image data from multiple camera devices 30 and use the image data acquired from the multiple camera devices 30 to manage visitors and perform pre-authentication. For example, image data of a predetermined area captured by a camera device 30 installed so as to capture an image of a customer facing the cash register or a camera device 30 installed so as to capture an image of a customer facing sideways from the cash register is transmitted to the server device 10. By using this image data, the server device 10 can more reliably perform pre-authentication. In particular, even when the image capture areas are mixed, the server device 10 can more reliably detect visitors and perform pre-authentication. Note that even when the server device 10 acquires image data from multiple camera devices 30, it is sufficient to perform the same processes as the visitor detection process and pre-authentication process described above.

[0171] In the above embodiment, the server device 10 transmits a pre-authentication result notification to one display device 40. However, the server device 10 may transmit a pre-authentication result notification to multiple display devices 40. The server device 10 may also change the information to be transmitted to each display device 40. For example, the notification control unit 204 may transmit a nickname to one display device 40 and an avatar or membership number to the other display devices 40.

[0172] In the above embodiment, the configuration, operation, etc. of the information processing system are described using a biometric authentication payment service as an example of a service using biometric authentication provided to a user. However, the service using biometric authentication provided to a user is not limited to a biometric authentication payment service. For example, the above-described pre-authentication may be performed before the biometric authentication performed when entering an event venue or a workplace.

[0173] In the above embodiment, the server device 10 uses biometric information (facial features) stored in the visitor management database for the main authentication (authentication when a biometric authentication payment service is provided). However, the payment control unit 205 may perform the biometric authentication (main authentication) using the biometric information stored in the member management database. Alternatively, if the matching process using the biometric information stored in the visitor management database fails, the payment control unit 205 may perform the biometric authentication (main authentication) using the biometric information stored in the member management database.

[0174] In the above embodiment, the server device 10 does not repeat pre-authentication for a visitor who has been pre-authenticated once. However, the visitor control unit 203 may repeat pre-authentication for a visitor who has failed pre-authentication.

[0175] The server device 10 may set a threshold for determining successful matching in the matching process performed during main authentication lower than the threshold for the matching process performed during pre-authentication. This is because the number of entries in the visitor management database is significantly smaller than the number of entries in the member management database, and it is expected that sufficient authentication accuracy can be ensured even if the threshold for the matching process is lowered. Alternatively, the server device 10 may set a higher threshold for the matching process during pre-authentication than the threshold for the matching process during main authentication. In other words, the server device 10 may make stricter judgments in pre-authentication to reduce the risk of the authenticatee being determined to have failed authentication during main authentication.

[0176] In the above embodiment, a case has been described in which a facial image is transmitted as biometric information from payment terminal 20 to server device 10. However, feature amounts generated from a facial image may be transmitted as biometric information from payment terminal 20 to server device 10. In this case, server device 10 may perform the matching process without generating feature amounts from the facial image.

[0177] The form of data transmission between each device (e.g., server device 10, payment terminal 20) is not particularly limited, but the data transmitted between these devices may be encrypted. Biometric information of users and other data is transmitted between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.

[0178] In the above embodiment, a case has been described in which a member management database and the like are configured inside the server device 10, but the database may also be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented on another server. More specifically, the above-described "visitor control unit (visitor control means)" and the like may be implemented on any of the devices included in the system.

[0179] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0180] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0181] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to information processing systems that provide services using biometric authentication.

[0182] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0183] [Appendix 1] a storage means for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control means for acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and for executing a first authentication process using the acquired biometric information and the stored biometric information; a second control means for notifying the visitor of the success of the first authentication process by using the anonymous information of the visitor identified by the first authentication process if the first authentication process is successful; A server device comprising: [Appendix 2] The server device described in Appendix 1, wherein the first control means calculates a person feature that characterizes the visitor from image data that shows the specified area, and determines that the visitor is staying in the specified area if a person feature that substantially matches the calculated person feature is calculated from newly acquired image data. [Appendix 3] The server device described in Appendix 2, wherein the first control means extracts a human area of ​​the visitor from image data showing the specified area, and obtains biometric information corresponding to the stored biometric information from the extracted human area. [Appendix 4] The server device described in Appendix 3, wherein the second control means continues to notify the visitor who is staying in the specified area that the first authentication process has been successful, and when the visitor leaves the specified area, cancels the notification of the fact that the first authentication process has been successful. [Appendix 5] The server device according to any one of appendices 1 to 4, wherein the second control means transmits the anonymous information of the visitor identified by the first authentication process to a display device installed in a position visible to the visitor. [Appendix 6] The server device according to any one of appendices 1 to 4, further comprising a third control means for acquiring biometric information of a person to be authenticated who has passed through the specified area and arrived at a specified location to receive a specified service, and for executing a second authentication process using the acquired biometric information of the person to be authenticated. [Appendix 7] The server device described in Appendix 6, wherein the third control means performs the second authentication process using the acquired biometric information of the person to be authenticated and the biometric information of the visitor who is determined to have succeeded in the first authentication process. [Appendix 8] The server device according to any one of appendices 1 to 4, wherein the anonymous information is a nickname or an avatar. [Appendix 9] a storage step of storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control step of acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and executing a first authentication process using the acquired biometric information and the stored biometric information; a second control step of, if the first authentication process is successful, notifying the visitor of the success of the first authentication process by using the anonymous information of the visitor identified by the first authentication process; A method for controlling a server device, comprising: [Appendix 10] The control method for a server device described in Appendix 9, wherein the first control step calculates a person feature that characterizes the visitor from image data that shows the specified area, and determines that the visitor is staying in the specified area if a person feature that substantially matches the calculated person feature is calculated from newly acquired image data. [Appendix 11] The control method for a server device described in Appendix 10, wherein the first control step extracts a human area of ​​the visitor from image data showing the specified area, and obtains biometric information corresponding to the stored biometric information from the extracted human area. [Appendix 12] The control method of the server device described in Appendix 11, wherein the second control step continues to notify the visitor who is staying in the specified area that the first authentication process has been successful, and when the visitor leaves the specified area, cancels the notification of the fact that the first authentication process has been successful. [Appendix 13] A control method for a server device described in any one of Appendices 9 to 12, wherein the second control step transmits the anonymous information of the visitor identified by the first authentication process to a display device installed in a position visible to the visitor. [Appendix 14] A control method for a server device described in any one of Appendices 9 to 12, further comprising a third control step of acquiring biometric information of a person to be authenticated who has passed through the specified area and arrived at a specified location to receive a specified service, and performing a second authentication process using the acquired biometric information of the person to be authenticated. [Appendix 15] A control method for a server device described in Appendix 14, in which the third control step performs the second authentication process using the acquired biometric information of the person to be authenticated and the biometric information of the visitor who is determined to have succeeded in the first authentication process. [Appendix 16] 13. The method for controlling a server device according to any one of appendices 9 to 12, wherein the anonymous information is a nickname or an avatar. [Appendix 17] The computer installed in the server device a storage process for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control process for acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and for executing a first authentication process using the acquired biometric information and the stored biometric information; a second control process for notifying the visitor of the success of the first authentication process, using the anonymous information of the visitor identified by the first authentication process, if the first authentication process is successful; A program to execute. [Appendix 18] The program described in Appendix 17, wherein the first control process calculates a person feature that characterizes the visitor from image data that shows the specified area, and determines that the visitor is staying in the specified area if a person feature that substantially matches the calculated person feature is calculated from newly acquired image data. [Appendix 19] The program described in Appendix 18, wherein the first control process extracts a human area of ​​the visitor from image data that captures the specified area, and obtains biometric information corresponding to the stored biometric information from the extracted human area. [Appendix 20] The program described in Appendix 19, wherein the second control process continues to notify the visitor who is staying in the specified area that the first authentication process has been successful, and when the visitor leaves the specified area, cancels the notification of the fact that the first authentication process has been successful. [Appendix 21] The program described in any one of Appendices 17 to 20, wherein the second control process transmits the anonymous information of the visitor identified by the first authentication process to a display device installed in a position visible to the visitor. [Appendix 22] The program described in any one of Appendices 17 to 20, further comprising a third control process for acquiring biometric information of a person to be authenticated who has passed through the specified area and arrived at a specified location to receive a specified service, and performing a second authentication process using the acquired biometric information of the person to be authenticated. [Appendix 23] The program described in Appendix 22, wherein the third control process executes the second authentication process using the acquired biometric information of the person to be authenticated and the biometric information of the visitor who is determined to have succeeded in the first authentication process. [Appendix 24] 21. The program according to any one of appendices 17 to 20, wherein the anonymous information is a nickname or an avatar.

[0184] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 17 in the same dependent relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 17, but within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements may also be dependent on various hardware, software, various recording means for recording software, or systems.

[0185] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0186] 10 Server device 20 Payment terminals 30 Camera equipment 40 Display device 50 devices 100 Server device 101 Memory means 102 first control means 103 Second control means 201 Communication control unit 202 Membership Management Department 203 Visitor Control Unit 204 Notification control section 205 Payment Control Unit 206 Memory section 301 Communication Control Unit 302 Payment control section 303 Storage section 311 processor 312 memory 313 Input / Output Interface 314 Communication Interface 401 Communication control unit 402 Display control unit 403 Storage section

Claims

1. a storage means for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control means for acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and for executing a first authentication process using the acquired biometric information and the stored biometric information; a second control means for notifying the visitor of the success of the first authentication process by using the anonymous information of the visitor identified by the first authentication process if the first authentication process is successful; A server device comprising:

2. 2. The server device according to claim 1, wherein the first control means calculates a person feature that characterizes the visitor from image data showing the specified area, and determines that the visitor is staying in the specified area when a person feature that substantially matches the calculated person feature is calculated from newly acquired image data.

3. 3. The server device according to claim 2, wherein the first control means extracts a human region of the visitor from image data showing the predetermined area, and acquires biometric information corresponding to the stored biometric information from the extracted human region.

4. 4. The server device according to claim 3, wherein the second control means continues to notify the visitor who is staying in the specified area of ​​the fact that the first authentication process has been successful, and when the visitor leaves the specified area, cancels the notification of the fact that the first authentication process has been successful.

5. The server device according to claim 1 , wherein the second control means transmits the anonymous information of the visitor identified by the first authentication process to a display device installed in a position visible to the visitor.

6. 5. The server device according to claim 1, further comprising a third control means for acquiring biometric information of a person to be authenticated who has passed through the specified area and arrived at a specified location in order to receive a specified service, and for executing a second authentication process using the acquired biometric information of the person to be authenticated.

7. The server device according to claim 6, wherein the third control means executes the second authentication process using the acquired biometric information of the person to be authenticated and the biometric information of the visitor who is determined to have succeeded in the first authentication process.

8. The server device according to claim 1 , wherein the anonymous information is a nickname or an avatar.

9. a storage step of storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control step of acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and executing a first authentication process using the acquired biometric information and the stored biometric information; a second control step of, if the first authentication process is successful, notifying the visitor of the success of the first authentication process by using the anonymous information of the visitor identified by the first authentication process; A method for controlling a server device, comprising:

10. The computer installed in the server device a storage process for storing biometric information and anonymous information of each of a plurality of users in association with each other; a first control process for acquiring biometric information of a visitor staying in a predetermined area from image data showing the predetermined area, and for executing a first authentication process using the acquired biometric information and the stored biometric information; a second control process for notifying the visitor of the success of the first authentication process by using the anonymous information of the visitor identified by the first authentication process if the first authentication process is successful; A program to execute.

Images