Server device, server device control method and program

Abstract

To provide a server device which appropriately obtains and manages information on users of a store.SOLUTION: A server includes: first obtaining means for obtaining first biological information on a user; output instructing means for instructing an output of registered introduction information when it is determined that the biological information on the user is not registered yet upon a check-up of the first biological information with biological information registered in advance; second obtaining means for obtaining registration person information on the user from the terminal thereof based on an input using the registered introduction information; and registration means for registering the first biological information and the registration person information in association with each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a server device, a method for controlling a server device, and a program. [Background technology]

[0002] There is a technology for acquiring and managing information about customers of a store that provides products and services.

[0003] For example, Patent Document 1 discloses a customer information management system that manages information about customers. In the system described in Patent Document 1, a customer who wishes to register as a member of a store operates a cash register terminal to input information including their name, address, gender, and date of birth. The management server adds the customer information received from the cash register terminal to the member data and manages it. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-004202 Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, a customer who registers as a member inputs information including the customer's name and other details using a terminal installed in the store, and registers. In this case, there is a possibility that the input information may be seen by others in the store, which poses a security problem.

[0006] Therefore, a main object of the present invention is to provide a server device, a method for controlling a server device, and a program that appropriately acquire and manage information about store users. [Means for solving the problem]

[0007] According to a first aspect of the present invention, a server device is provided which includes a first acquisition means for acquiring first biometric information of a user, an output instruction means for instructing the output of registration introduction information when it is determined that the user's biometric information is unregistered by comparing the first biometric information with pre-registered biometric information, a second acquisition means for acquiring the user's registered person information from the user's terminal based on input using the registration introduction information, and a registration means for linking and registering the first biometric information and the registered person information.

[0008] According to a second aspect of the present invention, there is provided a method for controlling a server device, comprising: a first acquisition step for acquiring first biometric information of a user; an output instruction step for instructing the output of registration introduction information when it is determined that the user's biometric information is unregistered by comparing the first biometric information with pre-registered biometric information; a second acquisition step for acquiring the user's registered person information from the user's terminal based on input using the registration introduction information; and a registration step for linking and registering the first biometric information and the registered person information.

[0009] According to a third aspect of the present invention, a program is provided for causing a computer mounted on a server device to execute a first acquisition process for acquiring first biometric information of a user, an output instruction process for instructing the output of registration introduction information when it is determined that the user's biometric information is unregistered by comparing the first biometric information with pre-registered biometric information, a second acquisition process for acquiring the user's registered person information from the user's terminal based on input using the registration introduction information, and a registration process for linking and registering the first biometric information and the registered person information. [Effects of the Invention]

[0010] According to each aspect of the present invention, a server device, a control method for a server device, and a program are provided that appropriately acquire and manage information about store users. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram illustrating an example of a processing configuration of a server device according to the present disclosure. [Figure 2] FIG. 2 is a flowchart illustrating an example of a processing operation of the server device according to the present disclosure. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of an information processing system according to the present disclosure. [Figure 4] FIG. 4 is a diagram illustrating an example of a registrant management database according to the present disclosure. [Figure 5] FIG. 5 is a block diagram illustrating an example of a processing configuration of a store terminal according to the present disclosure. [Figure 6] FIG. 6 is a block diagram illustrating an example of a processing configuration of a server device according to the present disclosure. [Figure 7] FIG. 7 is a block diagram illustrating an example of a processing configuration of a terminal according to the present disclosure. [Figure 8A] FIG. 8A is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 8B] FIG. 8B is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 8C] FIG. 8C is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 8D] FIG. 8C is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 9A] FIG. 9A is a diagram illustrating an example of a store terminal and a display on the terminal according to the present disclosure. [Figure 9B] FIG. 9B is a diagram illustrating an example of a store terminal and a display on the terminal according to the present disclosure. [Figure 9C] FIG. 9C is a diagram illustrating an example of a store terminal and a display on the terminal according to the present disclosure. [Figure 9D] FIG. 9D is a diagram illustrating an example of a store terminal and a display on the terminal according to the present disclosure. [Figure 10] FIG. 10 is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 11A] FIG. 11A is a diagram illustrating an example of a display on a terminal according to the present disclosure. [Figure 11B] FIG. 11B is a diagram showing an example of a display on a terminal according to the present disclosure. [Figure 12] FIG. 12 is a block diagram illustrating an example of a processing configuration of a terminal according to the present disclosure. [Figure 13] FIG. 13 is a sequence diagram showing an example of the operation of the information processing system according to the present disclosure. [Figure 14] FIG. 14 is a diagram illustrating an example of a display on a terminal according to the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating an example of a registrant management database according to the present disclosure. [Figure 16] FIG. 16 is a diagram illustrating an example of a hardware configuration of a store terminal according to the present disclosure. [Figure 17] FIG. 17 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. [Figure 18] FIG. 18 is a diagram illustrating an example of a hardware configuration of a terminal according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Unless otherwise specified, the blocks shown in each drawing represent functional configurations, not hardware configurations. Connection lines between blocks in each drawing include both bidirectional and unidirectional ones. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Furthermore, in this specification and drawings, elements that can be similarly described may be designated by the same reference numerals, thereby avoiding redundant explanation.

[0013] [First embodiment] FIG. 1 is a block diagram showing an example of a processing configuration (processing module) of a server device 1 according to the present disclosure. FIG. 2 is a flowchart showing an example of a processing operation of the server device 1 according to the present disclosure. This flowchart also shows a control method for the server device 1. The server device 1 is an information processing device that acquires and manages information about customers of a store. The server device 1 may be installed in any location inside or outside the store where customers visit, or may be installed on a network (on the cloud).

[0014] The server device 1 includes a first acquisition means 11, an output instruction means 12, a second acquisition means 13, and a registration means 14. The first acquisition means 11 acquires the first biometric information of the user (first acquisition step, step S1 in FIG. 2). The output instruction means 12 instructs the output of registration introduction information when it is determined that the user's biometric information is unregistered by comparing the first biometric information with pre-registered biometric information (output instruction step, step S2). The second acquisition means 13 acquires the user's registrant information from the user's terminal based on input using the registration introduction information (second acquisition step, step S3). The registration means 14 associates the first biometric information with the registrant information and registers them (registration step, step S4).

[0015] Here, biometric information includes, for example, feature quantities calculated from physical characteristics unique to an individual, such as face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, biometric information may be image data such as a face image or fingerprint image. Biometric information may be any information that includes a user's physical characteristics. The registration information includes identification information that uniquely identifies the user and access information for accessing the server device 1, and is generated according to a predetermined rule. Examples of the registration information include, but are not limited to, two-dimensional codes such as QR codes (registered trademarks), one-dimensional codes such as barcodes, alphanumeric characters, and symbols. The access information is, for example, the uniform resource locator (URL) of a website provided by the server device 1. A user can input and register their own registrant information by accessing the website using the access information obtained from the registration information. The registrant information may include, but is not limited to, the user's name, gender, date of birth, address, contact information, payment information, etc.

[0016] As described above, according to this embodiment, the server device 1 acquires the user's registrant information from the user's terminal based on input using the registration introduction information. Then, the server device 1 registers the acquired registrant information by linking it with the first biometric information. Therefore, the user can complete the member registration without others in the store seeing the content entered when registering the registrant information. Therefore, the server device 1 can eliminate security concerns in the member registration procedure and appropriately acquire and manage information about store users.

[0017] [Second embodiment] This embodiment is a specific example of the first embodiment described above. Fig. 3 is a block diagram showing the configuration of an information processing system 1000 according to the present disclosure. As shown in Fig. 3, the information processing system 1000 includes a store terminal 100, a server device 200, and a terminal 300. The information processing system 1000 is a system that acquires information about users who visit a store such as a convenience store, and registers and manages the users as members of the store.

[0018] 3, server device 200 includes a registrant management database. This database is an example, and server device 200 may also include other databases. Server device 200 may also integrate multiple databases into a single database.

[0019] The registrant management database is a database that stores information about store users. FIG. 4 is a diagram showing an example of information stored in the registrant management database. The registrant management database has the following data items: registration ID, registered biometric information, name, gender, date of birth, address, contact information (telephone number, email address), payment information, owned points, owned coupons, and expiration date. Here, a state in which only the registration ID, registered biometric information, and expiration date are registered is considered to be a "state in which provisional registration is complete." Furthermore, a state in which registrant information such as name, contact information, and payment information is also registered in addition to the registration ID and registered biometric information is considered to be a "state in which final registration is complete." Referring to FIG. 4, people with registration IDs ID01 and ID02 have completed final registration, and a person with registration ID ID03 has completed provisional registration but not final registration. A user is considered to have completed membership registration with the store once final registration is complete.

[0020] The registered ID is identification information that uniquely identifies a user. The registered biometric information is a feature generated from the user's facial image. The payment information is information such as credit card and bank account information. The owned points are information indicating points granted as a benefit to a user who is a member of a store. The owned coupons are information indicating coupons granted as a benefit to a user who is a member of a store. A user can use the owned points and owned coupons when paying for products at the store, but the use is not limited to this. The expiration date is information indicating the expiration date when provisional registration is complete. In order to complete membership registration with the store, the user must complete official registration by the expiration date. Note that the registrant management database shown in Figure 4 is an example and is not intended to limit the items to be stored. For example, a user's facial image may be registered in the registrant management database.

[0021] The store terminal 100 and the server device 200 are configured to be able to communicate with each other by wired communication or wireless communication via a network NW. The terminal 300 is also able to communicate with the server device 200 and the like via the network NW.

[0022] 3 is an example and is not intended to limit the configuration of the information processing system 1000 of the present disclosure. For example, the information processing system 1000 may include two or more store terminals 100, or may include two or more server devices 200. Furthermore, the information processing system 1000 may include an authentication device.

[0023] Next, an example of the processing configuration of each device constituting the information processing system 1000 according to the second embodiment will be described with reference to FIGS.

[0024] [Store terminal] 5 is a block diagram showing an example of a processing configuration (processing module) of a store terminal 100 according to the present disclosure. The store terminal 100 is, for example, a Point of Sale (POS) cash register terminal used when a user purchases goods in a store, and is installed in the store. The store terminal 100 includes a communication control unit 101, a transaction processing unit 102, an image capture control unit 103, a display control unit 104, an input receiving unit 105, an output unit 106, and a memory unit 107.

[0025] The communication control unit 101 is a means for controlling communication with other devices. For example, the communication control unit 101 receives data (packets) from the server device 200. The communication control unit 101 also transmits data to the server device 200. The communication control unit 101 passes data received from other devices to other processing modules. The communication control unit 101 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 101. The communication control unit 101 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0026] The accounting processor 102 is a means for processing the transaction for merchandise. For example, the accounting processor 102 reads the information codes attached to each product the user wishes to purchase and calculates the total price. The accounting processor 102 then presents the user with a breakdown of the prices of each product, the total price, and other information. The accounting processor 102 also processes the transaction when the user pays in cash or by any of various other payment methods. If the user's registered biometric information and registered user information are registered in the information processing system 1000, the accounting processor 102 may perform the transaction using the payment information included in the registered user information identified by biometric authentication of the user. The accounting processor 102 may perform each operation based on operations performed by a store employee, or, if the store terminal 100 is a self-checkout terminal, based on operations performed by the user.

[0027] The photography control unit 103 is a means for photographing a user. The photography control unit 103 photographs the user when the user comes in front of the store terminal 100 to pay for a product and is performing the payment process. At this time, the photography control unit 103 may perform photography in response to instructions from the payment processing unit 102. The store terminal 100 may also be equipped with a human presence sensor (not shown) that detects people within a predetermined range, and in that case, the photography control unit 103 may photograph the user when the human presence sensor detects a person. The communication control unit 101 transmits image data showing the user to the server device 200.

[0028] The display control unit 104 is a means for displaying guidance information for a user on the store terminal 100. For example, the display control unit 104 displays guidance information instructed by the display instruction unit 204 (display instruction means) of the server device 200 on a screen such as a liquid crystal display of the store terminal 100, depending on the result of a matching process using the user's biometric information. The user checks the guidance information via the screen.

[0029] The input receiving unit 105 is a means for receiving input from a user. For example, the input receiving unit 105 receives input from a user who has confirmed the guidance information displayed by the display control unit 104, using a device such as a touch panel of the store terminal 100 as a response to the guidance information. The communication control unit 101 transmits the received input content to the server device 200.

[0030] The output unit 106 is a means for outputting media such as receipts. For example, based on instructions from the accounting processing unit 102, the output unit 106 outputs to the user a receipt on which information including the items purchased by the user, a breakdown of the prices of each item, and the total amount is printed. Furthermore, based on instructions from the output instruction unit 206 of the server device 200, the output unit 106 outputs a receipt on which registration and introduction information is printed in addition to the contents of the receipt described above. Here, the registration and introduction information is information used to register the user's registrant information in the registrant management database. Note that the output unit 106 may output a paper medium on which the registration and introduction information is printed separately from the receipt.

[0031] The storage unit 107 is a means for storing information such as programs and data required for the operation of the store terminal 100.

[0032] [Server device] 6 is a block diagram showing an example of a processing configuration (processing module) of server device 200 according to the present disclosure. Server device 200 is a specific example of the above-mentioned server device 1. Server device 200 includes a communication control unit 201, a first acquisition unit 202, a matching unit 203, a display instruction unit 204, a registration unit 205, an output instruction unit 206, a second acquisition unit 207, and a storage unit 208.

[0033] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the store terminal 100. The communication control unit 201 also transmits data to the store terminal 100. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0034] The first acquisition unit 202 is an example of the first acquisition means 11 described above. The first acquisition unit 202 is a means for acquiring biometric information of a user from the store terminal 100. For example, the first acquisition unit 202 acquires the first biometric information of the user. Note that in this embodiment, the first biometric information will be described as meaning a person's facial image. The first acquisition unit 202 receives image data of the user captured by the image capture control unit 103 of the store terminal 100. The first acquisition unit 202 then extracts the user's facial image from the image data and acquires it as the first biometric information. Since existing technology can be used for the facial image extraction process performed by the first acquisition unit 202, detailed description thereof will be omitted. For example, the first acquisition unit 202 may extract a facial image (face region) from the image data using a learning model trained by a convolutional neural network (CNN). Alternatively, the first acquisition unit 202 may extract a facial image using a method such as template matching.

[0035] The matching unit 203 is a means for performing a matching process on a user. For example, when the matching unit 203 acquires a face image as the first biometric information from the first acquisition unit 202, the matching unit 203 generates feature amounts from the face image. Since existing technology can be used for the feature amount generation process by the matching unit 203, a detailed description thereof will be omitted. For example, the matching unit 203 extracts the eyes, nose, mouth, etc. from the face image as feature points. Thereafter, the matching unit 203 calculates the positions of the feature points and the distances between the feature points as feature amounts (generating a feature vector consisting of multiple feature amounts). Note that the first acquisition unit 202 may generate feature amounts from the first biometric information, and in that case, the matching unit 203 may acquire the feature amounts from the first acquisition unit 202.

[0036] The matching unit 203 performs a matching process using the generated feature and the feature (registered biometric information) registered in the registrant management database. More specifically, the matching unit 203 sets the generated feature as a matching target, and performs 1:N (N is a positive integer, the same applies below) matching with multiple feature registered in the registrant management database.

[0037] The matching unit 203 calculates the similarity between the feature to be matched and each of the multiple registered feature values. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0038] The matching unit 203 determines that the matching process has failed if there is no feature that has a similarity with the feature to be matched that is equal to or greater than a predetermined value among the multiple feature values ​​registered in the registrant management database. In this case, the user is a person whose biometric information has not been registered (provisional registration has not been completed).

[0039] The matching unit 203 determines that the matching process is successful if, among the multiple feature quantities registered in the registrant management database, there is a feature quantity whose similarity with the feature quantity to be matched is equal to or greater than a predetermined value. If the matching process is successful, the matching unit 203 refers to the registrant management database and identifies a registered ID corresponding to the feature quantity with the highest similarity. The matching unit 203 also refers to the registrant management database and determines whether or not registrant information linked to the identified registered ID exists. If the matching unit 203 determines that registrant information exists, the user is a person for whom registration of registered biometric information and registrant information has been completed (full registration has been completed). On the other hand, if the matching unit 203 determines that registrant information does not exist, the user is a person for whom registration biometric information has been registered but registrant information has not been registered (provisional registration has been completed but full registration has not been completed).

[0040] The display instruction unit 204 is a means for generating various types of guidance information for the user and instructing the store terminal 100 or the terminal 300 to display the generated various types of guidance information. For example, the display instruction unit 204 acquires information regarding the registration status of the user's biometric information and registrant information, determined based on the results of a matching process using the user's biometric information, from the matching unit 203. The registration status indicates whether the user's biometric information and registrant information are registered in the registrant management database. The display instruction unit 204 generates different guidance information depending on the registration status. Thereafter, the display instruction unit 204 causes the store terminal 100 to display the information.

[0041] The registration unit 205 is an example of the registration means 14 described above. The registration unit 205 is a means for performing a registration process for information related to a user. For example, the registration unit 205 generates a registration ID based on the input content from the user accepted by the input accepting unit 105 of the store terminal 100. The registration ID may be any information that can uniquely identify a store user. After generating the registration ID, the registration unit 205 adds a new entry to the registrant management database and creates an account for the user. The registration unit 205 associates the registration ID with the feature amount, etc., generated from the first biometric information by the matching unit 203 and registers it in the added entry, thereby provisionally registering the user. Note that the information that the registration unit 205 registers in the registrant management database at the time of provisional registration is not limited to the above, and other information, etc., may also be associated and registered.

[0042] Also, for example, the registration unit 205 registers the registrant information of the user acquired by the second acquisition unit 207 from the terminal 300 in the registrant management database. The registration unit 205 refers to the registrant management database and identifies an account corresponding to a registration ID linked to the acquired registrant information. The registration unit 205 registers the acquired registrant information in association with the registered biometric information already registered in the identified account, and performs the official registration of the user. Note that the information that the registration unit 205 registers in the registrant management database during the official registration is not limited to the above, and other information may also be registered in association with the information.

[0043] Furthermore, for example, the registration unit 205 sets an expiration date for the provisional registration at the time of provisional registration. Then, the registration unit 205 manages information regarding the set expiration date in the registrant management database, linking it to the registration ID. The registration unit 205 accesses the registrant management database periodically or at a predetermined timing, references the expiration date of each account, and identifies accounts whose expiration date has passed. If the registrant information for the identified account has not been registered and actual registration has not been completed, the registration unit 205 deletes the account. If the registrant information for the identified account has been registered and actual registration has been completed, the registration unit 205 invalidates the expiration date. This prevents information about users who have only completed provisional registration but do not intend to complete actual registration from continuing to be stored in the registrant management database.

[0044] The output instruction unit 206 is an example of the output instruction means 12 described above. The output instruction unit 206 is a means for instructing the store terminal 100 to output the registration introduction information. The output instruction unit 206 generates the registration introduction information after the registration unit 205 completes the temporary registration. The registration introduction information includes the user's registration ID, access information for accessing the server device 200, and information regarding the expiration date of the temporary registration set by the registration unit 205. Note that the registration introduction information in this embodiment will be described as taking the form of a two-dimensional code such as a QR code (registered trademark). The output instruction unit 206 causes the store terminal 100 to output the generated registration introduction information.

[0045] The second acquisition unit 207 is an example of the above-mentioned second acquisition means 13. The second acquisition unit 207 is a means for acquiring information about a user from the terminal 300. For example, the second acquisition unit 207 acquires registrant information such as name, sex, date of birth, address, contact information (telephone number, email address), and payment information from the terminal 300, in a state where the registrant information is linked to the user's registration ID.

[0046] The storage unit 208 is a means for storing information such as programs and data required for the operation of the server device 200. The storage unit 208 stores the registered biometric information of the user in association with the registrant information in the registrant management database.

[0047] [Device] 7 is a block diagram showing an example of a processing configuration (processing module) of a terminal 300 according to the present disclosure. The terminal 300 is a terminal carried by a user, and examples thereof include a mobile terminal device such as a smartphone, a mobile phone, or a tablet, and a computer (personal computer, laptop computer), etc. The terminal 300 includes a communication control unit 301, a reading control unit 302, an input receiving unit 303, a display control unit 304, and a storage unit 305.

[0048] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 200. The communication control unit 301 also transmits data to the server device 200. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0049] The reading control unit 302 is a means for reading the registration introduction information and accessing a website provided by the server device 200. For example, the reading control unit 302 photographs a two-dimensional code of the registration introduction information printed on a receipt output by the store terminal 100 in response to a user's operation. The reading control unit 302 reads and analyzes the photographed registration introduction information to obtain access information for accessing the website provided by the server device 200. The reading control unit 302 uses the obtained access information to access the website. When the website is accessed, an input form for accepting input of registrant information is displayed on a screen such as a liquid crystal display of the terminal 300.

[0050] The input accepting unit 303 is a means for accepting input from a user. For example, the input accepting unit 303 accepts input of registrant information via an input form displayed by the reading control unit 302 reading the registration introduction information. Examples of the registrant information include, but are not limited to, the user's name, gender, date of birth, address, contact information (telephone number, email address), and payment information. The user enters the information using a device such as a touch panel of the terminal 300. The communication control unit 301 transmits the accepted registrant information to the server device 200. The registration introduction information read by the reading control unit 302 includes the user's registration ID, and the registrant information entered by the user is also sent to the server device 200 in a state linked to the registration ID.

[0051] The display control unit 304 is a means for displaying guidance information for the user on the terminal 300. For example, the display control unit 304 displays guidance information instructed by the display instruction unit 204 of the server device 200 on a screen such as a liquid crystal display of the terminal 300, depending on the result of the main registration using the registrant information. The user checks the guidance information via the screen.

[0052] The storage unit 305 is a means for storing information such as programs and data required for the operation of the terminal 300 .

[0053] [System Operation] Next, the operation of each device in the information processing system 1000 according to the second embodiment will be described with reference to FIGS.

[0054] <Temporary registration> 8A to 8D are sequence diagrams showing an example of the operation of the information processing system 1000 according to the present disclosure. The operation of the information processing system 1000 according to the present disclosure regarding provisional registration will be described with reference to FIGS.

[0055] A user visiting a store goes to the store terminal 100 to pay for the product they wish to purchase. The store terminal 100 determines whether the user's checkout process has started (step S101) and waits until the checkout process starts (step S101, NO).

[0056] Next, if the store terminal 100 determines that the customer's transaction has begun (step S101, YES), the store terminal 100 takes a picture of the customer standing in front of the store terminal 100 (step S102). The store terminal 100 then transmits the captured image data to the server device 200 (step S103). Before capturing a picture of the customer, the store terminal 100 may display a screen for obtaining the customer's consent or a screen instructing the customer to look in a specific direction for capturing the picture.

[0057] When the server device 200 receives the image data from the store terminal 100, it extracts a facial image of the user from the image data and acquires the extracted facial image (facial image data) as first biometric information (step S104).

[0058] Next, the server device 200 generates a feature from the acquired first biometric information, and compares the generated feature with the feature (registered biometric information) registered in advance in the registrant management database in a one-to-N manner (step S105).

[0059] Next, the matching unit 203 of the server device 200 determines whether or not the matching feature exists in the registrant management database (step S106). If the matching unit 203 determines that the matching feature does not exist in the registrant management database (provisional registration has not been completed) (step S106, NO), the server device 200 proceeds to step S201.

[0060] On the other hand, if the matching unit 203 determines that the matching feature exists in the registrant management database (the user's biometric information is already registered) (step S106, YES), the server device 200 refers to the registrant information column linked to the matching feature in the registrant management database and determines whether the registrant information has already been registered (step S107).

[0061] If the server device 200 determines that the registrant information has not been registered (provisional registration has been completed but actual registration has not been completed) (step S107, NO), the server device 200 proceeds to step S301. On the other hand, if the server device 200 determines that the registrant information has been registered (actual registration has been completed) (step S107, YES), the server device 200 proceeds to step S401.

[0062] In step S201, the server device 200 generates registration guidance information. The registration guidance information is an example of guidance information generated by the display instruction unit 204, and is guidance information regarding the registration of biometric information. Specifically, the registration guidance information includes guidance information regarding the registration of biometric information required for the user to register as a member of a store, and information for allowing the user to select whether or not to agree to the member registration. The registration guidance information may include information encouraging the user to register as a member, and may include information indicating incentives such as points, coupons, discounts, etc., that will be given upon registering as a member. The registration guidance information may also include information guiding the user to register a facial image of the user captured by the store terminal 100 as part of the member registration procedure.

[0063] Next, the server device 200 transmits a display instruction including the generated registration guidance information to the store terminal 100 (step S202). The store terminal 100, which has received the display instruction, displays the registration guidance information to the user (step S203). Then, the store terminal 100 accepts input from the user (step S204). For example, the store terminal 100 displays a GUI (Graphical User Interface) as shown in FIG. 9A on a screen such as a liquid crystal display as the registration guidance information, and accepts input from the user as to whether or not they agree to member registration.

[0064] When the store terminal 100 receives the input from the user, it transmits the received input to the server device 200 (step S205).

[0065] When the server device 200 receives the input content from the store terminal 100, it determines whether the received input content indicates consent to member registration (step S206). If the server device 200 determines that the input content indicates consent to member registration (step S206, YES), the server device 200 generates a registration ID (step S207). Then, the server device 200 sets an expiration date for the provisional registration (step S208). The expiration date can be set to any period, and may be within a few hours or a few days after the completion of provisional registration. Furthermore, a different period may be set for each user, or a uniform period may be set.

[0066] The server device 200 associates the generated registration ID, the feature generated from the first biometric information, and information regarding the set expiration date of the provisional registration, and registers them in the registrant management database (step S209), thereby performing the provisional registration.

[0067] Next, the server device 200 generates registration introduction information including the provisionally registered registration ID, information regarding the expiration date of the provisional registration, and access information for accessing the server device 200 (step S210). The server device 200 transmits an output instruction including the generated registration introduction information to the store terminal 100 (step S211).

[0068] Upon receiving the output instruction, the store terminal 100 outputs the registration introduction information to the user and ends the process (step S212). For example, the store terminal 100 prints a two-dimensional code as shown in FIG. 9B on a receipt and outputs it as the registration introduction information. By receiving the receipt, the user can proceed with the member registration procedure from provisional registration onwards at any time they wish, as long as it is within the expiration date of the provisional registration. Note that although the provisional registration process performed by the server device 200 ends in step S211, if the server device 200 receives a registration ID from the user terminal 300 that obtained the registration introduction information output in step S212 (FIG. 10, step S502), the server device 200 starts the main registration process.

[0069] On the other hand, if the server device 200 determines that the input content received from the store terminal 100 does not indicate consent to member registration (step S206, NO), the server device 200 ends the process.

[0070] In step S301, the server device 200 generates output guidance information. The output guidance information is an example of guidance information generated by the display instruction unit 204 and is information regarding the re-output of the registration introduction information. Specifically, the output guidance information is information that informs the user that the provisional registration has been completed but the actual registration has not been completed, and allows the user to select whether or not to re-output the registration introduction information. Note that, in this case, re-output means that if the user has completed the provisional registration but not the actual registration, the store terminal 100 will output the registration introduction information again because the store terminal 100 has already output the registration introduction information to the user in step S212. This allows the information processing system 1000 to remind a user who has forgotten to perform the actual registration procedure that they need to perform the actual registration to complete their membership registration. Note that the output guidance information includes information regarding the expiration date of the provisional registration associated with the feature matched in step S106. The output guidance information may also include information that prompts the user to complete the registration, and may include information indicating an incentive, such as a special benefit that will be given if the user completes the registration within the expiration date.

[0071] Next, the server device 200 transmits a display instruction including the generated output guidance information to the store terminal 100 (step S302). The store terminal 100, which has received the display instruction, displays the output guidance information to the user (step S303). Then, the store terminal 100 accepts input from the user (step S304). For example, the store terminal 100 displays a GUI such as that shown in FIG. 9C on a screen such as a liquid crystal display as the output guidance information, and accepts input from the user as to whether or not they wish to re-output the two-dimensional code (registration introduction information).

[0072] When the store terminal 100 receives the input from the user, it transmits the received input to the server device 200 (step S305).

[0073] When receiving the input content from the store terminal 100, the server device 200 determines whether the received input content indicates a request for re-output of the registered introduction information (step S306). If the server device 200 determines that re-output is desired (step S306, YES), the server device 200 regenerates the registered introduction information (step S307). Specifically, the server device 200 regenerates the registered introduction information including the registration ID linked to the feature matched in step S106, information regarding the expiration date of the provisional registration, and access information for accessing the server device 200. Note that when regenerating the registered introduction information, the server device 200 may extend the expiration date of the provisional registration and update the expiration date registered in the registrant management database. In this case, the expiration date included in the regenerated registered introduction information is the extended expiration date.

[0074] The server device 200 transmits a re-output instruction including the regenerated registration introduction information to the shop terminal 100 (step S308).

[0075] Upon receiving the re-output instruction, the store terminal 100 re-outputs the registration introduction information to the user and ends the process (step S309). For example, the store terminal 100 prints a two-dimensional code as shown in FIG. 9B on a receipt as the registration introduction information, as in step S212. This allows the user to be prompted to re-register even if they lose the receipt on which the registration introduction information printed when they performed provisional registration is printed. Note that although the provisional registration process performed by the server device 200 ends in step S308, the server device 200 starts the main registration process when it receives a registration ID from the user's terminal 300 that obtained the registration introduction information re-output in step S309 (FIG. 10, step S503).

[0076] On the other hand, if the server device 200 determines that the input content received from the store terminal 100 is not the content desired to be re-output (step S306, NO), the server device 200 ends the process.

[0077] In step S401, server device 200 generates member guidance information. The member guidance information is an example of guidance information generated by display instruction unit 204. Specifically, the member guidance information is information that provides guidance to a user who is already a member of the store regarding benefits that will be granted to the member. The member guidance information includes, for example, information indicating owned points and owned coupons that are linked to the registered user information of the user identified in step S107. Benefits exclusive to members include, for example, services related to the user's owned points and owned coupons, and use of facial recognition payment using the user's registered biometric information, but are not limited to these.

[0078] Next, the server device 200 transmits a display instruction including the generated member guidance information to the store terminal 100 (step S402). Upon receiving the display instruction, the store terminal 100 displays the member guidance information to the user and terminates the process (step S403). For example, the store terminal 100 displays a GUI as shown in FIG. 9D on a screen such as a liquid crystal display as the member guidance information. The store terminal 100 may also display a display that accepts a desired action from the user who is a member based on the member guidance information. Examples of desired actions include, but are not limited to, using owned points or owned coupons, or using facial recognition payment. When the store terminal 100 accepts the use of an owned coupon from the user, it may display a list of the user's owned coupons on a screen such as a liquid crystal display.

[0079] <Registration> 10 is a sequence diagram showing an example of the operation of the information processing system 1000 according to the present disclosure. The operation of the information processing system 1000 according to the present disclosure regarding the main registration will be described with reference to FIG.

[0080] The customer receives a receipt on which the registration introduction information output by the store terminal 100 in step S212 or step S309 is printed. The terminal 300 carried by the customer photographs the receipt and determines whether the registration introduction information has been read (step S501), and waits until the registration introduction information has been read (step S501, NO).

[0081] On the other hand, if the terminal 300 determines that the registration introduction information has been read (step S501, YES), the terminal 300 transmits the registration ID included in the read registration introduction information to the server device 200 (step S502).

[0082] When the server device 200 receives the registration ID from the terminal 300, the server device 200 checks the received registration ID against the registration IDs registered in advance in the registrant management database on a one-to-many basis (step S503).

[0083] If the server device 200 determines that a matching registration ID does not exist in the registrant management database (the provisional registration has expired and the registration ID and the registered biometric information associated with the registration ID have been deleted) (step S504, NO), the server device 200 terminates the process. Note that the server device 200 may transmit a display instruction to the terminal 300 to notify that the provisional registration has expired and the main registration has failed.

[0084] On the other hand, if server device 200 determines that a matching registered ID exists in the registrant management database (step S504, YES), server device 200 transmits access permission to terminal 300 (step S505). Terminal 300, having received the access permission, uses access information for server device 200 included in the registration introduction information read in step S501 to access a website provided by server device 200 and displays an input form for registrant information to the user (step S506). At this time, terminal 300 may display registered biometric information of the user that has already been registered in the registrant management database along with the input form for registrant information. In this case, server device 200 may transmit registered biometric information linked to the matching registered ID to terminal 300 along with the access permission in step S505. This allows the user to confirm the biometric information (face image) registered at the time of provisional registration.

[0085] Next, the terminal 300 accepts input from the user (step S507). For example, the terminal 300 displays a GUI as shown in Fig. 11A as an input form on a screen such as a liquid crystal display, and accepts input of registrant information from the user.

[0086] When the terminal 300 receives the input of the registrant information from the user, the terminal 300 transmits the received registrant information to the server device 200 in a state in which the registrant information is linked to the registration ID of the user (step S508).

[0087] When the server device 200 receives the registrant information from the terminal 300, it identifies the account corresponding to the registration ID linked to the received registrant information from the registrant management database, links the received registrant information to the registered biometric information of the account, etc., registers the received registrant information (step S509), and performs the actual registration.

[0088] Server device 200 transmits a display instruction to terminal 300 notifying the completion of main registration (step S510). Terminal 300, which has received the display instruction, displays a notification of the completion of main registration to the user and terminates the process (step S511). For example, terminal 300 displays a GUI such as that shown in Fig. 11B on a screen such as a liquid crystal display.

[0089] Note that the server device 200 may perform the matching of the registered ID performed in step S503 after receiving the registrant information. In this case, if the terminal 300 determines that the registration introduction information has been read in step S501 (YES), the terminal 300 accesses a website provided by the server device 200 using access information for the server device 200 included in the read registration introduction information, and displays an input form for the registrant information to the user. The terminal 300 transmits the registrant information received from the user via the input form to the server device 200, linked to the registered ID. The server device 200 performs matching using the registered ID linked to the received registrant information. If the server device 200 determines that a matching registered ID exists in the registrant management database, the server device 200 identifies an account corresponding to the matching registered ID. The server device 200 then registers the received registrant information by linking it to the registered biometric information, etc., of the account, and performs main registration.

[0090] As described above, this embodiment achieves the same effects as the first embodiment. Specifically, the terminal 300 accepts input of registrant information from a user using the registration introduction information output by the store terminal 100 and transmits the information to the server device 200. The server device 200 registers the registrant information received from the terminal 300 by linking it with the user's biometric information already registered in the registrant management database. As a result, the user can complete membership registration without the contents of the registrant information being seen by others in the store. This eliminates security concerns in the membership registration process and allows for appropriate acquisition and management of information about store users. Furthermore, a user carrying the terminal 300 can provide their registrant information to the server device 200 at any location for registration. This improves user convenience. Furthermore, since users can register their registrant information outside the store, it is possible to prevent the store from becoming overcrowded with users completing the membership registration process.

[0091] Additionally, the store terminal 100 captures an image of the user while the user is processing the transaction for the product they wish to purchase and transmits the image to the server device 200. If the user agrees to register as a member of the store, the server device 200 registers the biometric information acquired from the image data captured by the store terminal 100 in the registrant management database. As a result, the user no longer needs to take a photo of themselves using their own terminal or other device when registering their biometric information as part of the membership registration process. Instead, they can simply provide their biometric information to the server device 200 and have it registered by processing the transaction at the store. In other words, the user simply uses the registration introduction information to enter their own registrant information on the terminal 300; the registrant information and their biometric information are registered in a linked state, completing the membership registration process. This reduces the time and effort required for users to register as members. Furthermore, the aforementioned effects, such as eliminating security concerns during member registration and improving convenience for users who register as members, can also lead to an increase in the number of registered members at the store.

[0092] [Third embodiment] This embodiment is a modified example of the second embodiment described above. Note that the same reference numerals as those in the drawings of the second embodiment indicate the same objects. Below, the description of the parts common to the second embodiment will be omitted, and the differences will be described in detail.

[0093] This embodiment differs from the second embodiment in that, during the main registration process of the store's membership registration procedure, the server device 200 further performs identity verification processing on the user before registering the user's registrant information in the registrant management database.

[0094] An example of the processing configuration of the terminal 300 according to the third embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing an example of the processing configuration (processing module) of the terminal 300 according to the present disclosure, in which an imaging control unit 306 is added to the configuration of the terminal 300 according to the second embodiment.

[0095] The photographing control unit 306 is a means for photographing a user. The photographing control unit 306 photographs the user based on an operation by the user who performs the main registration. The communication control unit 301 transmits image data showing the user to the server device 200.

[0096] The second acquisition unit 207 of the server device 200 receives image data of the user captured by the image capture control unit 306 of the terminal 300, extracts a facial image of the user from the image data, and acquires the extracted facial image as second biometric information. Note that the second biometric information in this embodiment will be described as meaning a facial image of a person.

[0097] [System Operation] Next, an example of the operation of the information processing system 1000 according to the third embodiment will be described with reference to FIG.

[0098] 13 is a sequence diagram showing an example of a user identity verification process during main registration in the information processing system 1000 according to the present disclosure. This process is executed, for example, between step S507 and step S509 in FIG. 10 described above.

[0099] In step S506, terminal 300 displays an input form for registrant information to the user, and in step S507, accepts input of registrant information from the user. Next, terminal 300 takes an image of the user (step S601). For example, terminal 300 displays a GUI such as that shown in Fig. 14 on a screen such as a liquid crystal display. Then, terminal 300 takes an image based on an operation by the user.

[0100] The timing at which terminal 300 captures the user's image is not limited to this. Specifically, terminal 300 may capture the user's image before accepting input of registrant information. For example, if terminal 300 determines that it has read the registration introduction information in step S501 of FIG. 10 (YES), terminal 300 may capture the user's image. In this case, terminal 300 transmits the registration ID included in the read registration introduction information and the captured image data of the user to server device 200 in step S502. Then, server device 200, having received the registration ID and image data from terminal 300, compares the acquired registration ID and the second biometric information extracted from the image data in step S503. If server device 200 determines in step S504 that an account matching the registration ID and the second biometric information exists in the registrant management database, server device 200 determines that the comparison is a match (YES). Subsequent operations are the same as those from step S505 of FIG. 10 onward.

[0101] Returning to Fig. 13, terminal 300 transmits the captured image data and the registrant information accepted in step S507 to server device 200 (step S602). Terminal 300 transmits the accepted registrant information to server device 200 in a state where it is linked to the user's registration ID.

[0102] When the server device 200 receives the image data and the registrant information from the terminal 300, it extracts a facial image of the user from the image data and acquires the extracted facial image (facial image data) as second biometric information (step S603).

[0103] Next, the server device 200 generates features from the acquired second biometric information, identifies an account from the registrant management database corresponding to the registration ID linked to the received registrant information, and compares the registered biometric information (features) of the account with the features generated from the second biometric information on a one-to-one basis (step S604).

[0104] If the server device 200 determines that the matching results are consistent (step S605, YES), the server device 200 registers the received registrant information by linking it to the registered biometric information of the account identified in step S604 (step S509) and performs official registration. The server device 200 may also link the feature values ​​generated from the second biometric information and register them in the registrant management database, or may overwrite and update the registered biometric information registered in the provisional registration with the feature values ​​generated from the second biometric information. In this case, in step S506, the terminal 300 may display the registered biometric information of the user already registered in the registrant management database and accept input from the user as to whether or not the user wishes to update the registered biometric information. Here, if an input indicating a desire to update is accepted, the registered biometric information will be overwritten with the feature values ​​generated from the second biometric information. Furthermore, in step S601, after capturing a photo of the user, the terminal 300 may display the captured image and accept input from the user as to whether or not to re-capture the image. When the terminal 300 receives an input indicating that the user wishes to retake an image, the terminal 300 takes a new image. The number of times that the user can take a new image may be limited or unlimited. As a result, the information processing system 1000 can perform the main registration using an image that satisfies the user.

[0105] On the other hand, if the server device 200 determines that the verification does not match (step S605, NO), the server device 200 ends the process. Note that the server device 200 may transmit a display instruction to the terminal 300 to notify that the verification does not match and the identity verification has failed.

[0106] As described above, this embodiment achieves the same effects as the first and second embodiments. Furthermore, when performing official registration, the terminal 300 photographs the user and transmits the photographed image data to the server device 200 along with the registrant information. The server device 200 compares the biometric information acquired from the received image data with the registered biometric information already registered in the registrant management database. If the comparison is successful and the user's identity is confirmed, the server device 200 registers the registrant information received from the terminal 300 in association with the user's account in the registrant management database. As a result, only the user who has completed provisional registration can complete official registration. Even if someone other than the user obtains the registration information output by the store terminal 100, the other person is prevented from performing official registration. This strengthens security in the member registration process, allowing the information processing system 1000 to reliably acquire user information.

[0107] [Fourth embodiment] This embodiment is a modified example of the third embodiment described above. Note that the same reference numerals as those in the drawings of the third embodiment indicate the same objects. Below, the description of the parts common to the third embodiment will be omitted, and the differences will be described in detail.

[0108] This embodiment differs from the third embodiment in that, during provisional registration in the store membership registration procedure, the server device 200 acquires first face information and iris information as the user's first biometric information from image data received from the store terminal 100. Note that in this embodiment, the first face information refers to a person's face image, and the iris information refers to a person's iris image. Also, this embodiment differs from the third embodiment in that the server device 200 performs multi-factor authentication using the acquired first face information and iris information.

[0109] 15 is a diagram illustrating an example of information stored in a registrant management database according to the present disclosure. Referring to FIG. 15, first registered biometric information and second registered biometric information have been added in place of the registered biometric information stored in the registrant management database according to the second embodiment. Here, the first registered biometric information is a feature generated from a face image of the user, and the second registered biometric information is a feature generated from an iris image of the user.

[0110] The first acquisition unit 202 of the server device 200 acquires first face information and iris information as first biometric information of the user from the store terminal 100. For example, the first acquisition unit 202 receives image data of the user captured by the image capture control unit 103 of the store terminal 100. Then, the first acquisition unit 202 extracts a face image and an iris image of the user from the image data and acquires them as first face information and iris information, respectively.

[0111] The second acquisition unit 207 of the server device 200 acquires the user's registrant information linked to the registration ID from the terminal 300, and also acquires second face information as the user's second biometric information. Note that in this embodiment, the second face information will be described as meaning a person's face image. The second acquisition unit 207 receives image data of the user captured by the imaging control unit 306 of the terminal 300. Then, the second acquisition unit 207 extracts the user's face image from the image data and acquires it as the second face information.

[0112] [System Operation] Next, an example of the operation of the information processing system 1000 according to the fourth embodiment will be described with reference to FIGS.

[0113] If the store terminal 100 determines in step S101 that a transaction has started, then in step S102 the store terminal 100 photographs the customer. At this time, the store terminal 100 may photograph the image data for the server device 200 to extract the customer's face image and the image data for extracting the customer's iris image separately, or may photograph the images as a single image data.

[0114] Next, the store terminal 100 transmits the captured image data to the server device 200 in step S103.

[0115] When the server device 200 receives the image data from the store terminal 100, in step S104, it extracts the user's face image and iris image from the image data, and obtains the extracted face image (face image data) and iris image (iris image data) as the first face information and iris information, respectively.

[0116] Next, in step S105, the server device 200 performs one-to-N matching on the acquired first face information and iris information using the first registered biometric information and second registered biometric information pre-registered in the registrant management database, thereby performing multi-factor authentication.

[0117] The operations from step S106 onward can be the same as those of the third embodiment, and therefore description thereof will be omitted. If the server device 200 determines in step S106 that an account having matching features for the user's first face information and iris information exists in the registrant management database, the server device 200 determines a match (YES). In step S209, the server device 200 associates the generated registration ID with the features generated from the user's first face information and the features generated from the iris information, and registers them in the registrant management database to perform provisional registration. At this time, the server device 200 registers the features generated from the first face information and the features generated from the iris information as first registered biometric information and second registered biometric information, respectively. In step S604, the server device 200 generates features from the acquired second face information and performs one-to-one matching of the generated features with the first registered biometric information in the registrant management database. If the server device 200 determines that the match is found, then in step S509, the server device 200 registers the received registrant information by linking it to the first registered biometric information and second registered biometric information of the account that matched, and performs the main registration.

[0118] As described above, this embodiment achieves the same effects as the first, second, and third embodiments. Furthermore, the server device 200 acquires the user's facial information and iris information from image data received from the store terminal 100 and performs multi-factor authentication using the acquired information. As a result, authentication accuracy is improved, and it is possible to reliably determine whether the user is a registered member. Furthermore, when a user who is not registered in the registrant management database agrees to register as a member of the store, the server device 200 registers features generated from the acquired facial information and iris information in the registrant management database. As a result, the user no longer needs to capture their own iris image using their own terminal or the like. Instead, they can provide their iris information to the server device 200 and have it registered by completing the checkout process at the store. In particular, capturing an iris image typically requires a special imaging device such as an infrared camera. Therefore, this embodiment allows the user to provide an iris image that cannot generally be captured using the terminal 300 (e.g., a smartphone), and the server device 200 can acquire the user's iris information and associate the features generated from the iris information with the registrant information and register them in the registrant management database. Therefore, the user only needs to have the terminal 300, which saves the user the trouble of registering as a member. Furthermore, when a user who has completed the registration and become a member wishes to use a member service that requires identity verification at a store, multi-factor authentication is performed using the user's facial information and iris information, which improves the accuracy of identity verification and strengthens security.

[0119] Next, an example of the hardware configuration of each device constituting the information processing system 1000 will be described with reference to Figures 16 to 18. Note that, since devices with the same name but different reference numerals in Figures 16 to 18 have equivalent functions, detailed description thereof will be omitted in the subsequent drawings.

[0120] [Store terminal hardware configuration] Fig. 16 is a block diagram showing an example of the hardware configuration of the store terminal 100. The store terminal 100 can be configured by an information processing device (so-called a computer), and has the configuration shown in Fig. 16. For example, the store terminal 100 includes a processor 110, a memory 120, a communication interface 130, an image capturing device 140, an input device 150, a display device 160, an output device 170, and the like. The components such as the processor 110 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0121] The processor 110 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 110 may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or other device. The processor 110 executes various programs including an operating system (OS).

[0122] The memory 120 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 120 stores an OS program, application programs, and various data.

[0123] The communication interface 130 is a circuit, module, etc. that communicates with other devices based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), 4G, etc. For example, the communication interface 130 includes a NIC (Network Interface Card), etc.

[0124] The photographing device 140 is, for example, a digital camera that photographs a user standing in front of the store terminal 100. The photographing device 140 may also include an infrared camera that can photograph an iris image of the user.

[0125] The input device 150 is a device that accepts user operations, such as a keyboard, mouse, or touch panel.

[0126] The display device 160 is, for example, a liquid crystal display, and is used to display moving images, still images, characters, and the like.

[0127] The output device 170 is a device that outputs receipts on which the results of the transaction process and registration / introduction information are printed.

[0128] [Server hardware configuration] Fig. 17 is a block diagram showing an example of the hardware configuration of the server device 200. The server device 200 can be configured by an information processing device (so-called a computer), and has the configuration shown in Fig. 17. For example, the server device 200 includes a processor 210, a memory 220, a communication interface 230, and the like. The components such as the processor 210 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0129] [Device hardware configuration] Fig. 18 is a block diagram showing an example of the hardware configuration of the terminal 300. The terminal 300 can be configured by an information processing device (so-called a computer), and has the configuration shown in Fig. 18. For example, the terminal 300 includes a processor 310, a memory 320, a communication interface 330, an image capturing device 340, an input device 350, a display device 360, a reading device 370, and the like. The components such as the processor 310 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0130] The reading device 370 is a device that reads the registration introduction information contained in the medium output by the store terminal 100 and acquires the access information indicated by the registration introduction information. Examples of the medium include paper receipts. The reading device 370 is configured, for example, by a code reader, an image scanner, a contactless IC reader, an OCR (Optical Character Reader) device, etc.

[0131] The functions of the store terminal 100, server device 200, and terminal 300 are realized by various processing modules. In the case of the store terminal 100, for example, the processing modules are realized by the processor 110 executing a program stored in the memory 120. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0132] 16 to 18 are not intended to limit the hardware configuration of the store terminal 100, the server device 200, and the terminal 300. The store terminal 100, the server device 200, and the terminal 300 may include hardware not shown. Furthermore, the number of processors and the like included in each device is not intended to be limited to the examples shown in FIGS. 16 to 18; for example, the store terminal 100 may include multiple processors 110.

[0133] [Variations] The configuration, operation, etc. of the information processing system 1000 described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0134] In the above embodiment, the server device 200 registers features generated from a face image or an iris image of a user in the registrant management database. However, the server device 200 may register a face image or an iris image as biometric information instead of features. In this case, the server device 200 may generate features and perform user matching each time it performs a matching process.

[0135] In the above embodiment, the server device 200 registers the registration ID generated during provisional registration in the registrant management database and collectively identifies users using the registration ID. However, the server device 200 may also generate a new ID (real registration ID) to identify the registrant during formal registration, and manage people who have completed provisional registration but not formal registration separately from people who have completed formal registration. This makes it easier for the person managing the store's membership registration procedures to understand the status of users' registration. In this case, the server device 200 may manage user information linked to the real registration ID in a database separate from the registrant management database, or may register the real registration ID by overwriting a registration ID already registered in the registrant management database when the real registration ID is generated.

[0136] In the above embodiment, the case where the registrant management database is built inside the server device 200 has been described. However, this database may be built on an external database server or the like. That is, some of the functions of the server device 200 may be implemented in another device. Specifically, it is sufficient that the above-described collation unit 203 and the like are implemented in any of the devices included in the system.

[0137] In the above embodiment, the server device 200 transmits an output instruction including the generated registration introduction information to the store terminal 100. However, the server device 200 may transmit the output instruction to the terminal 300 carried by the user. In this case, when the store terminal 100 receives an input from the user agreeing to member registration, it also receives input of the user's contact information (e.g., email address) and transmits the received input to the server device 200. The server device 200 uses the user's email address included in the received input to transmit an output instruction including the generated registration introduction information to the terminal 300. This allows the user to perform official registration as long as they have the terminal 300, thereby preventing the user from being unable to perform official registration due to losing a medium such as a receipt on which the registration introduction information is printed.

[0138] In the above embodiment, the store terminal 100 has been described as printing the registration introduction information on a receipt and outputting it to the user. However, the store terminal 100 may output the registration introduction information to the user by means other than printing it on a receipt. For example, the store terminal 100 may output the registration introduction information instructed to be output by the server device 200 to a screen such as an LCD display of the store terminal 100. In this case, the user reads the registration introduction information displayed on the screen of the store terminal 100 by photographing it with the terminal 300.

[0139] In the fourth embodiment, the second acquisition unit 207 of the server device 200 acquires the registrant information and the second face information, and when a feature quantity generated from the second face information matches the first registered biometric information and identity verification is successful, the server device 200 registers the registrant information in the registrant management database. However, the server device 200 may register the registrant information without performing the above-described identity verification process. That is, the second acquisition unit 207 of the server device 200 may acquire only the registrant information, associate the acquired registrant information with the first registered biometric information and the second registered biometric information, and register the associated information in the registrant management database, thereby performing the main registration. In this case, the first acquisition unit 202 of the server device 200 may acquire only iris information as the user's first biometric information, and the user's iris information may be stored in the registrant management database as registered biometric information. As a result, the user simply inputs his / her own registrant information from the terminal 300 using the registration introduction information, and the registrant information is registered in a linked state with his / her own iris information, completing the member registration procedure. This saves the user the trouble of registering as a member.

[0140] The format of data transmission and reception between each device (for example, the store terminal 100, the server device 200, the terminal 300, etc.) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Biometric information and the like is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.

[0141] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0142] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0143] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. [Appendix 1] a first acquisition means for acquiring first biometric information of a user; an output instruction means for instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; A second acquisition means for acquiring registrant information of the user from the terminal of the user based on an input using the registration introduction information; a registration means for registering the first biometric information and the registrant information in association with each other; A server device comprising: [Appendix 2] the output instruction means instructs output of the registration introduction information when it is determined based on the result of the matching that the biometric information of the user has been registered and the registrant information is not yet registered. 2. The server device according to claim 1. [Appendix 3] a display instruction means for displaying guidance information according to the biometric information of the user and the registration status of the registrant information determined based on the result of the matching; 3. The server device according to claim 2, further comprising: [Appendix 4] when it is determined as a result of the verification that the biometric information of the user is not registered, the display instruction means displays guidance information regarding registration of the biometric information, the output instruction means, when acquiring an input indicating that the user agrees to the registration of the biometric information, instructs the output of the registration introduction information; 4. The server device according to claim 3. [Appendix 5] When the registered user information of the user is identified based on the result of the matching, the display instruction means displays guidance information relating to a benefit linked to the identified registered user information. 5. The server device according to claim 4. [Appendix 6] the output instruction means instructs output of a medium on which the registration introduction information is displayed; 6. A server device according to any one of appendices 1 to 5. [Appendix 7] the second acquisition means further acquires second biometric information of the user from the terminal of the user; When the matching between the first biometric information and the second biometric information is successful, the registration means associates the first biometric information with the registrant information and registers them. 6. A server device according to any one of appendices 1 to 5. [Appendix 8] the first acquisition means acquires first face information and iris information of the user as the first biometric information; the second acquisition means further acquires second face information of the user from the terminal of the user; When the matching between the first face information and the second face information is successful, the registration means associates the iris information with the registrant information and registers them. 6. A server device according to any one of appendices 1 to 5. [Appendix 9] a first acquisition step of acquiring first biometric information of a user; an output instruction step of instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; a second acquisition step of acquiring registrant information of the user from the user's terminal based on input using the registration introduction information; a registration step of linking the first biometric information with the registrant information and registering them; A method for controlling a server device comprising: [Appendix 10] The output instruction step instructs output of the registration introduction information when it is determined based on the result of the matching that the biometric information of the user has been registered and the registrant information is not yet registered. A method for controlling a server device according to Supplementary Note 9. [Appendix 11] a display instruction step of displaying guidance information according to the registration status of the biometric information and the registrant information of the user determined based on the result of the matching; 11. The method for controlling a server device according to claim 10, further comprising: [Appendix 12] the display instruction step, when it is determined as a result of the matching that the biometric information of the user is not registered, displays guidance information regarding registration of the biometric information; the output instruction step instructs output of the registration introduction information when an input indicating consent to registration of the biometric information is obtained from the user; A method for controlling a server device according to claim 11. [Appendix 13] When the registered user information of the user is identified based on the result of the matching, the display instruction step displays guidance information related to a benefit associated with the identified registered user information. A method for controlling a server device according to claim 12. [Appendix 14] The output instruction step instructs output of a medium on which the registration introduction information is displayed. A method for controlling a server device according to any one of Supplementary Notes 9 to 13. [Appendix 15] the second acquisition step further acquires second biometric information of the user from the terminal of the user; the registration step registers the first biometric information and the registrant information in association with each other when the matching between the first biometric information and the second biometric information is successful; A method for controlling a server device according to any one of Supplementary Notes 9 to 13. [Appendix 16] the first acquisition step acquires first face information and iris information of the user as the first biometric information; the second acquiring step further acquires second face information of the user from the terminal of the user; In the registration step, when the matching between the first face information and the second face information is successful, the iris information and the registrant information are linked and registered. A method for controlling a server device according to any one of Supplementary Notes 9 to 13. [Appendix 17] The computer installed in the server device a first acquisition process for acquiring first biometric information of the user; an output instruction process for instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; A second acquisition process for acquiring registrant information of the user from the user's terminal based on input using the registration introduction information; a registration process for registering the first biometric information and the registrant information in association with each other; A program to execute. [Appendix 18] The output instruction process instructs output of the registration introduction information when it is determined based on the result of the matching that the biometric information of the user has been registered and the registrant information is not yet registered. 17. The program described in Appendix 17. [Appendix 19] a display instruction process for displaying guidance information according to the biometric information of the user and the registration status of the registrant information determined based on the result of the matching; 19. The program according to claim 18, further comprising: [Appendix 20] the display instruction process displays guidance information regarding registration of the biometric information when it is determined that the biometric information of the user is not yet registered as a result of the matching; the output instruction process instructs output of the registration introduction information when an input indicating consent to registration of the biometric information is obtained from the user; 19. The program described in Appendix 19. [Appendix 21] When the registered user information of the user is identified based on the result of the matching, the display instruction process displays guidance information related to a benefit associated with the identified registered user information. 20. The program described in Appendix 20. [Appendix 22] The output instruction process instructs output of a medium on which the registration introduction information is displayed. 22. The program according to any one of appendices 17 to 21. [Appendix 23] the second acquisition process further acquires second biometric information of the user from the terminal of the user; When the matching between the first biometric information and the second biometric information is successful, the registration process associates the first biometric information with the registrant information and registers them. 22. The program according to any one of appendices 17 to 21. [Appendix 24] the first acquisition process acquires first face information and iris information of the user as the first biometric information; the second acquisition process further acquires second face information of the user from the terminal of the user; When the matching between the first face information and the second face information is successful, the registration process associates the iris information with the registrant information and registers them. 22. The program according to any one of appendices 17 to 21.

[0144] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to information processing systems that acquire and manage information about users of stores and the like.

[0145] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 17 in the same manner as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 17, but within the scope of each of the above-mentioned embodiments, various hardware, software, various recording means for recording software, or systems may also be made to be dependent on some or all of the configurations described as Supplements.

[0146] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts. [Explanation of symbols]

[0147] 1. Server device 11 First acquisition method 12 Output instruction means 13 Second acquisition method 14 Registration Method 1000 Information Processing Systems NW Network 100 store terminals 101, 201, 301 Communication control unit 102 Accounting Department 103, 306 Imaging control unit 104, 304 Display control unit 105, 303 Input reception section 106 Output section 107, 208, 305 Storage section 110, 210, 310 processors 120, 220, 320 memory 130, 230, 330 communication interface 140, 340 imaging device 150, 350 input device 160, 360 display device 170 Output Device 200 Server device 202 First acquisition part 203 Matching Unit 204 Display instruction section (display instruction means) 205 Registration Department 206 Output instruction section 207 Second Acquisition Department 300 devices 302 Reading control unit 370 Reading Device

Claims

1. a first acquisition means for acquiring first biometric information of a user; an output instruction means for instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; a second acquiring means for acquiring registrant information of the user from the terminal of the user based on an input using the registration introduction information; a registration means for registering the first biometric information and the registrant information in association with each other; A server device comprising:

2. the output instruction means instructs output of the registration introduction information when it is determined based on the result of the matching that the biometric information of the user has been registered and the registrant information is not yet registered. The server device according to claim 1 .

3. a display instruction means for displaying guidance information according to the biometric information of the user and the registration status of the registrant information determined based on the result of the matching; The server device according to claim 2 , further comprising:

4. when it is determined as a result of the verification that the biometric information of the user is not registered, the display instruction means displays guidance information regarding registration of the biometric information, the output instruction means, when acquiring an input indicating that the user agrees to the registration of the biometric information, instructs the output of the registration introduction information; The server device according to claim 3 .

5. When the registered user information of the user is identified based on the result of the matching, the display instruction means displays guidance information relating to a benefit linked to the identified registered user information. The server device according to claim 4.

6. the output instruction means instructs output of a medium on which the registration introduction information is displayed; The server device according to any one of claims 1 to 5.

7. the second acquisition means further acquires second biometric information of the user from the terminal of the user; When the matching between the first biometric information and the second biometric information is successful, the registration means associates the first biometric information with the registrant information and registers them. The server device according to any one of claims 1 to 5.

8. the first acquisition means acquires first face information and iris information of the user as the first biometric information; the second acquisition means further acquires second face information of the user from the terminal of the user; When the matching between the first face information and the second face information is successful, the registration means associates the iris information with the registrant information and registers them. The server device according to any one of claims 1 to 5.

9. a first acquisition step of acquiring first biometric information of a user; an output instruction step of instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; a second acquisition step of acquiring registrant information of the user from the user's terminal based on input using the registration introduction information; a registration step of linking the first biometric information and the registrant information and registering them; A method for controlling a server device comprising:

10. The computer installed in the server device a first acquisition process for acquiring first biometric information of a user; an output instruction process for instructing output of registration introduction information when it is determined that the biometric information of the user is not registered by comparing the first biometric information with pre-registered biometric information; a second acquisition process for acquiring registrant information of the user from the user's terminal based on input using the registration introduction information; a registration process for registering the first biometric information and the registrant information in association with each other; A program to execute.

Images