Information processing device, information processing system, information processing method, and computer program

Abstract

An information processing device 1 comprises: an imaged biometric information acquisition unit 11 that acquires biometric information of a target obtained by imaging the target; a terminal information acquisition unit 12 that acquires, from an information processing terminal possessed by the target, biometric-related information relating to the biometric information of the target, which was acquired by imaging using the information processing terminal; and an authentication unit 13 that authenticates the target by using the biometric information of the target acquired by the imaged biometric information acquisition unit 11 and the biometric-related information of the target acquired by the terminal information acquisition unit 12.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] Patent Document 1 describes a technology that recognizes pre-registered customers, acquires customer identification information including facial data and payment account numbers, tracks customers whose identification information has been acquired in real time at a shopping location, acquires the customer's location, determines whether the customer's location matches the location of a product at the shopping location, and if there is a match, associates the customer with a pick-up or return action for the product, recognizes the pick-up or return action and the product corresponding to the pick-up or return action, creates a shopping list for the customer, and performs checkout based on the shopping list. Patent document 2 describes a technology in which a first processor performs facial authentication on the facial information of a customer extracted from an image acquired by a first interface against the registered facial information of each member registered in a member database, and stores the registered information of the member corresponding to the registered facial information that has been successfully authenticated with the facial information of the customer in the customer database in association with the facial information of the customer, and a second processor performs facial authentication on the facial information of the person to be paid extracted from an image acquired by a second interface against the facial information of the customer stored in the customer database, and performs payment processing using the registered information of the member that has been successfully authenticated with the facial information of the person to be paid. Patent document 3 describes a technology in which, when a check-in operation is performed at a seller's store, the buyer terminal notifies the buyer of newly generated first matching information, and when the check-in operation is performed, the sales support server records second matching information that can identify the first matching information in association with the buyer and provides the buyer's facial photo to the store terminal.When the buyer purchases a product at the store, the store terminal allows the seller to select a facial photo of the buyer, obtains the first matching information from the buyer, and notifies the sales support server of a payment request specifying the buyer whose facial photo was selected and the first matching information.The sales support server then allows electronic payment for the product price if the first matching information specified in the payment request matches the second matching information associated with the buyer specified in the payment request.

[0003] JP-T-2019-530923 A JP-A-2018-101420 A JP-A-2014-099156 A

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing device comprises an image capturing biometric information acquisition means for acquiring biometric information of a target by capturing an image of the target, a terminal information acquisition means for acquiring biometric-related information relating to the target's biometric information from an information processing terminal carried by the target, the biometric information being acquired by capturing an image using the information processing terminal, and an authentication means for authenticating the target using the biometric information of the target acquired by the image capturing biometric information acquisition means and the biometric-related information of the target acquired by the terminal information acquisition means.

[0006] One aspect of the information processing system includes an information processing device corresponding to a participating store that provides a service using user information including the subject's biometric information and payment information, and a management device that is equipped with a user information storage means that stores user information including the subject's biometric information captured on the information processing terminal and the subject's payment information, which is registered from the information processing terminal held by the subject, and a store storage means that stores participating store information related to the participating store, and the management device presents the participating store to the information processing terminal, receives from the information processing terminal a selected store selected by the subject from among the participating stores, and transmits the subject's biometric information to the information processing device corresponding to the selected store.

[0007] One aspect of the information processing method involves acquiring biometric information of a target by photographing the target, acquiring biometric-related information relating to the target's biometric information, which was acquired by photographing the target using an information processing terminal carried by the target, from the information processing terminal, and authenticating the target using the biometric information of the target by photographing the target and the biometric-related information of the target acquired from the information processing terminal.

[0008] One aspect of the recording medium has a computer program recorded on it for causing a computer to execute an information processing method that acquires biometric information of a subject by photographing the subject, acquires biometric-related information relating to the subject's biometric information acquired by photographing the subject using an information processing terminal carried by the subject, and authenticates the subject using the biometric information of the subject by photographing the subject and the biometric-related information of the subject acquired from the information processing terminal.

[0009] FIG. 1 is a block diagram showing the configuration of an information processing device in a first embodiment. FIG. 2 is an external view showing an overview of an information processing system in a second embodiment. FIG. 3 is a block diagram showing the configuration of a store payment support device in the second embodiment. FIG. 4 is a flowchart showing the flow of information processing operations of the store payment support device in the second embodiment. FIG. 5 is a block diagram showing the configuration of a store payment support device in a third embodiment. FIG. 6 is a block diagram showing the configuration of a smartphone in the third embodiment. FIG. 7 is a flowchart showing the flow of information processing operations of the store payment support device in the third embodiment. FIG. 8 is a block diagram showing the configuration of a store payment support device in a fourth embodiment. FIG. 9 is a block diagram showing the configuration of a cloud server in the fourth embodiment. FIG. 10 is a flowchart showing the flow of information processing operations of the information processing system in the fourth embodiment. FIG. 11 is a block diagram showing the configuration of a store payment support device in a fifth embodiment. FIG. 12 is a block diagram showing the configuration of a cloud server in the fifth embodiment. FIG. 13 is a flowchart showing the flow of information processing operations of the information processing system in the fifth embodiment. FIG. 14 is a block diagram showing the configuration of a store payment support device in a sixth embodiment. FIG. 15 is a flowchart showing the flow of information processing operations of the store payment support device in the sixth embodiment. Fig. 16 is a block diagram showing the configuration of a store payment support device in the seventh embodiment. Fig. 17 is a flowchart showing the flow of information processing operation of the store payment support device in the seventh embodiment. Fig. 18 is a flowchart showing the flow of information processing operation of the store payment support device in the seventh embodiment.

[0010] Hereinafter, embodiments of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0011] A first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described below. Hereinafter, the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 1 to which the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [1-1: Configuration of Information Processing Device 1]

[0012] FIG. 1 is a block diagram showing the configuration of an information processing device 1 in the first embodiment. As shown in FIG. 1, the information processing device 1 includes an imaged biometric information acquisition unit 11, a terminal information acquisition unit 12, and a biometric authentication unit 13. The imaged biometric information acquisition unit 11 acquires biometric information of a target by capturing an image of the target. The terminal information acquisition unit 12 acquires biometric-related information relating to the target's biometric information, acquired by capturing an image using an information processing terminal carried by the target, from the information processing terminal. The biometric authentication unit 13 authenticates the target using the target's biometric information acquired by the imaged biometric information acquisition unit 11 and the target's biometric-related information acquired by the terminal information acquisition unit 12. [1-2: Technical Effects of Information Processing Device 1]

[0013] The information processing device 1 in the first embodiment authenticates a subject using information related to biometric information captured by the information processing terminal, and therefore can guarantee that the subject carrying the information processing terminal is the owner of the information processing terminal. The information processing device 1 can easily ensure security. [2: Second Embodiment]

[0014] Next, a second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described. Hereinafter, the second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device to which the second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [2-1: Example of a scene in which the store payment support device 2 is applied]

[0015] The information processing device in this embodiment may be applied to a store T that provides a payment service using biometric authentication. An information processing device to which the second embodiment is applied is referred to as a store payment support device 2. Hereinafter, the store T that provides a payment service using biometric authentication will be simply referred to as "store T."

[0016] 2 is a schematic diagram showing an overview of a situation in which the in-store payment support device 2 in the second embodiment is applied. The in-store payment support device 2 may be used in association with a store T. As shown in FIG. 2, the in-store payment support device 2 can communicate with a camera C installed in the store T and a smartphone SP as an information processing terminal carried by a customer P in the store T.

[0017] The camera C captures an image of the store visitor P and generates biometric information. The camera C may capture an image of the face of the store visitor P. In this case, the camera C may be capable of generating a facial image with sufficient accuracy to be used for facial authentication.

[0018] Camera C may be installed to capture images of objects in a predetermined area within store T. Camera C may be installed to capture, for example, an image of a customer P entering store T. Camera C may be mounted on store payment support device 2.

[0019] The store payment support device 2 can read at least one of biometric information and an access code from the smartphone SP carried by a store visitor P who comes closer than a predetermined distance.

[0020] In order to use a payment service using biometric authentication, a store visitor P registers personal information including biometric information of the store visitor P and payment information to be used for electronic payment in the store payment support device 2 corresponding to the store T where the store visitor P wishes to use the payment service before using the payment service. Alternatively, the store T may use a payment service using biometric authentication provided by a cloud server. In this case, the cloud server registers the store visitor P as a user who will use the payment service using biometric authentication at the store T. The payment information may be bank account information, credit card information, electronic money information, etc.

[0021] A customer P carrying a smartphone SP captures his or her own biometric information using the built-in camera of the smartphone SP and registers it on the smartphone SP. As a result, the owner of the biometric information registered on the smartphone SP becomes the owner of the smartphone SP. The biometric information registered on the smartphone SP may be a facial image. The biometric information registered on the smartphone SP may also be an iris image, a fingerprint image, or the like. The biometric information registered on the smartphone SP may also be features extracted from an image such as a facial image, an authentication image, or a fingerprint image. A person who successfully undergoes biometric authentication with the biometric information captured by the smartphone SP and stored on the smartphone SP is guaranteed to be the genuine owner of the smartphone SP.

[0022] The smartphone SP may be designed so that payment information is registered by operation by the owner of the smartphone SP. The smartphone SP may store registered payment information and user information associated with the registered biometric information. In other words, payment information stored in the smartphone SP in association with biometric information may be treated as authentic information. Note that the biometric information associated with the payment information stored in the smartphone SP may be biometric information captured by a device other than the smartphone SP and acquired by the smartphone SP. In other words, the payment information may be stored in association with biometric information acquired by operation by the owner of the smartphone SP. [2-2: Configuration of store payment support device 2]

[0023] 3 is a block diagram showing the configuration of a store payment support device 2 in the second embodiment. As shown in FIG. 2, the store payment support device 2 includes a calculation device 21 and a storage device 22. The store payment support device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the store payment support device 2 does not necessarily have to include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0024] The arithmetic device 21 includes, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a field programmable gate array (FPGA). The arithmetic device 21 loads a computer program. For example, the arithmetic device 21 may load a computer program stored in the storage device 22. For example, the arithmetic device 21 may load a computer program stored in a computer-readable, non-transitory storage medium using a storage medium reading device (e.g., the input device 24, described later) not shown in the figure that is included in the store payment support device 2. The arithmetic device 21 may acquire (i.e., download or load) the computer program from a device (not shown) located outside the store payment support device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the loaded computer program. As a result, a logical function block for executing the operations to be performed by the store payment support device 2 is realized within the computing device 21. In other words, the computing device 21 can function as a controller for realizing the logical function block for executing the operations (in other words, processing) to be performed by the store payment support device 2.

[0025] FIG. 3 shows an example of logical functional blocks implemented within the computing device 21 to execute information processing operations. As shown in FIG. 2 , the computing device 21 includes an imaged biometric information acquisition unit 211, which is a specific example of the “imaged biometric information acquisition means” described in the appendix, a terminal information acquisition unit 212, which is a specific example of the “terminal information acquisition means” described in the appendix, a biometric authentication unit 213, which is a specific example of the “authentication means” described in the appendix, a user information acquisition unit 214, which is a specific example of the “biometric information acquisition means” described in the appendix, and a user information registration management unit 215, which is a specific example of the “authentication means” described in the appendix. However, any of the user information acquisition unit 214 and the user information registration management unit 215 may not be implemented within the computing device 21. Details of the operations of the imaged biometric information acquisition unit 211, the terminal information acquisition unit 212, the biometric authentication unit 213, the user information acquisition unit 214, and the user information registration management unit 215 will be described later with reference to FIG. 4 .

[0026] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may also store data that the store payment support device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0027] The communication device 23 can communicate with devices external to the store payment support device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus). The store payment support device 2 may communicate with the camera C and smartphone SP via the communication device 23.

[0028] Input device 24 is a device that accepts information input to store payment support device 2 from outside store payment support device 2. For example, input device 24 may include an operation device (e.g., at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of store payment support device 2. For example, input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to store payment support device 2.

[0029] The output device 25 is a device that outputs information to the outside of the store payment support device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. Furthermore, for example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. [2-3: Information Processing Operations Performed by the Store Payment Support Device 2]

[0030] The flow of information processing operations performed by the store payment support device 2 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the information processing operations performed by the store payment support device 2.

[0031] 4, the imaged biometric information acquisition unit 211 acquires biometric information of the store visitor P captured by the camera C (step S20). The imaged biometric information acquisition unit 211 may acquire a facial image of the store visitor P captured by the camera C.

[0032] The terminal information acquisition unit 212 acquires, from the smartphone SP carried by the store visitor P, biometric information relating to the biometric information of the store visitor P captured by the smartphone SP (step S21). The terminal information acquisition unit 212 may acquire the biometric information from the smartphone SP via the communication device 23.

[0033] The biometric-related information may be the biometric information itself. The biometric information is information captured on a smartphone SP carried by a customer P. The biometric-related information may also be biometric information access information for accessing biometric information stored in an external device O including the smartphone SP. The biometric information access information may be information indicating access rights to the biometric information, for example. The external device O including the smartphone SP may be a device that stores user information associated with payment information and biometric information. When the biometric-related information is biometric information access information, the terminal information acquisition unit 212 can present the biometric information access information to the external device O and acquire the corresponding biometric information from the external device O. Furthermore, the external device O including the smartphone SP may have an access code that encodes the biometric information access information.

[0034] The store payment support device 2 may be capable of communicating with a reader R capable of reading information from the smartphone SP via the communication device 23. The reader R may be installed within the store T. In this case, the reader R may be installed in multiple locations within the store T. The terminal information acquisition unit 212 may acquire the biometric information read by the reader R from the smartphone SP from the reader R via the communication device 23. The operation of step S21 may be triggered by an information presentation operation from the smartphone SP. The store visitor P may bring the smartphone SP close to the reader R to have the reader R read the biometric information.

[0035] The reader R may be, for example, an RFID reader. In this case, the reader R may read biometric information as the biometric-related information. The reader R may also be, for example, a code reader. In this case, the reader R may read an access code as the biometric-related information.

[0036] The biometric authentication unit 213 biometrically authenticates the store visitor P using the biometric information acquired in step S20 and the biometric information acquired in step S21 (step S22). The user information acquisition unit 214 determines whether the biometric authentication by the biometric authentication unit 213 was successful (step S23).

[0037] If the biometric authentication by the biometric authentication unit 213 is successful (step S23: Yes), the user information acquisition unit 214 acquires user information from the external device O (step S24). The user information includes biometric information and payment information. The biometric information is information used for authentication, and the payment information is information used for payment. If the authentication using the biometric information is successful, payment can be performed using the payment information.

[0038] The user information acquisition unit 214 may acquire user information from the smartphone SP. The user information acquisition unit 214 may be able to acquire user information from the smartphone SP by presenting personal identification information indicating that biometric authentication by the biometric authentication unit 213 has been successful. The personal identification information may be information that ensures that the user is using his or her own smartphone SP.

[0039] Alternatively, the user information acquisition unit 214 may acquire user information from an external device O other than the smartphone SP. The user information acquisition unit 214 may be able to acquire user information from the external device O by presenting personal identification information indicating that biometric authentication by the biometric authentication unit 213 has been successful and biometric information access information.

[0040] The user information registration management unit 215 registers the acquired user information in the user information storage unit 221 (step S25). After step S25, the user can use the biometric authentication payment service at the store T. [2-4: Technical Effects of Store Payment Support Device 2]

[0041] The store payment support device 2 in the second embodiment authenticates the customer P using information related to biometric information captured by the smartphone SP, thereby ensuring that the customer P carrying the smartphone SP is the actual owner of the smartphone SP. The store payment support device 2 can easily provide a payment service using biometric authentication while ensuring security. [3: Third Embodiment]

[0042] Next, a third embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described. Hereinafter, the third embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using a store payment support device 3 to which the third embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied.

[0043] 5 is a block diagram showing the configuration of the store payment support device 3 in the third embodiment. The store payment support device 3 in the third embodiment differs from the store payment support device 2 in the second embodiment in the operation of the terminal information acquisition unit 312 and the user information acquisition unit 314. [3-1: Configuration of the smartphone SP]

[0044] Fig. 6 is a block diagram showing the configuration of a smartphone SP in the third embodiment. As shown in Fig. 6, the smartphone SP includes a built-in camera SPC, a calculation unit SP1, a storage device SP2, and a communication device SP3. The smartphone SP may further include an input device SP4 and an output device SP5. The built-in camera SPC, the calculation unit SP1, the storage device SP2, the communication device SP3, the input device SP4, and the output device SP5 may be connected via a data bus SP6.

[0045] The arithmetic device SP1 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device SP1 loads a computer program. For example, the arithmetic device SP1 may load a computer program stored in a storage device SP2. For example, the arithmetic device SP1 may load a computer program stored in a computer-readable, non-transitory storage medium using a storage medium reading device (e.g., an input device SP4, described later) not shown in the figure that is included in the smartphone SP. The arithmetic device SP1 may acquire (i.e., download or load) the computer program from a device (not shown) located outside the smartphone SP via a communication device SP3 (or another communication device). The arithmetic device SP1 executes the loaded computer program. As a result, logical functional blocks for executing operations to be performed by the smartphone SP are realized within the arithmetic device SP1. In other words, the arithmetic device SP1 can function as a controller for realizing logical functional blocks for executing operations (in other words, processes) to be performed by the smartphone SP.

[0046] The storage device SP2 can store desired data. For example, the storage device SP2 may temporarily store a computer program executed by the arithmetic device SP1. The storage device SP2 may temporarily store data temporarily used by the arithmetic device SP1 when the arithmetic device SP1 is executing a computer program. The storage device SP2 may store data to be stored long-term by the smartphone SP. The storage device SP2 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device SP2 may include a non-temporary recording medium. A user information storage unit SP22 is implemented within the storage device SP2. The user information storage unit SP22 stores biometric information, payment information, and biometric-related information captured by the camera C.

[0047] The communication device SP3 can communicate with devices external to the smartphone SP via a communication network (not shown). The communication device SP3 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0048] The input device SP4 is a device that accepts information input to the smartphone SP from outside the smartphone SP. For example, the input device SP4 may include an operation device (e.g., at least one of a keyboard, a mouse, and a touch panel) that can be operated by the customer P. For example, the input device SP4 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the smartphone SP.

[0049] The output device SP5 is a device that outputs information to the outside of the smartphone SP. For example, the output device SP5 may output information as an image. In other words, the output device SP5 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device SP5 may output information as sound. In other words, the output device SP5 may include an audio device (a so-called speaker) that can output sound. [3-2: Information Processing Operation Performed by the Store Payment Support Device 3]

[0050] The flow of information processing operations performed by the store payment support device 3 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the information processing operations performed by the store payment support device 3.

[0051] 7, the captured biometric information acquisition unit 211 acquires biometric information of a store visitor P captured by a camera C (step S20). When biometric information is presented from a smartphone SP (step S30), the terminal information acquisition unit 312 acquires the biometric information from the smartphone SP (step S31).

[0052] The biometric authentication unit 213 biometrically authenticates the store visitor P using the biometric information acquired in step S20 and the biometric information acquired in step S31 (step S22). If the authentication in step S22 is successful (step S23: Yes), the user information acquisition unit 314 requests user information from the smartphone SP (step S32).

[0053] When the smartphone SP receives the request for user information and outputs the user information (step S33), the user information acquisition unit 314 acquires the user information (step S34). The user information registration management unit 215 registers the acquired user information in the user information storage unit 221 (step S25). [3-3: Technical Effects of the Store Payment Support Device 3]

[0054] The store payment support device 3 in the third embodiment performs authentication using biometric information of the store visitor P captured by the smartphone SP and acquired from the smartphone SP, thereby ensuring the identity of the store visitor P. The store payment support device 3 can easily provide a payment service using biometric authentication while ensuring security. [4: Fourth Embodiment]

[0055] Next, a fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fourth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing system SYS4 to which the fourth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. The information processing system SYS4 includes a store payment support device 4 and a cloud server 100 as a management device.

[0056] 8 is a block diagram showing the configuration of the store payment support device 4 in the fourth embodiment. The store payment support device 4 in the fourth embodiment differs from the store payment support device 2 in the second embodiment and the store payment support device 3 in the third embodiment in the operation of the terminal information acquisition unit 412 and the user information acquisition unit 414.

[0057] As shown in FIG. 8 , the store payment support device 4 operates while communicating with a camera C, a smartphone SP, and a cloud server 100. The cloud server 100 is an authorized organization that is permitted to handle user information, including biometric information and payment information. The cloud server 100 stores user information, including biometric information and payment information, as well as at least one of biometric information access information and an access code as acquired information. The cloud server 100 can provide biometric information when at least one of the biometric information access information and the access code is presented.

[0058] At least one of the biometric information access information and the access code stored in the smartphone SP and the cloud server 100 may be information assigned to the smartphone SP by the cloud server 100 when the smartphone SP registers user information in the cloud server 100. In this case, the cloud server 100 transmits at least one of the biometric information access information and the access code to the smartphone SP. Alternatively, the biometric information access information may be information generated by the smartphone SP when the smartphone SP registers user information in the cloud server 100. In this case, the smartphone SP transmits at least one of the biometric information access information and the access code to the cloud server 100.

[0059] Store T is an institution that is permitted to use the user information handled by cloud server 100 if the owner of the user information permits it. [4-1: Configuration of cloud server 100]

[0060] 9 is a block diagram showing the configuration of the cloud server 100. As shown in FIG. 9, the cloud server 100 includes an arithmetic device 1001, a storage device 1002, and a communication device 1003. The cloud server 100 may further include an input device 1004 and an output device 1005. The arithmetic device 1001, the storage device 1002, the communication device 1003, the input device 1004, and the output device 1005 may be connected via a data bus 1006.

[0061] The arithmetic device 1001 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 1001 loads a computer program. For example, the arithmetic device 1001 may load a computer program stored in the storage device 1002. For example, the arithmetic device 1001 may load a computer program stored in a computer-readable, non-transitory storage medium using a storage medium reading device (e.g., an input device SP4 described later) not shown in the figure that is provided in the cloud server 100. The arithmetic device 1001 may acquire (i.e., download or load) the computer program from a device (not shown) located outside the cloud server 100 via the communication device 1003 (or another communication device). The arithmetic device 1001 executes the loaded computer program. As a result, logical function blocks for executing the operations to be performed by the cloud server 100 are realized within the arithmetic device SP1. In other words, the arithmetic device 1001 can function as a controller for realizing logical function blocks for executing the operations (in other words, processing) to be performed by the cloud server 100.

[0062] The storage device 1002 can store desired data. For example, the storage device 1002 may temporarily store a computer program executed by the arithmetic device 1001. The storage device 1002 may temporarily store data that the arithmetic device 1001 temporarily uses when the arithmetic device 1001 is executing a computer program. The storage device 1002 may store data that the cloud server 100 stores long-term. The storage device 1002 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 1002 may include a non-transitory recording medium. A user information storage unit 10023 and a store information storage unit 10024 are implemented within the storage device 1002.

[0063] The user information storage unit 10023 stores, for each user, user information including biometric information and payment information, and at least one of biometric information access information and an access code, in association with each other. The user information storage unit 10023 stores user information including biometric information and payment information provided from a smartphone SP carried by the user, and at least one of biometric information access information and an access code.

[0064] The store information storage unit 10024 stores information indicating stores T that perform payments using biometric authentication. When a request for providing at least one of biometric information and user information is made, the store information storage unit 10024 stores information indicating stores T that can respond to the request.

[0065] The communication device 1003 is capable of communicating with devices external to the cloud server 100 via a communication network (not shown). The communication device 1003 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0066] The input device 1004 is a device that accepts information input to the smartphone SP from outside the cloud server 100. The output device 1005 is a device that outputs information to outside the cloud server 100. [4-2: Information Processing Operation Performed by the Information Processing System SYS4]

[0067] The flow of the information processing operation performed by the information processing system SYS4 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the information processing operation performed by the information processing system SYS4.

[0068] As shown in FIG. 10, the captured biometric information acquisition unit 211 acquires biometric information of a customer P captured by a camera C (step S20).

[0069] When the smartphone SP presents at least one of the biometric information access information and the access code (step S40), the terminal information acquisition unit 412 presents at least one of the biometric information access information and the access code to the cloud server 100 and requests the transmission of the biometric information (step S41).

[0070] When the cloud server 100 transmits the biometric information, the terminal information acquisition unit 412 acquires the biometric information (step S43). The biometric authentication unit 213 performs biometric authentication of the store visitor P using the biometric information acquired in step S20 and the biometric information acquired in step S43 (step S22). The user information acquisition unit 414 determines whether the biometric authentication by the biometric authentication unit 213 was successful (step S23).

[0071] If the biometric authentication by the biometric authentication unit 213 is successful (step S23: Yes), the user information acquisition unit 414 presents the biometric information access information, the access code, or both, and the personal identification information to the cloud server 100 to request user information (step S44). When the cloud server 100 transmits the user information (step S45), the user information acquisition unit 414 acquires the user information (step S46). The user information registration management unit 215 registers the acquired user information in the user information storage unit 221 (step S25).

[0072] In step S44, the user information acquisition unit 414 may request the user information by presenting at least one of the biometric information access information and the access code, and the personal identification information to the smartphone SP, and in step S46, the user information acquisition unit 414 may acquire the user information transmitted by the smartphone SP. [4-3: Technical Effects of the Information Processing System SYS4]

[0073] The information processing system SYS4 in the fourth embodiment performs authentication using biometric information of the store visitor P captured by the smartphone SP and obtained from the cloud server 100, thereby ensuring the identity of the store visitor P. The store payment support device 4 can easily provide a payment service using biometric authentication while ensuring security. [5: Fifth Embodiment]

[0074] Next, a fifth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fifth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing system SYS5 to which the fifth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. The information processing system SYS5 includes a store payment support device 5 and a cloud server 500.

[0075] In each of the above embodiments, the store T was able to acquire user information when it was able to acquire biometric information directly from the smartphone SP within the store T. In the present embodiment, the store T may also be able to acquire user information by indirectly acquiring biometric information via the cloud server 500.

[0076] FIG. 11 is a block diagram showing the configuration of a store payment support device 5 in the fifth embodiment. The store payment support device 5 in the fifth embodiment differs from the store payment support device 2 in the second embodiment to the store payment support device 4 in the fourth embodiment in the operation of an imaged biometric information acquisition unit 511, a terminal information acquisition unit 512, a biometric authentication unit 513, and a user information acquisition unit 514. In addition, the store payment support device 5 in the fifth embodiment operates while communicating information with a cloud server 500. [5-1: Configuration of Cloud Server 500]

[0077] As shown in FIG. 12 , the cloud server 500 in the fifth embodiment includes a computing device 1001, a storage device 1002, and a communication device 1003, similar to the cloud server 100 in the fourth embodiment. Furthermore, the cloud server 500 in the fifth embodiment may include an input device 1004 and an output device 1005, similar to the cloud server 100 in the fourth embodiment. However, the store payment support device 7 does not need to include at least one of the input device 1004 and the output device 1005. The cloud server 500 in the fifth embodiment differs from the cloud server 100 in the fourth embodiment in that a selection information presentation unit 50016 is further implemented within the computing device 1001. Other features of the cloud server 500 may be the same as those of the cloud server 100 in the fourth embodiment. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping features. [5-2: Information Processing Operation Performed by Information Processing System SYS5]

[0078] The flow of the information processing operation performed by the information processing system SYS5 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the information processing operation performed by the information processing system SYS5.

[0079] 13 , the selection information presentation unit 50016 presents selectable stores T on the smartphone SP (step S50). The selection information presentation unit 50016 may display the selectable stores T on a display provided on the smartphone SP. The store visitor P may select the store T they wish to use by operating the smartphone SP.

[0080] The smartphone SP transmits information indicating the selected store T to the cloud server 500 (step S51). Note that there may be a time lag between steps S50 and S51. For example, the store visitor P may operate the smartphone SP to select the store T when he or she decides to use the store T. Alternatively, the store visitor P may select the store T when he or she wants to use a payment service using biometric authentication at the store T he or she has entered.

[0081] The cloud server 500 transmits the biometric information of the store visitor P to the store T selected by the store visitor P in accordance with the information received from the smartphone SP (step S52). The terminal information acquisition unit 512 acquires the biometric information of the store visitor P captured by the smartphone SP via the cloud server 500 (step S53).

[0082] The captured biometric information acquisition unit 511 acquires the biometric information of the store visitor P captured by the camera C (step S54). The biometric authentication unit 513 performs biometric authentication of the store visitor P using the biometric information acquired in step S53 and the biometric information acquired in step S54 (step S55). Note that while FIG. 12 illustrates an example in which the transmitted biometric information is received (step S53) and then the captured biometric information is acquired by the camera C (step S54), the order of these operations may be reversed. For example, the operation of acquiring the biometric information captured by the camera C in step S54 may be performed when the store visitor P enters the store. The operation of acquiring the biometric information captured by the camera C may be performed before the biometric information is acquired via the cloud server 500 in step S53.

[0083] The user information acquisition unit 514 determines whether the biometric authentication by the biometric authentication unit 513 is successful (step S23). If the biometric authentication by the biometric authentication unit 513 is successful (step S23: Yes), the user information acquisition unit 514 presents personal identification information to the cloud server 500 and requests user information (step S56).

[0084] When the cloud server 500 transmits the user information (step S57), the user information acquisition unit 514 acquires the user information (step S58). The user information registration management unit 215 registers the acquired user information in the user information storage unit 221 (step S25).

[0085] In this embodiment, the store visitor P may be able to select multiple stores T. In this case, in step S52, the cloud server 500 may transmit biometric information to the selected multiple stores T. Furthermore, if a request for user information is received from a store payment support device 5 corresponding to any of the multiple stores T selected at the same time (step S56), the cloud server 500 may transmit the user information to the selected multiple stores T in step S57. The user information may be registered in the store payment support device 5 corresponding to the selected store T, and the user may be able to use a payment service using biometric authentication at the corresponding store T.

[0086] Furthermore, the store clerk P may be able to select a store T by specifying a region. In this case, a store T located in the specified region may be processed as the store T selected by the store clerk P. The region specified by the store clerk P may be, for example, near the store clerk P's place of residence. The region specified by the store clerk P may also be near the store clerk P's place of work. The region specified by the store clerk P may also be a region that the store clerk P uses temporarily, such as a travel destination.

[0087] Furthermore, the selection information presentation unit 50016 may provide the smartphone SP with information about the store T desired by the store visitor P, which is stored in the store information storage unit 10024, in response to a request from the smartphone SP. The store T desired by the store visitor P may be, for example, a store T located within a predetermined range including the location of the store T. Furthermore, the store T desired by the store visitor P may be, for example, a store T located within a predetermined range including the location specified by the store T.

[0088] Furthermore, the store visitor P may be able to collectively select stores T that have the same attribute, such as using the same trade name. The cloud server 500 may manage stores T for each attribute, and the store visitor P may be able to select a store T for each attribute.

[0089] Furthermore, the visitor P may be able to restrict the use of the user information for the selected store T. The case where the use of the user information is restricted will be described in another embodiment.

[0090] In any of the above cases, the selection information presentation unit 50016 may provide the smartphone SP with an interface that allows the customer P to easily perform selection operations. [5-3: Technical Effects of the Information Processing System SYS5]

[0091] The information processing system SYS5 in the fifth embodiment can notify the store visitor P of the store T where the biometric authentication payment service is available. This allows the information processing system SYS5 to easily allow the store visitor P to use the biometric authentication payment service. [6: Sixth Embodiment]

[0092] Next, a sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the sixth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing system SYS6 to which the sixth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. The information processing system SYS6 includes a store payment support device 6 and a cloud server 100. [6-1: Configuration of the store payment support device 6]

[0093] As shown in FIG. 14 , the store payment support device 6 in the sixth embodiment includes a calculation device 21, a storage device 22, and a communication device 23, similar to the store payment support device 2 in the second embodiment to the store payment support device 5 in the fifth embodiment. Furthermore, the store payment support device 6 in the sixth embodiment may include an input device 24 and an output device 25, similar to the store payment support device 2 in the second embodiment to the store payment support device 5 in the fifth embodiment. However, the store payment support device 6 does not necessarily include at least one of the input device 24 and the output device 25. The store payment support device 6 in the sixth embodiment differs from the store payment support device 2 in the second embodiment to the store payment support device 5 in the fifth embodiment in that the calculation device 21 further includes a tracking unit 617, a user determination unit 618, a payment management unit 619, a gate control unit 620, and a terminal control unit 622, and the storage device 22 further includes a temporary user storage unit 624. The gate control unit 620 controls the opening and closing of the gate of the gate device G. The gate device G may be installed at the entrance and exit of the store T, and may be controlled to open when a subject is entering the store T, and may be controlled to open when a subject is leaving the store T.

[0094] Other features of the store payment support device 6 may be the same as at least one other feature of the store payment support device 2 in the second embodiment to the store payment support device 5 in the fifth embodiment. Also, the cloud server 100 may be the same as the cloud server 100 in the fourth embodiment. Therefore, below, differences from the already-described embodiments will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [6-2: Information processing operations performed by the information processing system SYS6]

[0095] The information processing operation performed by the information processing system SYS6 will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the information processing operation performed by the information processing system SYS6.

[0096] 15 , when the tracking unit 617 detects a new target of tracking, a store entrant P (step S60: Yes), the tracking unit 617 starts tracking the store entrant P. The tracking unit 617 may detect a target of entering the store when the gate device G is controlled to be opened.

[0097] The imaged biometric information acquisition unit 211 acquires biometric information of the store visitor P captured by the camera C (step S61). That is, the imaged biometric information acquisition unit 211 acquires biometric information of the store visitor. The tracking unit 617 of the store visitor P may track the store visitor P using the biometric information of the store visitor P.

[0098] The user determination unit 618 determines whether or not the store visitor P is registered as a user using the biometric information of the store visitor P captured by the camera C (step S62). The user determination unit 618 may determine whether or not the store visitor P is registered as a user using the biometric information registered in the user information storage unit 621 and the biometric information of the store visitor P captured by the camera C. The user determination unit 618 may determine whether or not the store visitor P is registered as a user using, for example, a biometric authentication engine used by the biometric authentication unit 213.

[0099] If the customer P is registered as a user (step S62: Yes), the process proceeds to step S70. In this case, the terminal control unit 622 controls the smartphone SP carried by the user to vibrate and / or output sound.

[0100] If the store visitor P is not registered as a user (step S62: No), the user determination unit 618 assigns a temporary ID to the store visitor P (step S63). The user determination unit 618 registers the store visitor P's biometric information and the temporary ID assigned to the store visitor P in association with each other in the temporary user storage unit 624.

[0101] The terminal information acquisition unit 212 determines whether the smartphone SP carried by the store visitor P has presented biometric information (step S64a). If the smartphone SP has presented biometric information (step S64a: Yes), the terminal information acquisition unit 212 acquires biometric information from the external device O (step S65a). If the smartphone SP has presented biometric information, the terminal information acquisition unit 212 acquires the biometric information from the smartphone SP. If the smartphone SP has presented biometric information access information, the terminal information acquisition unit 212 presents the biometric information access information to the cloud server 100 and acquires the biometric information from the cloud server 100.

[0102] The biometric authentication unit 213 biometrically authenticates the store visitor P using the biometric information registered in the temporary user storage unit 624 and the biometric information acquired in step S65. If the biometric authentication is successful (step S66: Yes), the user information acquisition unit 214 acquires the user information (step S67). If the biometric-related information presented in step S64a is biometric information, the user information acquisition unit 214 may acquire the user information from the smartphone SP. Alternatively, if the biometric-related information presented in step S64a is biometric information access information, the user information acquisition unit 214 may acquire the user information from the cloud server 100. The user information registration management unit 215 registers the user information in the user information storage unit 621 (step S68). At this time, the terminal control unit 622 may send information indicating that the user has been registered as a user to the smartphone SP carried by the user. At this time, management of the store visitor P using a temporary ID may be switched to management of the user using user information. Furthermore, the user determination unit 618 may delete the registered biometric information and temporary ID of the user from the temporary user storage unit 624 .

[0103] If the biometric authentication is not successful (step S66: No), the image capturing biometric information acquisition unit 211 may have the camera C capture an image of the store entrant P to acquire new biometric information, and the biometric authentication unit 213 may use the biometric information to biometrically authenticate the store entrant P (step S69).

[0104] The tracking unit 617 may track which products users pick up and purchase within the store T. The tracking unit 617 may track users and products while associating them with each other.

[0105] The tracking unit 617 determines whether the user is about to leave the store T (step S70). The tracking unit 617 may determine that the user is about to leave the store T when the user approaches the gate device G by a predetermined distance or more.

[0106] If the user is about to leave store T (step S70: Yes), the payment management unit 619 uses the user information to pay for the products the user wishes to purchase using the payment method indicated in the user's payment information (step S71). Once payment is complete, the gate control unit 620 controls the gate device G to open (step S72). When the user leaves store T, the tracking unit 617 ends tracking of the user.

[0107] If the smartphone SP does not present any biometric information (step S64a: No), the process proceeds to step S73. In this case, the customer P is not a user, and the temporary ID remains associated with the customer P.

[0108] The tracking unit 617 determines whether the store visitor P is about to leave the store T (step S73). The tracking unit 617 may determine that the user is about to leave the store T when the store visitor P approaches the gate device G by a predetermined distance or more. If the store visitor P is about to leave the store T (step S73: Yes), the payment management unit 619 determines whether the store visitor P has made payment for the products he or she wishes to purchase (step S74). If the store visitor P has made payment for the products he or she wishes to purchase, the tracking unit 617 may add a flag indicating that payment has been completed to the information of the store visitor P in the temporary user storage unit 624, and the payment management unit 619 may be able to determine whether the store visitor P has made payment for the products he or she wishes to purchase by referring to the temporary user storage unit 624.

[0109] The payment performed by the customer P may be a so-called self-payment. The customer P may make the payment by operating a so-called self-checkout. The self-checkout may support various payment methods such as cash payment, credit card payment, electronic money payment, and code payment.

[0110] If the store visitor P has completed payment for the products he or she wishes to purchase (step S74: Yes), the gate control unit 620 controls the gate device G to open (step S72). The tracking unit 617 ends tracking of the store visitor P when the store visitor P leaves the store T. The user determination unit 618 may delete the registered biometric information and temporary ID of the store visitor P from the temporary user storage unit 624.

[0111] If the customer P has not yet completed payment for the product he or she wishes to purchase (step S74: No), the output device 25 may, for example, display an image or output a sound to prompt the customer P to complete payment. [6-3: Technical Effects of the Information Processing System SYS6]

[0112] The information processing system SYS6 in the sixth embodiment manages products picked up by a store visitor P in association with the store visitor P, and can complete payment for the associated and managed products when the store visitor P leaves the store T. If the store visitor P is a user of a payment service using biometric authentication, the store payment support device 6 can complete payment for the products picked up by the user using the payment service using biometric authentication when the store visitor P leaves the store T. The store payment support device 6 can manage store visitor P who is not a user of the payment service using biometric authentication and who is assigned a temporary ID through one-to-one authentication using biometric information. Because it can manage whether or not a store visitor P with a temporary ID has completed payment through one-to-one authentication, even store visitor P who is not a user can shop at the store T.

[0113] When a customer P enters the store T, the store payment support device 6 notifies the customer P that he or she is a user, allowing the user to use the payment service with peace of mind. The store payment support device 6 notifies the customer P that he or she is a user by vibrating the smartphone SP or by outputting a sound, so the user can recognize that the payment service is available without having to look at the smartphone SP. Therefore, the user can shop at the store T without removing the smartphone SP, wallet, etc. from a bag, etc.

[0114] Furthermore, when a customer P is registered as a user, the store payment support device 6 notifies the customer P of this fact, so that the customer P can shop using the payment service with peace of mind. [7: Seventh embodiment]

[0115] Next, a seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the seventh embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing system SYS7 to which the seventh embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. The information processing system SYS7 includes a store payment support device 7 and a cloud server 500.

[0116] FIG. 16 is a block diagram showing the configuration of a store payment support device 7 in the seventh embodiment. The store payment support device 7 in the seventh embodiment differs from the store payment support device 6 in the sixth embodiment in the operation of a terminal information acquisition unit 712, a user information acquisition unit 714, and a user information registration and management unit 715. Furthermore, the cloud server 500 may be the same as the cloud server 500 in the fifth embodiment. [7-1: Information processing operations performed by the information processing system SYS7]

[0117] The information processing operation performed by the information processing system SYS7 will be described with reference to Fig. 17 and Fig. 18. Fig. 17 and Fig. 18 are flowcharts showing the flow of the information processing operation performed by the information processing system SYS7.

[0118] The seventh embodiment differs from the sixth embodiment in that the store visitor P is registered as a user in response to the store visitor P selecting the store T. The operation in the seventh embodiment differs from the operation in the sixth embodiment in the operation from when the store visitor P wishes to become a user to when the smartphone SP acquires the captured biometric information.

[0119] 17, after the user determination unit 618 assigns a temporary ID to the store visitor P in step S63, the store visitor P selects a store T by operating the smartphone SP, and the smartphone SP transmits information indicating the selected store T to the cloud server 500 (step S64b). The cloud server 500 transmits the biometric information of the store visitor P to the store T selected by the store visitor P in accordance with the information indicating the store T received from the smartphone SP, and the terminal information acquisition unit 712 acquires the biometric information of the store visitor P captured by the smartphone SP (step S65b). [When restricting the use of user information]

[0120] The store visitor P may be able to restrict the use of the user information for the selected store T. For example, the store T in the travel destination selected by the store visitor P may restrict the use of the user information so that the user information can be used only once. For example, for a certain store T, the period during which the user information can be used may be limited.

[0121] In step S64b, the smartphone SP may be able to transmit restriction information regarding restrictions on the use of the user information to the cloud server 500, in association with the store T. In this case, in step S67, the user information acquisition unit 714 acquires the user information associated with the restriction information.

[0122] 18(a), the user information registration management unit 715 determines whether the user information is associated with restriction information regarding restrictions on the use of the user information (step S75). If restriction information is associated with the user information (step S75: Yes), the user information registration management unit 715 associates the restriction information with the user information and registers the restriction information in the user information storage unit 721 (step S76).

[0123] When performing at least one of the user determination operation in step S62 shown in Fig. 17 and the payment operation in step S71, the user information registration management unit 715 determines whether the corresponding user information is available due to the restrictions indicated by the restriction information registered in step S76 (step S77), as shown in Fig. 18(b). If the user information is unavailable (step S77: Yes), the user information registration management unit 715 deletes the user information of the user (step S78). [7-2: Technical Effects of the Information Processing System SYS7]

[0124] The information processing system SYS7 in the seventh embodiment can limit the use of user information, thereby improving convenience for users. [8: Supplementary Note]

[0125] The following supplementary notes are further disclosed with respect to the above-described embodiments. [Supplementary Note 1] An information processing device comprising: an imaged biometric information acquisition means for acquiring biometric information of an object by capturing an image of the object; a terminal information acquisition means for acquiring, from an information processing terminal carried by the object, biometric-related information relating to the biometric information of the object acquired by capturing an image using the information processing terminal; and an authentication means for authenticating the object using the biometric information of the object acquired by the imaged biometric information acquisition means and the biometric-related information of the object acquired by the terminal information acquisition means. [Supplementary Note 2] The information processing device according to Supplementary Note 1 further comprises: a user information acquisition means for, if authentication by the authentication means is successful, acquiring user information including the biometric information of the object and payment information of the object from an external device different from the information processing device; and a user registration means for registering the object as a user of a service using the user information. [Supplementary Note 3] The information processing device according to Supplementary Note 1 or 2, wherein the terminal information acquisition means acquires the biometric information captured by the information processing terminal directly from the information processing terminal or via a device external to the information processing terminal. [Supplementary Note 4] The information processing device according to Supplementary Note 1 or 2, wherein the terminal information acquisition means acquires, directly from the information processing terminal or via a device external to the information processing terminal, acquisition information for acquiring the biometric information from an external device in which the biometric information captured by the information processing terminal is registered, the external device being a device external to the information processing device. [Supplementary Note 5] An information processing system including: an information processing device corresponding to a participating store that provides a service using user information including the biometric information of the target and payment information of the target; and a management device including: user information storage means that stores user information including the biometric information of the target captured by the information processing terminal and the payment information of the target, which is registered from an information processing terminal held by the target; and store storage means that stores participating store information related to the participating store, wherein the management device presents the participating store to the information processing terminal, receives from the information processing terminal a selected store selected by the target from among the participating stores, and transmits the biometric information of the target to the information processing device corresponding to the selected store.[Supplementary Note 6] The information processing device according to Supplementary Note 2, further comprising: a tracking means for tracking the target; a user determination means for determining whether a store resident who is a new tracking target of the tracking means is registered as the user using biometric information obtained by capturing an image of the store resident; and the terminal information acquisition means for acquiring the biometric information from an information processing terminal carried by the store resident who is not the user, and if authentication by the authentication means is successful, the user registration means registers the store resident as the user. [Supplementary Note 7] The information processing device according to Supplementary Note 6, further comprising: a gate control means for opening a gate when the user being tracked by the tracking means leaves the store corresponding to the information processing device. [Supplementary Note 8] The information processing device according to Supplementary Note 6, further comprising: a gate control means for opening a gate when the store resident who is not the user being tracked by the tracking means makes a payment at the store corresponding to the information processing device. [Supplementary Note 9] The information processing device according to Supplementary Note 6, wherein the authentication means further comprises terminal control means for authenticating a target entering a store and, if the target is a user, controlling an information processing terminal carried by the user to vibrate and / or output sound. [Supplementary Note 10] The information processing device according to Supplementary Note 6, further comprising terminal control means for, if the user registration means registers a target who is not the user as the user, sending information indicating that the target has been registered as the user to a terminal device carried by the user. [Supplementary Note 11] An information processing method, comprising: acquiring biometric information of an image of the target obtained by capturing an image of the target; acquiring biometric-related information related to the biometric information of the target obtained by capturing an image of the target using an information processing terminal carried by the target; and authenticating the target using the biometric information of the image of the target and the biometric-related information of the target acquired from the information processing terminal.[Supplementary Note 12] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method of: acquiring biometric information of a target obtained by capturing an image of the target; acquiring biometric-related information relating to the biometric information of the target obtained by capturing an image of the target using an information processing terminal carried by the target, from the information processing terminal; and authenticating the target using the biometric information of the target obtained by capturing an image of the target and the biometric-related information of the target acquired from the information processing terminal.

[0126] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0127] 1 Information processing device 11, 211, 511 Imaged biometric information acquisition unit 12, 212, 312, 412, 512, 712 Terminal information acquisition unit 13, 213, 513 Biometric authentication unit 2, 3, 4, 5, 6, 7 Store payment support device T Store SP Smartphone P Store visitor C Camera O External device 214, 314, 414, 514, 714 User information acquisition unit 215, 615, 715 User information registration management unit SYS4, SYS5, SYS6, SYS7 Information processing system 100, 500 Cloud server 221, 621, 721, SP22, 10023 User information storage unit 10024 Store information storage unit 50016 Selection information presentation unit 617 Tracking unit 618 User determination unit 619 Payment management unit 620 Gate control unit 622 Terminal control unit 624 Temporary user storage unit G Gate device

Claims

1. an imaged biometric information acquiring means for acquiring first biometric information of a target by imaging the target; a terminal information acquiring means for acquiring, from an information processing terminal carried by the subject, biological-related information relating to the subject's second biological information, the biological-related information being acquired by imaging the subject using the information processing terminal; an authentication means for authenticating the target using the first biometric information acquired by the imaged biometric information acquisition means and the biometric-related information of the target acquired by the terminal information acquisition means; An information processing device comprising:

2. a user information acquisition means for acquiring user information including the target biometric information and the target payment information from an external device different from the information processing device when authentication by the authentication means is successful; a user registration means for registering the target as a user of a service using the user information; Further provided with The information processing device according to claim 1 .

3. The terminal information acquisition means acquires the second biometric information directly from the information processing terminal or via an external device of the information processing terminal.

3. The information processing device according to claim 1 or 2.

4. The terminal information acquisition means acquires acquisition information for acquiring the second biometric information from an external device in which the second biometric information is registered, directly from the information processing terminal or via an external device of the information processing terminal. The external device is a device external to the information processing device.

3. The information processing device according to claim 1 or 2.

5. a tracking means for tracking the object; a user determination means for determining whether or not a store resident who is a new target for tracking by the tracking means is registered as a user using biometric information acquired by capturing an image of the store resident; The terminal information acquisition means acquires the biometric information from an information processing terminal carried by a store visitor who is not the user, and if the authentication by the authentication means is successful, the user registration means registers the store visitor as the user. The information processing device according to claim 2 .

6. The information processing device further includes a gate control unit that controls a gate to open when the user being tracked by the tracking unit leaves the store corresponding to the information processing device. The information processing device according to claim 5 .

7. The information processing device further includes a gate control means for controlling the gate to open when a person entering the store who is not the user tracked by the tracking means makes a payment at the store corresponding to the information processing device. The information processing device according to claim 5 .

8. an information processing device corresponding to a participating store that provides a service using user information including the target biometric information and the target payment information; and a user information storage means for storing user information including second biometric information of the subject, which is registered from an information processing terminal carried by the subject and captured by the information processing terminal, and payment information of the subject; a management device including a store storage means for storing participating store information relating to the participating store; The management device The participating store is presented on the information processing terminal, receiving from the information processing terminal a selected store selected by the target from among the participating stores; The second biometric information is transmitted to the information processing device corresponding to the selected store. Information processing system.

9. acquiring first biometric information of a subject obtained by imaging the subject; acquiring, from an information processing terminal carried by the subject, biological-related information relating to the subject's second biological information, the biological-related information being acquired by imaging the subject using the information processing terminal; authenticating the target using the first biometric information of the target and the biometric-related information of the target acquired from the information processing terminal; A computer-implemented information processing method.

10. On the computer, acquiring first biometric information of a subject obtained by imaging the subject; acquiring, from an information processing terminal carried by the subject, biological-related information relating to the subject's second biological information, the biological-related information being acquired by imaging the subject using the information processing terminal; authenticating the target using the first biometric information of the target and the biometric-related information of the target acquired from the information processing terminal; A computer program for executing an information processing method.