Information processing device, settlement system, settlement method, and settlement program

By adjusting camera exposure and performing biometric authentication before product registration completion, the information processing device streamlines payment processing, reducing wait times and enhancing customer experience.

JP2024169673AActive Publication Date: 2024-12-05NEC CORP +1
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024166378
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2020-03-09
Filing Date
2024-09-25
Publication Date
2024-12-05
Estimated Expiration
2041-01-22

AI Technical Summary

Technical Problem

Biometric authentication for payment processing can take a long time, causing customer inconvenience and extending wait times, even after capturing an image suitable for face recognition.

Method used

An information processing device that adjusts camera exposure during product registration, acquires customer images before completion, performs biometric authentication, and requests payment upon successful authentication after product registration is finished.

Benefits of technology

This approach reduces the overall payment processing time by completing biometric authentication and payment processing efficiently.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169673000001_ABST
    Figure 2024169673000001_ABST
Patent Text Reader

Abstract

To provide an information processing device and the like capable of shortening a time required for settlement processing when a customer performs settlement processing using a biological image.SOLUTION: An information processing device comprises: an exposure adjustment unit which adjusts exposure of a camera when first commodity registration by a customer is started; an image acquisition unit which acquires an image of the customer captured by the camera before registration completion of one or more commodities after the adjustment of the exposure; an authentication unit which receives biological authentication results based on the image of the customer captured before the registration completion of the one or more commodities; and a settlement unit which requests the settlement of the one or more commodities using settlement information of the customer after the registration completion of the commodity when biological authentication is successful in the results.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device or the like for allowing a customer to execute a payment. [Background technology]

[0002] In a payment process after purchasing a product, there is a technology that performs biometric authentication using a customer's biometric data, such as face data or iris data, and executes the payment after confirming that the biometric authentication was successful. In biometric authentication, a biometric image of the customer is photographed at the time of payment, etc., and biometric image data is extracted, and it is determined whether the extracted biometric image data matches the biometric image data of the customer that has been registered in advance. If they match, the payment process is performed using the customer's payment information that has been registered in advance. If they do not match, the payment process is not performed.

[0003] If the biometric authentication process takes a long time, the time to complete the payment may be extended, and the customer may have to wait. This causes a psychological burden to the customer who is making the payment, and further extends the waiting time of other customers waiting in line at the cash register.

[0004] Patent Document 1 discloses a technique for adjusting the amount of exposure in order to capture a face image suitable for face recognition processing, in order to facilitate face recognition processing. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2007-251558 A Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, the amount of exposure is adjusted when capturing a facial image, but even if this adjustment results in capturing an image suitable for facial recognition, the customer must continue to wait in front of the image processing device for the time required for the subsequent facial recognition process, i.e., from the start of facial recognition to its completion.

[0007] The present disclosure has been made in consideration of the above-mentioned problems, and one of its objectives is to provide an information processing device, etc. that can shorten the time required for payment processing when a customer performs payment processing using a biometric image. [Means for solving the problem]

[0008] In view of the above problems, an information processing device according to a first aspect of the present disclosure includes: an exposure adjustment means for adjusting the exposure of the camera when the customer starts to register a first product; an image acquisition means for acquiring an image of the customer captured by the camera after the exposure adjustment means adjusts the exposure and before the registration of one or more products is completed; an authentication means for receiving a result of biometric authentication based on an image of the customer captured before the registration of the one or more products is completed; If the biometric authentication is successful, after the registration of the product is completed, a payment means for requesting payment for the one or more products using the customer's payment information. It is equipped with.

[0009] A payment system according to a second aspect of the present disclosure includes: The information processing device described above; At least one camera that captures an image of a customer and transmits the image to the information processing device; a biometric authentication server that performs biometric authentication in response to a request from the information processing device; a payment server that provides payment information related to the customer to the information processing device when the biometric authentication is successful, and executes the payment upon receiving the payment request from the information processing device; It is equipped with.

[0010] A payment method according to a third aspect of the present disclosure includes: The computer When customers start registering their first products, the camera exposure is adjusted, acquiring an image of the customer captured by the camera after adjusting the exposure and prior to completion of registration of one or more products; receiving a biometric authentication result based on an image of the customer taken prior to completing registration of the one or more products; If the biometric authentication is successful, payment for the one or more products is requested using the customer's payment information after the product registration is completed.

[0011] A payment program according to a fourth aspect of the present disclosure includes: When customers start registering their first products, the camera exposure is adjusted, acquiring an image of the customer captured by the camera after adjusting the exposure and prior to completion of registration of one or more products; receiving a biometric authentication result based on an image of the customer captured prior to completion of registration of the one or more products; If the biometric authentication is successful, the computer is caused to request payment for the one or more products using the customer's payment information after the product registration is completed. This is what the computer does.

[0012] The payment program may be stored in a computer-readable and writable non-transitory recording medium. Effect of the Invention

[0013] According to the present disclosure, it is possible to provide an information processing device etc. that can reduce the time required for a payment process when a customer performs a payment process using a biometric image. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing a configuration example of a payment system according to a first embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing a configuration example of an information processing device according to a first embodiment of the present disclosure. [Diagram 3]5 is a flowchart showing an example of the operation of the information processing device according to the first embodiment. [Figure 4] FIG. 13 is a diagram showing an example of a registration preparation screen. [Diagram 5] FIG. 13 is an example of a product list screen. [Figure 6] FIG. 13 is an example of a payment screen. [Figure 7] FIG. 13 is a diagram showing an example of a screen during face authentication. [Figure 8] 13 is a diagram showing an example of a face authentication failure screen. [Figure 9] FIG. 13 is an example of a payment completion screen. [Figure 10] FIG. 11 is a block diagram showing a configuration example of a payment system according to a second embodiment of the present disclosure. [Figure 11] FIG. 11 is a block diagram showing an example configuration of an information processing device according to a second embodiment of the present disclosure. [Figure 12] 10 is a flowchart showing an example of the operation of the information processing device according to the second embodiment. [Figure 13] FIG. 13 is a block diagram showing an example configuration of an information processing device according to a third embodiment of the present disclosure. [Figure 14] FIG. 2 is a block diagram showing an example of the configuration of an information processing device to which each embodiment can be applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Each embodiment will be described in detail below with reference to the drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. However, the drawings only show the schematic configuration of the embodiment of the present disclosure. Furthermore, the embodiment of the present disclosure described below is merely an example, and can be modified as appropriate within the scope of the same essence.

[0016] First Embodiment (Payment system) Hereinafter, a payment system 100 according to a first embodiment of the present disclosure will be described with reference to the drawings.

[0017] Fig. 1 is a diagram showing a schematic configuration of a payment system 100. As shown in Fig. 1, the payment system 100 includes an information processing device 1, a biometric authentication server 5, and a payment server 7. The information processing device 1, the biometric authentication server 5, and the payment server 7 are connected to each other so as to be able to communicate with each other via a communication line such as the Internet or an intranet. At least one of the biometric authentication server 5 and the payment server 7 may be included in the information processing device 1.

[0018] The information processing device 1 is a device for registering and paying for products that a customer wishes to purchase. A display unit 2, a camera 3, and a scanner 4 are connected to the information processing device 1. The information processing device 1 may be equipped with any of the display unit 2, the camera 3, and the scanner 4. The display unit 2 is an output device such as a monitor or display. The display unit 2 may be an input / output device such as a touch panel. The camera 3 is a photographing device for taking and capturing images of the customer. The scanner 4 is a reader for reading information (e.g., barcodes) of the products that the customer purchases. Products read by the scanner 4 are added to a product list that is subject to payment, and the display unit 2 displays the product list. The product list is generated by the information processing device 1.

[0019] The biometric authentication server 5 is a server that performs biometric authentication using a biometric image of a customer when making a payment in the information processing device 1. Biometric authentication refers to, for example, face authentication, iris authentication, and the like. In the following description, the case of face authentication will be mainly described. The biometric authentication server 5 includes a biometric authentication storage unit 6, and in the biometric authentication storage unit 6, feature data of a previously acquired biometric image of a customer (a face image of the customer) is stored in association with information identifying the customer (such as a customer ID (identifier) ​​and a customer name). The biometric authentication server 5 receives a request for biometric authentication from the information processing device 1 together with a face image of the customer captured by the camera 3, and determines whether the feature data extracted from the face image of the customer matches the feature data stored in the biometric authentication storage unit 6. If the matching rate is equal to or higher than a predetermined rate (for example, 97%), it may be determined that the two data match, that is, the authentication is successful. The biometric authentication server 5 transmits the determination result to the information processing device 1. If the determination result is a successful authentication, the biometric authentication server 5 transmits information identifying the customer together with a notice of the successful authentication to the information processing device 1. If the authentication is successful, the information processing device 1 transmits information for identifying the customer received from the biometric authentication server 5 to the payment server 7, and requests it to transmit payment information of the customer.

[0020] The payment server 7 is a server that executes payment processing, and includes a payment storage unit 8. The payment storage unit 8 stores, for each customer, for example, a customer ID, a customer name, a thumbnail image of the customer's face, credit card information, and bank account information (hereinafter, these will be referred to as payment information). The customer IDs used in the biometric authentication server 5 and the payment server 7 do not need to be the same, but it is preferable that they are linked so that they can be supported. When the payment server 7 receives a request to send the payment information of the customer from the information processing device 1 together with information that identifies the customer, the payment server 7 searches the payment information of the customer from the payment storage unit 8 based on the information that identifies the customer, and transmits the searched payment information of the customer to the information processing device 1. The information processing device 1 that receives the payment information of the customer from the payment server 7 displays the payment information of the customer and the total price of the products in the product list on the display unit 2, and requests the customer to approve the payment. Approval is determined by detecting a touch on an approval button displayed on the display unit 2 or a press on a physical button (not shown) provided on the information processing device 1.

[0021] When approval is obtained from the customer, the information processing device 1 transmits information identifying the customer and requests the payment server 7 to settle the total amount of the products to a settlement institution (such as a credit card company or bank) included in the customer's payment information. Upon receiving the request, the payment server 7 executes the settlement. The payment server 7 transmits the execution result of the settlement to the information processing device 1, and the information processing device 1 displays the execution result on the display unit 2.

[0022] The information processing device 1 according to this embodiment is triggered by the camera 3 starting to capture an image of the customer (for example, a facial image) when the customer starts initial product registration (in this embodiment, registration by reading the product using the scanner 4). This is because capturing an image suitable for authentication is important to perform biometric authentication quickly and reliably. The information processing device 1 causes the camera 3 to capture an image at least once between the start of product registration and completion of product registration to obtain an image suitable for authentication. Furthermore, the information processing device 1 transmits the acquired image to the biometric authentication server 5 to request biometric authentication, and receives a result of successful authentication.

[0023] Registration is considered complete when an input indicating that the customer has registered all the products he or she plans to purchase is received. An input indicating that the customer has registered all the products he or she plans to purchase is, for example, an input for moving to the payment process, such as pressing a subtotal button or a registration completion button.

[0024] As described above, the information processing device 1 receives the result of biometric authentication based on an image of the customer captured before the registration of one or more products is completed, so that the biometric authentication of the customer can be completed before moving to the payment process, i.e., at the time of product registration, thereby shortening the time required for the entire payment process. The information processing device 1 will be described in detail below.

[0025] (Information processing device) As shown in FIG. 2, the information processing device 1 includes an exposure adjustment unit 11, an image acquisition unit 12, an authentication unit 13, a payment information acquisition unit 14, a payment unit 15, a display control unit 16, and a registration unit 17.

[0026] The exposure adjustment unit 11 adjusts the exposure value of the camera 3 when capturing an image of a customer. The exposure value is determined from an aperture value and a shutter speed value (time value). When the exposure adjustment unit 11 receives a request for exposure adjustment from the image acquisition unit 12, it adjusts the exposure value so that the luminance value of the image falls within a predetermined range suitable for biometric authentication. Note that since the luminance value of the image changes depending on the ambient light (indoor lighting or sunlight entering from outside), the amount of exposure required to keep the luminance value of the image within an appropriate range changes frequently. When the exposure adjustment of the camera 3 is completed, the exposure adjustment unit 11 notifies the image acquisition unit 12 of the completion.

[0027] The image acquisition unit 12 acquires an image of the customer captured by the camera 3 before the registration of one or more products is completed. The image acquisition unit 12 requests the exposure adjustment unit 11 to adjust the exposure when the first registration of multiple products is started, that is, when the first product is read by the scanner 4, and acquires an image of the customer when the image acquisition unit 12 receives a notification of the completion of the exposure adjustment. The product registration by the scanner 4 may be performed by the customer himself or by a store clerk. The camera 3 is preferably disposed facing the position where the customer should be when the product is read by the scanner 4. The image acquisition unit 12 determines whether the overall brightness value of the acquired image is within a predetermined threshold, and if it is within the predetermined threshold, transmits the acquired image of the customer to the authentication unit 13.

[0028] When the authentication unit 13 acquires an image of a customer from the image acquisition unit 12, it requests the biometric authentication server 5 to perform biometric authentication on the customer included in the image. If the brightness value of the image is within a predetermined threshold, the authentication unit 13 may identify an area in the image to be used for biometric authentication (a face area in the case of face authentication) and then request biometric authentication along with the identified area. The authentication unit 13 receives the result of the biometric authentication from the biometric authentication server 5. If the result of the biometric authentication is successful, the authentication unit 13 receives a notification of successful authentication and information identifying the customer. The authentication unit 13 transmits a notification of successful authentication and information identifying the customer to the payment information acquisition unit 14.

[0029] When the payment information acquisition unit 14 receives a notification of successful authentication and information identifying the customer from the authentication unit 13, it acquires payment information of the customer from the payment server 7. Specifically, the payment information acquisition unit 14 sends the information identifying the customer to the payment server 7 and requests it to send payment information linked to the information identifying the customer. Upon receiving the request, the payment information acquisition unit 14 acquires the payment information linked to the information identifying the customer from the payment server 7. The payment information acquisition unit 14 transmits the acquired payment information to the payment unit 15.

[0030] After completing the registration of products, that is, after receiving an input indicating that the customer has registered all products that he plans to purchase (for example, by pressing the subtotal button or the registration completion button), the payment unit 15 uses the acquired payment information to request the payment server 7 to make a payment for one or more products purchased by the customer. Specifically, when the payment unit 15 receives payment information from the payment information acquisition unit 14, it transmits the payment information and the total amount of the products purchased by the customer to the payment server 7 and requests payment. When the payment unit 15 receives a notification of the completion of payment from the payment server 7, it outputs information including the notification to the display control unit 16.

[0031] The display control unit 16 controls the information to be displayed on the display unit 2. When the display control unit 16 receives a request to display predetermined information from the authentication unit 13, the settlement unit 15, the registration unit 17, or the like, it displays a screen (for example, the screens shown in FIGS. 4 to 9) presenting the information on the display unit 2.

[0032] The registration unit 17 converts the product-related information (such as barcode information) read by the scanner 4 into product information (such as product ID, product name, product price), and adds it to a product list. The registration unit 17 includes a master (not shown) for storing product information. When the registration unit 17 requests the display control unit 16 to present a product list, the display control unit 16 displays the product list on the display unit 2.

[0033] (Operation of information processing device) The operation of the information processing device 1 will be described with reference to the flowchart shown in Fig. 3. As preparation for product registration, the display control unit 16 may display a registration preparation screen shown in Fig. 4 on the display unit 2.

[0034] In step S101, when the registration unit 17 of the information processing device 1 detects the registration of information about a product (reading of a barcode or the like), the registration unit 17 notifies the image acquisition unit 12 that registration has started. Note that even after the notification, when the registration unit 17 receives product registration from a customer via the scanner 4, it continues to execute the process of registering information about the product and adding the read product information to the product list (product list screen; see FIG. 5).

[0035] In step S102, upon receiving the notification that reading has started, image acquisition unit 12 requests exposure adjustment unit 11 to adjust the exposure of camera 3. Exposure adjustment unit 11 executes exposure adjustment of camera 3, and when the exposure adjustment is completed, notifies image acquisition unit 12 of the completion.

[0036] In step S103, when the image acquisition unit 12 receives a notification from the exposure adjustment unit 11 that the exposure adjustment of the camera 3 is complete, the image acquisition unit 12 acquires an image of the customer taken by the camera 3 after the exposure adjustment. The image acquisition unit 12 judges whether the luminance value of the acquired image is within a predetermined range. The image acquisition unit 12 may further judge whether the authentication target part is in an appropriate position (for example, in the case of face authentication, whether the face is near the center of the image) and whether the image is in focus. Based on the judgment result, the image acquisition unit 12 decides whether to request biometric authentication with the acquired image. If the image acquisition unit 12 decides to request biometric authentication with the acquired image (YES in step S104), it transmits the image to the authentication unit 13 and proceeds to the process of step S105. If the image acquisition unit 12 decides not to request biometric authentication with the acquired image (NO in step S104), it returns the process to step S102.

[0037] In step S105, the authentication unit 13, which has received the image from the image acquisition unit 12, executes face authentication processing. Specifically, the authentication unit 13 requests the biometric authentication server 5 to perform biometric authentication for the customer included in the image. After the biometric authentication server 5 executes authentication, the authentication unit 13 receives the authentication result from the biometric authentication server 5. If the result of the biometric authentication is successful (YES in step S106), the authentication unit 13 receives a notification of successful authentication and information identifying the customer. Thereafter, the authentication unit 13 transmits a notification of successful authentication and information identifying the customer to the payment information acquisition unit 14. If the result of the biometric authentication is unsuccessful (NO in step S106), the authentication unit 13 returns the process to step S102. That is, if the authentication is unsuccessful, the image acquisition unit 12 acquires an image again between immediately after receiving the result and the completion of product registration.

[0038] In step S107, the payment information acquisition unit 14 performs a payment information acquisition process. Specifically, when the payment information acquisition unit 14 receives a notification of authentication success and information identifying the customer from the authentication unit 13, it requests the payment server 7 to transmit the payment information of the customer linked to the information identifying the customer, and acquires the payment information from the payment server 7 as a result of the request.

[0039] In step S108, the payment information acquisition unit 14 passes the payment information to the display control unit 16. The registration unit 17 passes the total payment amount for the products to the display control unit 16. If the registration of product information started in step S101 is completed by the time the payment information is passed, the display control unit 16 generates a payment screen (see FIG. 6) based on the payment information and the total payment amount, and displays it on the display unit 2. In FIG. 6, the card number is the payment information acquired in step S107.

[0040] If the customer purchases a small number of items (for example, one item) and the payment information has not been acquired by the time the product information is registered, the display control unit 16 may present a face authentication in progress screen (see FIG. 7) on the display unit 2, which includes the total payment amount and a notification that face authentication processing is in progress, and ask the customer to wait until the payment information has been acquired.

[0041] If the facial authentication continues to be unsuccessful and acquisition of payment information is not completed by the time registration of product information is completed, the authentication unit 13 notifies the display control unit 16 of the failure of facial authentication, and the display control unit 16 may display a facial authentication failure screen (see FIG. 8) including the fact that facial authentication was unsuccessful on the display unit 2. When the display control unit 16 detects that the customer has tapped "Re-authenticate" or the like on the facial authentication failure screen, the display control unit 16 may return the process to step S102. When the display control unit 16 detects that the customer has tapped "Cancel" or the like on the facial authentication failure screen, the display control unit 16 may end the process of this flow.

[0042] In step S109, when the customer inputs "Payment Confirmation" on the payment screen (see FIG. 6) by tapping on the display unit 2, the process proceeds to the payment process in step S110. When the customer inputs "Cancel" on the payment screen (see FIG. 6) by tapping on the display unit 2, the process of this flow ends.

[0043] In step S110, the payment unit 15 performs payment processing. Specifically, the payment unit 15 receives the payment information from the payment information acquisition unit 14, transmits the payment information and the total amount of the products purchased by the customer to the payment server 7, and requests payment. When the payment unit 15 receives a notification of payment completion from the payment server 7, it requests the display control unit 16 to display information including the notification on the display unit 2. Having received the request, the display control unit 16 displays a payment completion screen (see FIG. 9) including the notification of payment completion on the display unit 2.

[0044] This completes the operation of the information processing device 1.

[0045] In the above operation, face authentication is applied as the biometric authentication, but other biometric authentication based on image analysis, such as iris authentication, may also be applied.

[0046] (Effects of the first embodiment) According to the first embodiment of the present disclosure, when a customer performs a payment process using a biometric image, the time required for the payment process can be shortened. This is because the image acquisition unit 12 acquires an image of the customer captured before the product registration is completed, the authentication unit 13 requests biometric authentication using the acquired image and receives the result of the biometric authentication, the payment information acquisition unit 14 acquires the payment information of the customer if the result of the biometric authentication is successful, and the payment unit 15 requests payment for the product using the payment information after the product registration is completed. As a result of the above, the biometric authentication process before the payment can be quickly and reliably performed, and the time required for the entire payment process can be shortened.

[0047] <Second embodiment> (Payment system) In the first embodiment of the present disclosure, the exposure adjustment unit 11 starts exposure processing with the registration of product information as a trigger. However, since the brightness value of an image changes depending on the ambient light (indoor lighting or sunlight entering from outside), the exposure amount for making the image have an appropriate brightness value changes frequently. For example, the amount of light used for indoor lighting may be different in the morning, afternoon, and evening, and sunlight changes with the passage of time and changes in weather. By adjusting the exposure amount in advance according to the change in brightness around the camera 3, when a customer starts to register a product, the time required for exposure adjustment for making the image of the customer have an appropriate brightness value for biometric authentication can be shortened. As a result, the time required for biometric authentication processing and further the entire payment processing can be shortened. Below, a payment system 200 according to the second embodiment will be described.

[0048] Fig. 10 is a diagram showing a schematic configuration of a payment system 200 according to the second embodiment. As shown in Fig. 10, the payment system 200 includes an information processing device 20, a biometric authentication server 5, and a payment server 7. The information processing device 20 is a device for registering and paying for products that a customer wishes to purchase. A display unit 2, a camera 3, and a scanner 4 are connected to the information processing device 20. The information processing device 20 may include any one of the display unit 2, the camera 3, and the scanner 4.

[0049] As shown in FIG. 11, the information processing device 20 includes an exposure adjustment unit 11a, an image acquisition unit 12a, an authentication unit 13, a payment information acquisition unit 14, a payment unit 15, a display control unit 16, and a registration unit 17.

[0050] Before the customer starts registering the product, the exposure adjustment unit 11a adjusts the amount of exposure in accordance with the change in brightness around the camera 3. The exposure adjustment unit 11a adjusts the amount of exposure so that the brightness value of the image falls within a predetermined range of values ​​suitable for biometric authentication.

[0051] The exposure adjustment unit 11a may adjust the exposure at a predetermined interval. For example, the exposure adjustment unit 11a may adjust the exposure of the location photographed by the camera 3 every 10 seconds.

[0052] The exposure adjustment unit 11a may adjust the exposure when it detects a change in the ambient light. For example, the exposure adjustment unit 11a may adjust the exposure when it detects a change in the amount of light of indoor lighting or a change in the amount of sunlight incident thereon.

[0053] In any of the above cases, since it is easier to adjust the exposure amount if there is an object (subject) for exposure adjustment in the location photographed by camera 3, photographing and exposure adjustment may be performed when a person who could be the subject passes by the location photographed by camera 3.

[0054] The exposure adjustment section 11a has almost the same functions as the exposure adjustment section 11 according to the first embodiment, except for the timing of the exposure adjustment.

[0055] Image acquisition unit 12a acquires an image of the customer captured by camera 3 before the product registration is completed. The image of the customer captured at this time has had its exposure adjusted. Image acquisition unit 12 acquires an image of the customer from camera 3 when the first registration of a plurality of products is started, that is, when the first product is read by scanner 4, which is a trigger. Image acquisition unit 12 transmits the acquired image of the customer to authentication unit 13.

[0056] Other than the above, the second embodiment is the same as the first embodiment (see Figs. 1 and 2).

[0057] (Operation of information processing device) The operation of the information processing device 20 will be described with reference to the flowchart shown in Fig. 12. As preparation for product registration, the display control unit 16 may display on the display unit 2 a registration preparation screen shown in Fig. 4.

[0058] In step S201, the exposure adjustment unit 11a of the information processing device 20 adjusts the exposure of the camera 3 in advance. The exposure adjustment unit 11a adjusts the amount of exposure in advance in accordance with a change in luminance around the camera 3 before the customer starts registering the product. The exposure adjustment unit 11a may adjust the exposure at predetermined intervals. The exposure adjustment unit 11a may also adjust the exposure when a change in the environmental light is detected. Since it is easier to adjust the amount of exposure when a subject is present in the location where the camera 3 is photographing, photographing and exposure adjustment may be performed when the subject passes by the location where the camera 3 is photographing.

[0059] In step S202, when the start of registration of product information (reading of the code) is detected via the scanner 4 (YES in step S202), the registration unit 17 starts the product information registration process (step S203). Furthermore, the image acquisition unit 12a acquires an image of the customer captured by the camera 3 before the product registration is completed (step S204). The exposure of the image of the customer acquired at this time has been adjusted by the exposure adjustment unit 11a. The image acquisition unit 12a transmits the acquired image of the customer to the authentication unit 13.

[0060] The operations in steps S205 to S212 below are similar to those in steps S104 to S111 in the first embodiment.

[0061] (Effects of the second embodiment) According to the second embodiment of the present disclosure, in addition to the effects of the first embodiment, when a customer performs a payment process using a biometric image, the time required for the payment process can be further shortened. The reason is that the exposure adjustment unit 11a performs exposure adjustment in advance, the image acquisition unit 12a acquires an image of the customer with exposure adjustment taken before the product registration is completed, the authentication unit 13 requests biometric authentication using the acquired image and receives the result of the biometric authentication, the payment information acquisition unit 14 acquires the payment information of the customer if the result of the biometric authentication is successful, and the payment unit 15 requests payment for the product using the payment information after the product registration is completed. By performing exposure adjustment in advance as described above, the time required for image acquisition can be shortened, the biometric authentication process before payment can be executed more quickly and reliably, and the time required for the entire payment process can be shortened.

[0062] <Third embodiment> An information processing device 30 according to a third embodiment of the present disclosure will be described with reference to Fig. 13. The information processing device 30 is an example of a minimum configuration of the information processing devices 1 and 20 in the first and second embodiments.

[0063] The information processing device 30 includes an authentication unit 31 and a payment unit 32. The authentication unit 31 receives a result of biometric authentication based on an image of the customer captured before the registration of one or more products is completed. If the result shows that the biometric authentication is successful, the payment unit 32 requests payment for the one or more products using the payment information of the customer after the registration of the products is completed.

[0064] According to the third embodiment of the present disclosure, when a customer performs a payment process using a biometric image, the time required for the payment process can be shortened. The reason is that when the authentication unit 31 receives a result of biometric authentication based on an image of the customer captured before the product registration is completed, if the biometric authentication is successful, the payment unit 32 requests payment for the one or more products using the payment information of the customer after the product registration is completed.

[0065] (Computer Equipment) In each embodiment of the present disclosure described above, some or all of the components of the information processing device, biometric authentication server, and payment server (hereinafter, referred to as the information processing device of the present disclosure, etc.) shown in Figures 1, 2, 10, 11, 13, etc. can be realized using any combination of a computer (information processing) device 500 and a program as shown in Figure 14. The computer device 500 includes, as an example, the following configuration.

[0066] CPU501 ROM502 RAM503 A storage device 505 for storing programs 504 and other data A drive device 507 for reading and writing data from the recording medium 506 A communication interface 508 for connecting to a communication network 509 Input / output interface 510 for inputting and outputting data Bus 511 connecting each component Each component in each embodiment of the information processing device etc. of the present disclosure is realized by the CPU 501 acquiring and executing a program 504 that realizes these functions. The program 504 that realizes the function of each component of the information processing device etc. of the present disclosure is stored in advance in the storage device 505 or the RAM 503, for example, and is read by the CPU 501 as necessary. The program 504 may be supplied to the CPU 501 via the communication network 509, or may be stored in advance in the recording medium 506, and the drive device 507 may read the program and supply it to the CPU 501.

[0067] There are various variations in the method of implementing each device. For example, the information processing device of the present disclosure may be implemented by any combination of a separate computer device and a program for each component. In addition, multiple components included in the information processing device of the present disclosure may be implemented by any combination of a single computer device 500 and a program.

[0068] In addition, some or all of the components of the information processing device and the like disclosed herein may be realized by other general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus.

[0069] Some or all of the components of the information processing device and the like disclosed herein may be realized by a combination of the above-mentioned circuits and programs.

[0070] When some or all of the components of the information processing device of the present disclosure are realized by a plurality of computer devices, circuits, etc., the plurality of computer devices, circuits, etc. may be centrally arranged or distributed. For example, the computer devices, circuits, etc. may be realized as a client-server system, a cloud computing system, etc., in a form in which each is connected via a communication network.

[0071] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. [Appendix 1] an authentication means for receiving a result of biometric authentication based on an image of the customer captured prior to completion of registration of one or more products; If the biometric authentication is successful, after the registration of the product is completed, a payment means for requesting payment for the one or more products using the customer's payment information. An information processing device comprising: [Appendix 2] and an image acquisition means for acquiring an image of the customer taken before the registration of the one or more products is completed. 2. An information processing device according to claim 1. [Appendix 3] The image acquisition means acquires the image at a timing when registration of the one or more products is started. 3. An information processing device according to claim 2. [Appendix 4] If the result of the biometric authentication received by the authentication means is authentication failure, the image acquisition means acquires the image during the period from receiving the result to completing the registration. 4. The information processing device according to claim 2 or 3. [Appendix 5] The image acquisition means determines whether a luminance value of the acquired image is within a predetermined range, When the result of the determination is that the area is within the predetermined range, the authentication means specifies an area in the image to be used for the biometric authentication. An information processing device according to any one of Supplementary Note 2 to Supplementary Note 4. [Appendix 6] An exposure adjustment means for adjusting the exposure of the camera when capturing the image is further provided, The image acquisition means acquires the image after the exposure adjustment means adjusts the exposure. An information processing device according to any one of Supplementary Note 2 to Supplementary Note 5. [Appendix 7] The exposure adjustment means performs the adjustment at predetermined intervals. 7. The information processing device according to claim 6. [Appendix 8] An information processing device according to any one of Supplementary Note 1 to Supplementary Note 7; At least one camera that captures an image of a customer and transmits the image to the information processing device; a biometric authentication server that performs biometric authentication in response to a request from the information processing device; a payment server that provides payment information about the customer to the information processing device if the biometric authentication is successful, and executes the payment upon receiving a payment request from the information processing device; A payment system comprising: [Appendix 9] receiving a biometric authentication result based on an image of the customer captured prior to completing registration of the one or more products; If the biometric authentication is successful, after the registration of the product is completed, payment for the one or more products is requested using the customer's payment information. A payment method comprising: [Appendix 10] receiving a biometric authentication result based on an image of the customer captured prior to completing registration of the one or more products; If the biometric authentication is successful, after the registration of the product is completed, payment for the one or more products is requested using the customer's payment information. A payment program that makes this possible on a computer. [Appendix 11] The exposure adjustment means performs the adjustment when a change in the environmental light is detected. 7. The information processing device according to claim 6. [Appendix 12] The exposure adjustment means performs the adjustment when an object for exposure adjustment is detected. 7. The information processing device according to claim 6.

[0072] Although the present invention has been described with reference to the present embodiment, the present invention is not limited to the above embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0073] This application claims priority based on Japanese Patent Application No. 2020-039904, filed on March 9, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0074] 1. Information processing device 2 Display section 3. Camera 4. Scanner 5. Biometric authentication server 6 Biometric authentication memory unit 7 Payment Server 8 Payment storage unit 11 Exposure adjustment section 11a Exposure adjustment section 12 Image acquisition section 12a Image acquisition section 13 Authentication Section 14 Payment Information Acquisition Department 15 Payment Department 16 Display control section 17 Registration Department 20 Information processing device 30 Information processing device 31 Authentication Section 32 Payment Department 100 Payment Systems 200 Payment Systems 500 Computer equipment 504 Program 505 Storage device 506 Recording media 507 Drive Unit 508 Communication Interface 509 Communication Network 510 Input / Output Interface 511 Bus

Claims

1. an exposure adjustment means for adjusting the exposure of the camera when the customer starts to register a first product; an image acquisition means for acquiring an image of the customer captured by the camera after the exposure adjustment means adjusts the exposure and before the registration of one or more products is completed; an authentication means for receiving a result of biometric authentication based on an image of the customer captured before the registration of the one or more products is completed; If the biometric authentication is successful, after the registration of the product is completed, a payment means for requesting payment for the one or more products using the customer's payment information. An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein the image acquisition means acquires the image at a timing when registration of the one or more products is started.

3. If the result of the biometric authentication received by the authentication means is authentication failure, the image acquisition means acquires the image during the period from receiving the result to completing the registration. The information processing device according to claim 2 .

4. The image acquisition means determines whether a luminance value of the acquired image is within a predetermined range, When the result of the determination is that the area is within the predetermined range, the authentication means specifies an area in the image to be used for the biometric authentication.

4. The information processing device according to claim 1.

5. The exposure adjustment means performs the adjustment at predetermined time intervals. The information processing device according to claim 1 .

6. The exposure adjustment means performs the adjustment when a change in the environmental light is detected. The information processing device according to claim 1 .

7. The exposure adjustment means performs the adjustment when an object for exposure adjustment is detected. The information processing device according to claim 1 .

8. An information processing device according to any one of claims 1 to 7, At least one camera that captures an image of the customer and transmits the image to the information processing device; a biometric authentication server that performs the biometric authentication in response to a request from the information processing device; a payment server that provides payment information about the customer to the information processing device if the biometric authentication is successful, and executes the payment upon receiving a payment request from the information processing device; A payment system comprising:

9. The computer When customers start registering their first products, the camera exposure is adjusted, acquiring an image of the customer captured by the camera after adjusting the exposure and prior to completion of registration of one or more products; receiving a biometric authentication result based on an image of the customer taken prior to completing registration of the one or more products; If the biometric authentication is successful, after the registration of the product is completed, payment for the one or more products is requested using the customer's payment information. A payment method comprising:

10. When customers start registering their first products, the camera exposure is adjusted, acquiring an image of the customer captured by the camera after adjusting the exposure and prior to completion of registration of one or more products; receiving a biometric authentication result based on an image of the customer taken prior to completing registration of the one or more products; If the biometric authentication is successful, after the registration of the product is completed, payment for the one or more products is requested using the customer's payment information. A payment program that makes this possible on a computer.

Citation Information

Patent Citations

  • Personal identification device and personal identification method

    JP2007226327A

  • Imaging apparatus and exposure time control method

    JP2008011007A

  • Imaging device

    JP2009182461A

  • Information processing system, commodity registration apparatus, settlement apparatus, information processing method, and program

    JP2016181100A

  • Information processing system, information processing device, information processing method, and information processing program

    JP2018159965A