Payment terminals and payment systems

Abstract

To provide a configuration that can improve security of IC card payment that requires a personal identification number.SOLUTION: Facial feature points of a user and a PIN code (personal identification number) are recorded in a payment code 40 to be presented by the user at the time of payment. Then, when the facial feature points and the PIN code are read from the payment code 40 captured by an image capturing unit 24 through code reading processing and the facial feature points are extracted from an image of the face of the user captured by the image capturing unit 24 through facial feature point extraction processing, the facial feature points read through the code reading processing and the facial feature points extracted through the facial feature point extraction processing are collated by collation processing. When face authentication is determined to be successful based on the collation result of this collation processing, payment processing is performed using the payment information read by an IC card reader 28a and the PIN code read through the code reading processing.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a payment terminal and a payment system that require the input of a password such as a PIN code at the time of payment.

Background Art

[0002] In recent years, payment terminals that can use multiple payment methods such as contactless IC card payments, magnetic card payments, contactless payments, and QR code (registered trademark) payments have been becoming widespread. As such a payment terminal, for example, a payment terminal disclosed in Patent Document 1 below is known. This payment terminal includes a touch panel that accepts operations such as PIN input and electronic signature operations. When a contactless IC card can be read, input detection by the touch panel becomes impossible, and when a contactless IC card cannot be read, input detection by the touch panel becomes possible, thereby suppressing electrical interference between the reading of the contactless IC card and the input detection of the touch panel.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in a payment using a contact IC type credit card (hereinafter, also simply referred to as a contact IC card), in order to authenticate the user, it is necessary to input a PIN code (password) that is previously associated with the card number of the contact IC card. Therefore, it is necessary to prevent the leakage of the PIN code, such as preventing the PIN code from being seen by observing the movement of the finger during the operation of inputting the PIN code. If the PIN code of a stolen contact IC card leaks, there is a problem that the contact IC card can be easily misused.

[0005] This invention was made to solve the above-mentioned problems, and its objective is to provide a configuration that can improve the security of IC card payments that require a PIN. [Means for solving the problem]

[0006] To achieve the above objective, the invention described in claim 1 of the claims is: A payment terminal (10) that processes payment information read from the user's IC card (C) and the PIN associated with the IC card, The information code (40) presented by the user at the time of payment contains the user's facial feature points and the PIN number. A card reader (28a) reads the payment information from the IC card, Imaging unit (24), A code reading unit (21) reads the facial feature points and the PIN from the information code captured by the imaging unit, A facial feature point extraction unit (21) extracts facial feature points from the image of the user's face captured by the imaging unit, A matching unit (21) compares the facial feature points read by the code reading unit with the facial feature points extracted by the facial feature point extraction unit, If the matching unit determines that facial recognition is successful based on the matching result, the payment processing unit (21) performs the payment processing using the payment information read by the card reader and the PIN read by the code reader, It is characterized by having the following features. The symbols within the parentheses above indicate the correspondence with the specific means described in the embodiments described later. [Effects of the Invention]

[0007] In the invention of claim 1, the information code presented by the user at the time of payment contains the user's facial feature points and PIN. The facial feature points and PIN are read from the information code captured by the imaging unit by the code reading unit, and the facial feature points are extracted from the image of the user's face captured by the imaging unit by the facial feature point extraction unit. The facial feature points read by the code reading unit and the facial feature points extracted by the facial feature point extraction unit are then compared by the matching unit. If the matching unit determines that facial authentication is successful, the payment processing unit performs the payment process using the payment information read by the card reading unit and the PIN read by the code reading unit.

[0008] This system allows users to simply have their face and information code captured by the payment terminal's imaging unit. The payment terminal then reads the payment information from the IC card and processes the payment using the PIN associated with that IC card. This eliminates the need to manually enter the PIN and prevents the PIN from being stolen. In particular, if a third party's facial features differ from those of the user, the matching unit will not determine that facial recognition was successful, thus preventing the IC card from being misused. Therefore, the security of IC card payments that require a PIN can be improved.

[0009] In the invention of claim 2, an IC card is associated with a second PIN in addition to the existing PIN. Then, when two-factor authentication using the verification result by the verification unit and the second PIN entered by the user on the operation unit is successful, the payment processing unit performs the payment processing. By adopting two-factor authentication using a second PIN in this way, the security of payments using IC cards can be improved.

[0010] According to the invention of claim 3, a payment system that has the same effects as those of claim 1, etc., can be realized.

[0011] In the invention of claim 4, the information code is generated as a partially confidential code having a public area where the IC card number is recorded and a private area where facial feature points and a PIN are recorded encrypted and decryptable using a decryption key. As a result, even if the information code is secretly photographed and the card number is read from the public area, the presence of facial feature points and a PIN in the private area cannot be recognized, thus improving security with respect to facial feature points and PINs. [Brief explanation of the drawing]

[0012] [Figure 1] This is an explanatory diagram illustrating the outline of the payment system according to the first embodiment. [Figure 2] This is a block diagram illustrating the electrical configuration of the payment terminal shown in Figure 1. [Figure 3] This is an explanatory diagram illustrating a part of the process for extracting facial feature points from captured facial image data. [Figure 4] Figure 1 is a block diagram illustrating the electrical configuration of the mobile terminal. [Figure 5] This flowchart shows the flow of contact IC card payment processing performed by the control unit of the payment terminal in the first embodiment. [Figure 6] This flowchart shows the flow of contact IC card payment processing performed by the control unit of the payment terminal in the second embodiment. [Modes for carrying out the invention]

[0013] [First Embodiment] Hereinafter, a first embodiment of the payment terminal and payment system according to the present invention will be described with reference to the drawings. The payment system 1 according to this embodiment is configured as a system comprising a payment terminal 10 that can use contact IC card payment, magnetic card payment, contactless payment, QR code (registered trademark) payment, etc., and a mobile terminal 30 used for payment with the payment terminal 10.

[0014] The settlement terminal 10 according to this embodiment is a touch panel type terminal that enables a user (purchaser) to select a plurality of settlement methods. The housing 11 that forms the outer shell of this settlement terminal 10 is formed in a substantially thin plate shape, and an insertion slot 12 for a contact IC card is provided at a position on the front side when viewed from the purchaser with respect to the operation surface 23a of the touch panel 23 disposed on the surface 11a of the housing 11, and a slot 13 for a magnetic card is provided at a position on the right side when viewed from the purchaser. Further, an imaging window 24a of the imaging unit 24 is provided on the back side of the operation surface 23a.

[0015] A control unit 21 that controls the entire settlement terminal 10 is provided inside the housing 11. This control unit 21 is mainly composed of a microcomputer, has a CPU, a system bus, an input / output interface, etc., and constitutes an information processing device together with a storage unit 22 composed of a semiconductor memory or the like. Programs for executing various settlement processes and the like are stored in advance in the storage unit 22 so as to be executable by the control unit 21.

[0016] Also, as shown in FIG. 2, in addition to the control unit 21 and the storage unit 22 described above, the settlement terminal 10 includes a touch panel 23, an imaging unit 24, an operation unit 25, a notification unit 26, an external interface 27, a settlement information reading unit 28, etc. The touch panel 23 is configured as a known touch panel type display device, and includes a display unit configured as a known display device such as a liquid crystal display, and a transparent operation panel that is overlaid on the display screen of this display unit and can detect the range where a pressing operation (contact) is made on the display screen as the operation surface 23a. The display content of the display unit is controlled by the control unit 21 for this touch panel 23.

[0017] The imaging unit 24 is configured as a camera equipped with a light receiving sensor (for example, a C-MOS area sensor, a CCD area sensor, etc.), and is controlled by the control unit 21 so as to output imaging image data obtained by imaging the outside through the imaging window 24a to the control unit 21.

[0018] The operation unit 25 is configured to include the operation panel and one or more keys provided on the side of the housing 11, and is configured to output signals to the control unit 21 in response to touch operations on the operation surface 23a of the touch panel 23 or key operations.

[0019] The notification unit 26 is equipped with light-emitting parts such as LEDs, a speaker, a buzzer, a vibrator, etc., and the control unit 21 controls the illumination state of the light-emitting parts, the voice guidance of the speaker, the sounding state of the buzzer, the vibration of the vibrator, etc., so that it is configured to provide predetermined notifications according to the results of the payment processing, etc.

[0020] The external interface 27 is configured as an interface for data communication with external devices such as payment servers and POS terminals, and functions to perform communication processing in cooperation with the control unit 21.

[0021] The payment information reading unit 28 includes a card reader for contact IC cards (hereinafter also referred to as IC card reader 28a), a card reader for magnetic cards (hereinafter also referred to as magnetic card reader 28b), and a contactless communication unit 28c for contactless payment. The IC card reader 28a is configured to output payment information read from a contact IC card C (see Figure 1) inserted into the insertion slot 12 to the control unit 21. The magnetic card reader 28b is configured to output payment information read from a magnetic card swiped through the slot 13 to the control unit 21. The contactless communication unit 28c has a near-field communication (NFC) function and is configured to output payment information read from a contactless IC card or electronic money medium held over a predetermined reading surface (for example, the operating surface 23a and its surroundings) using an antenna provided on the surface 11a side inside the housing 11 to the control unit 21. Note that the IC card reader 28a may correspond to an example of a "card reading unit".

[0022] In the payment terminal 10 configured in this way, payment information is read from the contact IC card C inserted into the insertion slot 12 by the IC card reader 28a, and the control unit 21 starts the contact IC card payment process. In this contact IC card payment process, two input modes are provided for the PIN code (a 4-digit number in this embodiment) required as a personal identification number for contact IC card payments: a touch input mode in which the user touches the PIN code using the touch panel 23, and a read input mode in which the user has their own mobile terminal 30 read the PIN code.

[0023] In read input mode, the information code displayed on the mobile terminal 30 screen is captured by the imaging unit 24, and a reading process is performed to read the PIN code recorded in the captured information code and the user's facial feature points. The facial feature points thus read are then compared with facial feature points extracted from a facial image separately captured by the imaging unit 24, and if facial authentication is determined to be successful based on the comparison result, payment processing is performed using the PIN code read as described above. In other words, unless facial authentication processing is performed by the payment terminal 10 alone and the facial authentication is determined to be successful, the PIN code read as described above will not be used for payment processing.

[0024] Therefore, the mobile terminal 30 has an information code (hereinafter also referred to as the payment code 40) pre-stored in which the PIN code that the user should enter when making a payment using the contact IC card C and the user's facial feature points are recorded. In this embodiment, a QR code is used as the payment code 40, but it is not limited to this, and other types of information codes (for example, barcodes, data matrix codes, maxi codes, etc.) may be used. Furthermore, the control unit 21 that processes the reading of facial feature points and PIN code (personal identification number) from the payment code 40 captured by the imaging unit 24 corresponds to an example of a "code reading unit," and the control unit 21 that processes the contact IC card payment processing corresponds to an example of a "payment processing unit."

[0025] In this embodiment, the facial feature points for personal authentication to be recorded in the payment code 40 include items such as the size and shape of each facial organ, such as the eyes, eyebrows, nose, ears, and mouth, as well as the contour and the relative positions of the facial organs. Then, in accordance with the facial feature point extraction process for extracting known facial feature points, for example, as illustrated in Figure 3, the acquired facial image data D is used to calculate and extract facial feature points for each item, such as "D1: almond-shaped eyes" or "D2: large mouth".

[0026] Next, the configuration of the mobile terminal 30 on which the payment code 40 described above is displayed will be explained with reference to Figure 4. The mobile terminal 30 is, for example, a smartphone owned by the user, and is a portable information processing terminal capable of displaying information codes such as payment codes 40 on its screen. As shown in Figure 4, the mobile terminal 30 includes a control unit 31 consisting of a CPU, a storage unit 32 consisting of ROM, RAM, non-volatile memory, an imaging unit 33 configured as a camera equipped with a light receiving sensor (for example, a C-MOS area sensor, a CCD area sensor, etc.), a touch panel display unit 34, an operation unit 35 that outputs signals to the control unit 31 in response to touch operations on the touch panel and operations on various operation keys, a notification unit 36 ​​having LEDs, a speaker, a buzzer, a vibrator, etc., and a communication unit 37 configured as a communication interface that enables wireless communication with external devices, including short-range wireless communication such as NFC.

[0027] When a user receives a contact IC card C, they submit their facial image data along with personal information and a PIN code to the card issuer, etc., and obtain a payment code 40 from the card issuer, etc., which contains facial feature points and a PIN code. The payment code 40 obtained in this way is stored in the storage unit 32 so that it can be displayed on the screen. The mobile terminal 30 can be considered an example of a "display medium" capable of displaying the payment code 40.

[0028] Next, the contact IC card payment processing performed by the control unit 21 of the payment terminal 10 when payment is made using a contact IC card C will be described in detail with reference to the flowchart shown in Figure 5. When payment information (e.g., card number) is read from the contact IC card C inserted into the slot 12 by the IC card reader 28a, the control unit 21 starts the contact IC card payment process. In the determination process shown in step S101 of Figure 5, it is determined whether or not the read input mode is selected. If the store clerk or other person has not performed an operation to select the read input mode, it is assumed that the touch input mode is selected (No in S101), and the PIN code input process shown in step S103 is performed. In this process, the PIN code is entered by the user performing a touch operation on the touch panel 23 corresponding to the PIN code to be entered.

[0029] Next, the payment information transmission process shown in step S105 is performed, and the payment information read from the contact IC card C, the PIN code entered as described above, and information about the purchased items are transmitted to the payment server via the external interface 27. If the payment server receives information indicating successful authentication in response to this transmission, the contact IC card payment process is terminated as successful authentication (Yes in S107). On the other hand, if information indicating authentication failure is received because the entered PIN code is incorrect (No in S107), the process from step S103 is repeated.

[0030] On the other hand, if a user requests to enter a PIN code using the payment code 40, and a store employee or other person performs an operation on the operation unit 25 to select the reading input mode, the reading input mode is considered to be selected (Yes in S101), and the imaging process shown in step S109 is performed, making the imaging unit 24 capable of imaging the payment code 40, etc. Subsequently, the code reading process shown in step S111 is performed, and processing is carried out to read facial feature points and the PIN code from the captured payment code 40.

[0031] As described above, when the imaging unit 24 is in a state where it can capture images, the user holds the payment code 40 displayed on the screen of the mobile terminal 30 over the imaging window 24a of the payment terminal 10. When facial feature points and a PIN code are read from the captured payment code 40, the facial feature point extraction process shown in step S113 is performed. In this process, a process is performed to extract facial feature points from the image of the face captured by the imaging unit 24 in accordance with the known facial feature point extraction process described above. The control unit 21 that performs the above facial feature point extraction process may correspond to an example of a "facial feature point extraction unit".

[0032] Then, when the user who has held up the payment code 40 faces the imaging window 24a, facial feature points are extracted from the facial image captured by the imaging unit 24, and the matching process shown in step S115 is performed. In this process, as described above, the facial feature points read from the payment code 40 are compared with the facial feature points extracted from the facial image. The control unit 21 that performs the above matching process may correspond to an example of a "matching unit".

[0033] Furthermore, prior to the code reading process shown in step S111, the notification unit 26 may provide a predetermined notification prompting the user to hold the payment code 40 over the imaging window 24a. Similarly, prior to the face feature point extraction process shown in step S113, the notification unit 26 may provide a predetermined notification prompting the user to orient their face towards the imaging window 24a.

[0034] As described above, once the matching process is performed, the determination process in step S117 determines whether or not facial recognition using the matching results from this matching process has been successful. If the facial feature points read from the payment code 40 and the facial feature points extracted from the facial image nearly match, and facial recognition is determined to be successful (Yes in S117), the payment information transmission process shown in step S119 is performed. In this process, payment information read from the contact IC card C, the PIN code read from the payment code 40 as described above, and information about the purchased items are transmitted to the payment server via the external interface 27. If the payment server receives information indicating successful authentication in response to this transmission, the authentication is considered successful (Yes in S121), and the contact IC card payment process ends.

[0035] On the other hand, if a third party whose facial feature points differ from those of the user holds a payment code 40, which was fraudulently obtained from the user, over the imaging window 24a and then points their face towards the imaging window 24a, the facial recognition will be determined to have failed because the facial feature points read from the payment code 40 do not match the facial feature points extracted from the facial image (No in S117). In this case, the process from step S109 above is repeated, and the PIN code read from the payment code 40 is not used for payment processing. Also, if an information code that does not correspond to the contact IC card C inserted into the slot 12 (for example, a payment code 40 that corresponds to a different contact IC card C) is held over the imaging window 24a, even if facial recognition is successful (Yes in S117), information indicating authentication failure is received (No in S121), and the process from step S109 above is repeated.

[0036] Furthermore, when facial recognition is successful (Yes in S117), the notification unit 26 may issue a predetermined notification indicating that facial recognition has been successful. Similarly, when authentication is successful (Yes in S107, Yes in S121), the notification unit 26 may issue a predetermined notification indicating that authentication has been successful, and when authentication fails (No in S107, No in S121), the notification unit 26 may issue a predetermined notification indicating that authentication has failed.

[0037] As described above, in the payment terminal 10 according to this embodiment, the payment code 40 presented by the user at the time of payment contains the user's facial feature points and PIN code (personal identification number). Then, the facial feature points and PIN code are read from the payment code 40 captured by the imaging unit 24 by a code reading process (S111), and facial feature points are extracted from the image of the user's face captured by the imaging unit 24 by a facial feature point extraction process (S113). The facial feature points read by the code reading process and the facial feature points extracted by the facial feature point extraction process are then compared by a comparison process (S115). If the comparison result from this comparison process determines that facial authentication is successful, the payment process is performed using the payment information read by the IC card reader 28a and the PIN code read by the code reading process.

[0038] As a result, users only need to have their face and payment code 40 captured by the imaging unit 24 of the payment terminal 10. The payment terminal 10 then reads the payment information from the contact IC card C and processes the payment using the PIN code associated with the contact IC card C. This eliminates the need for users to manually enter the PIN code and prevents the PIN code from being stolen. In particular, if a third party's facial features differ from those of the user, the matching process will not determine that facial recognition was successful, thus preventing the contact IC card C from being misused. Therefore, the security of IC card payments requiring a PIN code (personal identification number) can be improved.

[0039] As a modification of this embodiment, the payment code 40 may be generated by encrypting facial feature points and PIN code (personal identification number), etc. Specifically, for example, the payment code 40 may be generated as a partially confidential code having a public area where the card number of the contact IC card C is recorded and a private area where the facial feature points and PIN code (personal identification number) are recorded encrypted and decryptable using a decryption key. As a result, even if the card number is read from the public area due to the payment code 40 being secretly photographed, the presence of the facial feature points and PIN code in the private area cannot be recognized, thus improving security with respect to the facial feature points and PIN code.

[0040] [Second Embodiment] Next, a second embodiment of the present invention, comprising a payment terminal and a payment system, will be described with reference to the drawings. This second embodiment differs from the first embodiment in that it employs two-factor authentication using a second PIN. Therefore, components that are substantially the same as those in the first embodiment are denoted by the same reference numerals, and their descriptions are omitted.

[0041] In this embodiment, in order to further improve security for payments using the contact IC card C, two-factor authentication using a second PIN is implemented in addition to the facial recognition described above during the contact IC card payment processing performed by the control unit 21 of the payment terminal 10. In this embodiment, a four-digit number (e.g., "2222") different from the PIN code (e.g., "1111") recorded in the payment code 40 is used as the second PIN and is managed by the payment server. However, the second PIN is not limited to this, and for example, the same four-digit number as the PIN code recorded in the payment code 40 may be used, or five or more characters may be used.

[0042] To implement such two-factor authentication, the payment server in this embodiment first performs a first authentication process using the PIN code and card number received from the payment terminal 10 after successful facial recognition. Upon success in this first authentication process, the payment server requests the payment terminal 10 to send the PIN code as a second PIN. Upon failure in the first authentication process, the payment server sends information indicating authentication failure to the payment terminal 10. Subsequently, the payment server performs a second authentication process using the PIN code received from the payment terminal 10 as a second PIN in response to the above request. Upon success in this second authentication process, the payment server sends information indicating authentication success to the payment terminal 10. Upon failure in the second authentication process, the payment server sends information indicating authentication failure to the payment terminal 10.

[0043] In this embodiment, the contact IC card payment processing performed by the control unit 21 of the payment terminal 10 will be described in detail below with reference to the flowchart shown in Figure 6. In the same manner as in the first embodiment described above, if facial recognition is successful (Yes in S117 of Figure 6), the payment information transmission process shown in step S119 transmits the payment information read from the contact IC card C, the PIN code read from the payment code 40, and information about the purchased items to the payment server via the external interface 27.

[0044] Then, when the payment server that has successfully completed the first authentication process receives a request to send a PIN code in response to the transmission of payment information, the determination process shown in step S123 determines it to be Yes, and the PIN code reception process shown in step S125 is performed. In this process, the system enters a state where it is ready to accept a PIN code input operation in response to the user's touch operation on the operating surface 23a of the touch panel 23 (input operation on the operation unit 25).

[0045] In this reception state, the user touches the operation surface 23a to input a PIN code that they have previously registered as a second PIN, and the PIN code transmission process shown in step S127 is performed, and the PIN code entered as described above is transmitted to the payment server via the external interface 27.

[0046] Then, when information indicating successful authentication is received from the payment server that successfully completed the second authentication process in response to the input PIN code transmission, the contact IC card payment process is terminated as authentication is successful (Yes in S129).

[0047] Furthermore, if authentication is successful (Yes in S129), the notification unit 26 may issue a predetermined notification indicating that authentication was successful, and if authentication fails (No in S129), the notification unit 26 may issue a predetermined notification indicating that authentication failed.

[0048] As described above, in the payment terminal 10 according to this embodiment, a second PIN is associated with the contact IC card C in addition to the PIN code recorded in the payment code 40. The payment process is then performed when the two-factor authentication, which uses the verification result from the verification process and the second PIN entered by the user into the operation unit 25, is successful. By employing two-factor authentication using the second PIN in this way, the security of payments using the contact IC card C can be improved.

[0049] The present invention is not limited to the embodiments described above, and may be further embodied as follows, for example. (1) The present invention is not limited to being used in a payment system 1 that includes a payment terminal 10 that can select from multiple payment methods such as contact IC card payment, magnetic card payment, contactless payment, and QR code payment, but may also be used in a payment terminal that is capable of at least contact IC card payment and includes an imaging unit.

[0050] (2) The PIN code (personal identification number) recorded in the payment code 40 is not limited to a four-digit number, but may also be, for example, a five-digit or longer string of characters.

[0051] (3) The payment code 40 is not limited to being displayed on the screen of the mobile terminal 30, but may also be printed on other display media, such as the surface of a dedicated card medium for the payment code 40 or the back of a contact IC card C.

[0052] 1…Payment system 10…Payment terminal 21...Control Unit (Code Reading Unit, Face Feature Point Extraction Unit, Matching Unit, Payment Processing Unit) 24…Imaging Department 28a... IC card reader (card reading unit) 30…Mobile devices (display media) 40…Payment code (information code) C... Contactless IC card (IC card)

Claims

1. A payment terminal that processes payment information read from a user's IC card and the PIN associated with that IC card, The information code presented by the user at the time of payment contains the user's facial feature points and the PIN number. A card reader unit that reads the payment information from the IC card, Imaging unit, A code reading unit reads the facial feature points and the PIN from the information code captured by the imaging unit, A facial feature point extraction unit extracts facial feature points from the image of the user's face captured by the imaging unit, A matching unit that compares the facial feature points read by the code reading unit with the facial feature points extracted by the facial feature point extraction unit, If the matching unit determines that facial recognition is successful based on the matching result, the payment processing unit performs the payment processing using the payment information read by the card reader and the PIN read by the code reader. A payment terminal characterized by being equipped with the following features.

2. In addition to the aforementioned PIN, a second PIN is also associated with the IC card. The system includes an operating unit for the user to input the second PIN, The payment terminal according to claim 1, characterized in that the payment processing unit performs the payment processing when two-factor authentication using the verification result by the verification unit and the second PIN entered by the operation unit is successful.

3. A payment terminal according to claim 1 or 2, A display medium capable of displaying the aforementioned information code, A payment system characterized by having the following features.

4. The payment system according to claim 3, characterized in that the information code is generated as a partially confidential code having a public area in which the card number of the IC card is recorded and a private area in which the facial feature points and the PIN are recorded encrypted and decryptable using a decryption key.

Images