Payment terminal, payment support method, and payment program

Abstract

A payment terminal 100 is capable of implementing a code payment using a code and a contactless payment using a contactless communication function with a contactless IC medium. The payment terminal 100 comprises a camera 25 for use in a code payment, an NFC antenna 120 for use in an NFC function, and a processor 20, wherein when a payment is initiated, the processor 20 turns on the camera 25, detects an object held by a hand from an image captured by the camera 25, and implements a code payment using a code detected by the camera 25 when a display area is detected from the object.

Description

Payment Terminal, Payment Support Method, and Payment Program

[0001] The present disclosure relates to a payment terminal, a payment support method, and a payment program.

[0002] In recent years, payment terminals that support a plurality of payment methods have been becoming widespread. The plurality of payment methods include, for example, magnetic card payment, contact IC card payment, contactless communication with contactless IC media, for example, contactless touch payment (contactless payment) using an NFC (Near Field Communication) function, code payment using a QR code (registered trademark), and the like.

[0003] Since the function to be activated on a payment terminal differs depending on the payment method, a user often selects a payment method in advance before performing payment processing. However, considering convenience at the time of payment, it is desirable that payment processing can be performed through a plurality of payment methods without an operation of selecting a payment method in advance. On the other hand, the following situation may occur at an actual payment site. For example, when performing code payment using an electronic terminal (such as a smartphone) which is one type of contactless IC medium, a user brings the electronic terminal close to the payment terminal while displaying a code for code payment. Here, if the payment method of the payment terminal is not selected in advance, the NFC function of the payment terminal may react first, making it impossible to perform the code payment processing.

[0004] In contrast to this, the payment terminal of Patent Document 1 is known. Specifically, this payment terminal determines that a terminal displaying a code has approached when a terminal comes close to the payment terminal and illuminance higher than a predetermined value is detected by a proximity sensor or an illuminance sensor, and then performs code payment processing.

[0005] Japanese Unexamined Patent Publication No. 2024-067803

[0006] The present disclosure provides a payment terminal, a payment support method, and a program that can easily and automatically switch between code payment and contactless payment without requiring a user to select a payment method.

[0007] One aspect of the present disclosure is a payment terminal capable of at least code-based payment and contactless payment using a contactless communication function with a contactless IC medium, comprising a camera used for code-based payment, an antenna used for the contactless communication function, and a processor, wherein when payment processing related to payment is started, the processor activates the camera, detects an object held in the hand based on the image captured by the camera, and if it detects a display area of ​​the object, performs the code-based payment using the code detected based on the image.

[0008] One aspect of the present disclosure is a payment support method that enables at least code-based payment and contactless payment using a contactless communication function with a contactless IC medium, wherein when a payment process related to payment is started, a camera used for the code-based payment is activated, and based on the image captured by the camera, an object held in the hand is detected, and if a display area of ​​the object is detected, the code contained in the image is detected, and the code-based payment is performed using the code.

[0009] One aspect of this disclosure is a program for causing a computer to execute the above-described payment support method.

[0010] According to this disclosure, users can easily and automatically switch between QR code payments and contactless payments without having to select a payment method.

[0011] Top view of the payment terminal according to Embodiment 1 of this disclosure Block diagram showing the configuration of the payment terminal according to Embodiment 1 of this disclosure Flowchart showing the payment processing procedure by the payment terminal according to Embodiment 1 of this disclosure Perspective view of the payment terminal according to Embodiment 2 of this disclosure Cross-sectional view of the payment terminal according to Embodiment 2 of this disclosure Block diagram showing the configuration of the payment terminal according to Embodiment 2 of this disclosure Flowchart showing the payment processing procedure by the payment terminal according to Embodiment 2 of this disclosure Perspective view of the payment terminal according to Embodiment 3 of this disclosure when the touch position mark is displayed Perspective view of the payment terminal according to Embodiment 3 of this disclosure when the touch position mark is not displayed Cross-sectional view of the payment terminal according to Embodiment 3 of this disclosure when the touch position mark is displayed Block diagram showing the configuration of the payment terminal according to Embodiment 3 of this disclosure Flowchart showing the payment processing procedure by the payment terminal according to Embodiment 3 of this disclosure

[0012] The following describes in detail the embodiments of the payment terminal, payment support method, and payment program specifically disclosed herein, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters or redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding by those skilled in the art. The attached drawings and the following explanation are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter described in the claims.

[0013] (Background to obtaining the embodiments of this disclosure) In the technology of Patent Document 1, it is necessary to newly install proximity sensors and illuminance sensors that are not directly related to the payment method in the payment terminal, which increases the number of parts in the payment terminal. In addition, recent contactless IC media come in forms other than electronic terminals that users hold in their hands, such as smartphones, such as ring type, pendant type, and watch type. In particular, electronic terminals (smartphones, etc.) and watch type contactless IC media are inevitably equipped with displays. Therefore, even if the payment terminal tries to detect whether an approaching object is a contactless IC medium using proximity sensors or illuminance sensors, it may react to the illumination of the display and first attempt code payment.

[0014] Furthermore, recent advancements in image processing technology are remarkable, making it possible to determine the appropriate payment processing method based on images of approaching objects. However, in order to automatically switch between code-based and contactless payments based on image processing, it is necessary to detect contactless IC media of various shapes, such as ring-type, pendant-type, and watch-type. In this case, it is necessary to pre-store the shapes of each contactless IC media. Therefore, detecting which type of contactless IC media it is requires comparing each contactless IC media with its respective shape, which places a heavy burden on image processing and makes implementation difficult.

[0015] The following embodiment provides a payment terminal that can easily and automatically switch between code payment and contactless payment without the user having to select a payment method.

[0016] (Embodiment 1) Figure 1 is a top view of a payment terminal 100 according to Embodiment 1 of the present disclosure. In each figure, the X-axis direction is a direction along the touch panel surface (e.g., the short side direction), and the Y-axis direction is a direction along the touch panel surface perpendicular to the X-axis direction (e.g., the long side direction). The Z-axis direction is a direction perpendicular to the touch panel surface (e.g., the thickness direction or the height direction).

[0017] The payment terminal 100 comprises a housing 10, an NFC antenna 120 that constitutes an antenna, and a touch panel 130. The payment terminal 100 also comprises a first card slot 16s, a second card slot 17s, and a camera 25. The payment terminal 100 is a type of electronic device that performs payment processing.

[0018] The payment terminal 100 is a hybrid type that allows purchasers of goods to select from multiple payment methods. These multiple payment methods include, for example, credit card payment, electronic money payment, code (e.g., QR code®) payment, and cash payment. Credit card payment includes, for example, magnetic card payment, contact IC card payment, and contactless IC card payment. There may be one or more types of electronic money. Since electronic money payment and contactless IC card payment are performed using contactless communication (e.g., NFC) with a contactless IC medium, they are collectively referred to here as contactless payment.

[0019] Multiple payment methods are carried out using each of the corresponding multiple payment interfaces. These multiple payment interfaces include, for example, credit cards, electronic money cards, codes, and cash. Credit cards include, for example, magnetic cards, contact IC cards, and contactless IC credit cards.

[0020] Magnetic cards are inserted into the first card slot 16s and used for payment. Contact IC cards are inserted into the second card slot 17s and used for payment. Contactless IC credit cards and electronic money cards are brought close to the NFC antenna 120 and used for payment. Contactless IC credit cards and electronic money cards are collectively referred to as "contactless IC cards".

[0021] The housing 10 is made of, for example, resin and constitutes the exterior of the payment terminal 100, housing other components.

[0022] The NFC antenna 120 is a communication antenna for short-range wireless communication (short-range wireless communication antenna). The NFC antenna 120 detects a communication medium such as a contactless IC card or a high-frequency identification tag using short-range wireless communication and communicates wirelessly with the detected communication medium. For example, the NFC antenna 120 communicates wirelessly with a contactless IC card, which is a communication medium in close proximity to the payment terminal 100, to send and receive information. The payment terminal 100 may read information from the contactless IC card or write information to the contactless IC card via the NFC antenna 120.

[0023] For example, a user holds a contactless IC card capable of communicating with the NFC antenna 120 and brings it close to the payment terminal 100. This enables contactless wireless communication between the contactless IC card and the NFC antenna 120, allowing payment-related information to be sent and received.

[0024] The touch panel 130 has a user interface that electrically detects input from a user's finger or a stylus pen or other indicator. The touch panel 130 can be of various types, such as resistive or capacitive, but is not particularly limited to any specific type. The touch panel 130 accepts and detects input operations of various data and information related to payment processing by store staff or customers (e.g., selection of payment method, PIN, Personal Identification Number, or electronic signature). The touch panel 130 is positioned near the NFC antenna 120. For example, at least a portion of the detection area of ​​the touch panel 130 overlaps with the communication area of ​​the NFC antenna 120.

[0025] The LCD module 140 is a so-called liquid crystal display device and includes various components such as liquid crystal cells and polarizing plates, but its type is not particularly limited. Alternatively, other display devices (e.g., organic electroluminescence) may be used instead of the LCD module 140. The LCD module 140 displays, for example, various data and information related to payment processing.

[0026] The camera 25 is installed inside the housing 10 so as to be exposed from one side of the housing 10, for example, the top surface 13, and captures images of the area around the payment terminal 100 and acquires images. The camera sends the captured images (captured images) to the processor 20 (see Figure 2). The camera 25 is used, for example, in code payment.

[0027] Furthermore, the aforementioned NFC antenna 120, touch panel 130, and LCD module 140 are also located on the top surface 13, and the user primarily views and operates the payment terminal 100 from the top surface 13.

[0028] The payment terminal 100 may be a stationary device with a fixed installation location, or it may be a portable device that can be carried by the user (portable, handheld). Alternatively, a communication medium such as a contactless IC card or a high-frequency identification tag may be embedded in a stationary device, and the user can bring the portable payment terminal 100 close to this communication medium. The payment terminal 100 may be the same size as, for example, an electronic terminal (smartphone, etc.). Also, in Figure 1, the housing 10 of the payment terminal 100 is rectangular in plan view as an example, but it may have other shapes. Also, in Figure 1, the NFC antenna 120 is rectangular as an example, but it may have other shapes.

[0029] Figure 2 is a block diagram showing the configuration of a payment terminal 100 according to Embodiment 1. The payment terminal 100 includes a processor 20, an NFC antenna 120, an NFC IC 12, a first card slot 16s, a magnetic IC card reader 16, a second card slot 17s, a contact IC card reader 17, a camera 25, a touch panel 130, an LCD module 140, and a memory 22.

[0030] The NFC_IC12 is a circuit that controls the NFC antenna 120 so that it can communicate with the contactless IC card without making contacts. The NFC_IC12 and the NFC antenna 120 work together to implement the function of short-range wireless communication (i.e., NFC function). The NFC_IC12 reads the information from the contactless IC card and sends the read information (contactless read information) to the processor 20.

[0031] The magnetic IC card reader 16 reads the information of the magnetic card inserted into the first card slot 16s and sends the read information (magnetic reading information) to the processor 20.

[0032] The contact IC card reader 17 reads the information from the contact IC card inserted into the second card slot 17s and sends the read information (contact reading information) to the processor 20.

[0033] The processor 20 has a CPU (Central Processing Unit) that operates according to a program stored in memory 22, for example, and is a computer device responsible for controlling the entire payment terminal 100. The processor 20 may be a processor other than a CPU.

[0034] The processor 20 may acquire an image from the camera 25 and detect an object approaching the payment terminal 100 based on the image. If the detected object has a display (display area), the processor 20 may detect the brightness (including luminance and brightness) of the display based on the image, that is, it may detect the display area of ​​the object. The brightness of the display can be determined, for example, by obtaining pixel values ​​corresponding to the display within the image, thereby determining whether or not there is a display area.

[0035] If the processor 20 acquires magnetic reading information, it performs payment processing using the magnetic reading information (also referred to as magnetic card payment). If the processor 20 acquires contact reading information, it performs payment processing using the contact reading information (also referred to as contact IC card payment). If the processor 20 acquires contactless reading information, it performs payment processing using the contactless reading information (also referred to as contactless payment).

[0036] When the processor 20 acquires an image, it determines whether or not the image contains a code. If the CPU 11 determines that the image contains a code, it acquires (reads) the identification information indicated by the code as code reading information. The CPU 11 uses the code reading information to perform payment processing (also called code payment). In the payment processing, the CPU 11 may cooperate with an external server for payment processing via the communication unit.

[0037] Memory 22 holds various information, data, programs, etc. Memory 22 has RAM as work memory used when executing each process of the processor 20, and ROM which stores programs and data that define the operating procedures of the processor 20. Memory 22 may store programs related to code payment, contactless payment, etc., and the payment terminal 100 can perform code payment, contactless payment, etc. by reading and executing these programs when the processor 20 reads them.

[0038] For example, when payment is initiated, the processor 20 may activate (turn on) the camera 25 at a predetermined timing and detect the object held in the user's hand based on the image captured by the camera 25. Furthermore, if the processor 20 detects a display area (i.e., a display area) included in the detected object, it may perform code payment using the detected code.

[0039] In other words, the processor 20 has a display capable of showing a code when an approaching object is detected by the camera 25, and the user can perform a code payment without having to perform any special operation on the input device in the payment terminal 100.

[0040] Figure 3 is a flowchart showing the payment processing procedure by the payment terminal 100 according to Embodiment 1. For example, when the processor 20 instructs the payment terminal 100 to start payment processing via its input device, it starts the process shown in Figure 3.

[0041] The processor 20 determines whether or not the magnetic card inserted into the first card slot 16s has been detected by the magnetic IC card reader 16 (step S1). If the processor 20 has detected the magnetic card (step S1; Yes), it obtains magnetic reading information from the magnetic IC card reader 16 and performs magnetic card payment (step S2). Then, it terminates the process shown in Figure 3.

[0042] If no magnetic card is detected (step S1: No), the processor 20 determines whether a contact IC card inserted into the second card slot 17s by the contact IC card reader 17 has been detected (step S3). When the processor 20 detects a contact IC card (step S3: Yes), the processor 20 acquires contact reading information from the contact IC card reader 17 and performs contact IC card payment (step S4). Then, the processing of FIG. 3 is ended.

[0043] If no contact IC card is detected (step S3: No), the processor 20 activates the camera 25, that is, turns on the camera 25 (step S5).

[0044] The processor 20 acquires a captured image captured by the camera 25. Based on the captured image, the processor 20 determines whether an object held in a user's hand has been detected (step S6). For example, the processor 20 can extract the shape of a hand through image processing of the captured image, and detect an object held in the hand based on the shape of the extracted hand holding the object.

[0045] When an object held in a hand (e.g., a user's hand) is detected (step S6: Yes), the processor 20 determines based on the captured image whether a display area included in the object has been detected (step S7). The display area is, for example, an area including a display capable of displaying an image. For example, the processor 20 can detect the display area through image processing of the captured image based on a difference between the brightness (including luminance and lightness) of the display area and the brightness of the surrounding area.

[0046] When a display area is detected in the object (step S7: Yes), the processor 20 determines that the approaching object is any object capable of displaying a code in the display area, for example, an electronic terminal with a display such as a smartphone or a tablet, and determines whether the code has been read (step S8). Whether the code has been read can be determined, for example, based on whether the processor 20 has acquired code reading information.

[0047] When the code is read (step S8; Yes), the processor 20 performs code payment (step S9). Then, the processor 20 stops the operation of the camera 25, that is, turns off the camera 25 (step S10). Then, the process of FIG. 3 is ended.

[0048] In step S6, when no object held in the user's hand is detected (step S6; No), the processor 20 determines that the user is wearing a non-contact IC medium such as a ring type, a pendant type, or a watch type while holding nothing in the hand.

[0049] In step S7, even if an object held in the hand is detected, when the display area of the object is not detected (step S7; No), the processor 20 determines that the detected object is a non-contact IC medium such as a non-contact IC card, a ring type, or a pendant type, or a side (back surface, side surface, etc.) of an electronic terminal (smartphone, etc.) that does not have a display.

[0050] That is, in such a case, the processor 20 determines that the object is an object related to a non-contact IC medium irrelevant to code payment, and performs processing for performing non-contact payment.

[0051] Specifically, when no object held in the user's hand is detected (step S6; No), or when the display area of the object is not detected (step S7; No), the processor 20 turns off the camera 25 (step S11). The processor 20 turns on the NFC function by the NFC antenna 120 and the NFC_IC 12, and stops the operation of the touch panel 130 (turns off the touch panel 130) (step S13). Then, the processor 20 performs non-contact payment (step S13).

[0052] After the non-contact payment is completed, the processor 20 turns off the NFC function and activates the touch panel 130 (turns on the touch panel 130) (step S14). Then, the process of FIG. 3 is ended.

[0053] Note that the processor 20 turns off the camera 25 in step S11, which is before contactless payment, but it is not limited to this, and may also turn off the camera 25 after contactless payment.

[0054] Note that while Figure 3 illustrates the process of performing both magnetic card payment and contact IC card payment, it is not limited to this. For example, if the payment terminal 100 does not have magnetic card payment or contact IC card payment functions, steps S1 to S4 may be omitted. In other words, immediately after the start of the payment process shown in Figure 3, the processor 20 may activate the camera 25 in step S5.

[0055] Thus, in this embodiment, the payment terminal 100, which supports at least code payment and contactless payment, can detect the presence or absence of an object held in the hand and the presence or absence of a display area of ​​the object by image processing, even when the contactless IC medium has various shapes. As a result, the payment terminal 100 can automatically select code payment or contactless payment without the user having to select a payment method (without performing a selection operation), and can automatically switch between code payment and contactless payment. Therefore, since the payment terminal 100 can automatically switch payment methods, it can improve user operability and convenience.

[0056] Furthermore, since the payment terminal 100 can detect the display showing the code as the display area of ​​an object, it eliminates the need for components such as proximity sensors and illuminance sensors, thereby reducing the number of parts in the payment terminal 100.

[0057] Furthermore, the payment terminal 100 determines whether or not an object is being held by the hand, and decides whether or not to perform a code payment based on the determination result. Therefore, even if a watch-type contactless IC medium has a display, the payment terminal 100 can reliably select contactless payment instead of code payment by determining that the object is not being held by the hand.

[0058] Furthermore, the payment terminal 100 determines whether or not an object is being grasped by a hand, determines whether or not there is a display area for the object, and determines whether or not to perform contactless payment based on the determination results. Therefore, the payment terminal 100 can determine whether or not to perform contactless payment using the above determination results without having to pre-store various shapes of various contactless IC media in the memory 22 and identify each individual contactless IC media. Thus, the payment terminal 100 can avoid having to perform a lot of image processing to identify the contactless IC media, and can reduce the processing load.

[0059] Furthermore, if the processor 20 does not detect an object being held in the hand based on the captured image, it may determine that a contactless IC medium is attached to the hand, activate (turn on) the contactless communication function, and perform contactless payment (No. of step S6, step S12). In this case, the payment terminal 100 can determine that, for example, a ring-type, pendant-type, or watch-type contactless IC medium is attached, and automatically select contactless payment without the user having to select a payment method.

[0060] Furthermore, the processor 20 detects the object held in the hand based on the captured image, and if no display area is detected on the object, it may determine that the object is a contactless IC medium and activate the contactless communication function to perform contactless payment (No. of step S7, step S12). In this case, the payment terminal 100 determines that the object is a contactless IC medium (for example, a contactless IC card, a ring-type or pendant-type contactless IC medium, or the side of an electronic terminal (smartphone, etc.) that does not have a display (back, side, etc.)), and therefore can automatically select contactless payment without the user having to select a payment method.

[0061] (Embodiment 2) Figure 4A is a perspective view of the payment terminal 100 according to Embodiment 2. Figure 4B is a cross-sectional view of the payment terminal 100 according to Embodiment 2.

[0062] The payment terminal 100 of this embodiment has a circular housing 10 when viewed from above, and a camera 25 and an NFC antenna 120 are provided on the housing 10. Note that the housing 10 having a circular surface is just one example, and the shape of the housing 10 is arbitrary.

[0063] The payment terminal 100 is equipped with a circular transparent member 132 made of, for example, transparent resin or glass, on the upper surface 13 of the housing 10. The upper surface 13 of the housing 10 is inclined downward from the rear surface 14 of the housing 10 toward the front surface 15 where the user is located. The transparent member 132 is also positioned in a similar inclined state to the upper surface 13 of the housing 10.

[0064] Furthermore, a touch position mark M1 is provided on the transparent member 132 in the center of the transparent member 132, for example, including the center of the transparent member 132. The touch position mark M1 is provided, for example, by printing or pasting. The touch position mark M1 indicates a target position for holding an electronic terminal or the like over the payment terminal 100 during near-field communication (NFC communication) (to guide the user). The touch position mark M1 is, for example, a contactless symbol mark or a ripple mark.

[0065] The camera 25 is installed inside the housing 10 and positioned so that its lens faces the transparent member 132. The NFC antenna 120 is installed in the housing 10 along the edge (outer circumference) of the transparent member 132.

[0066] Next, the positional relationship between the optical axis of the camera 25 and the transparent member 132 will be explained using Figures 4A and 4B.

[0067] The first imaginary line L1 is defined as a straight line extending from the center C1 of the transparent member 132 to the edge of the transparent member 132 on the front surface 15 side. The intersection of the first imaginary line L1 and the edge of the touch position mark M1 is defined as the first point P1. The position on the first imaginary line L1 that is half the length of the first imaginary line L1 from the center C1 of the transparent member 132 is defined as the second point P2. The length of the first imaginary line L1 along the transparent member 132 is A1, and the length from the center C1 to the second point P2 is (A1) / 2.

[0068] In this case, for example, the camera 25 is positioned inside the housing 10 such that the intersection point PA of the optical axis X of the camera 25 and the transparent member 132 is located between the first point P1 and the second point P2 on the first imaginary line L1.

[0069] As a result, the optical axis X of the camera 25 of the payment terminal 100 is positioned closer to the user than the center C1 of the transparent member 132, making it easier to capture the code displayed on the electronic terminal held by the user within the imaging range of the camera 25. Therefore, the payment terminal 100 can perform payment processing while reducing the probability of failing to detect or falsely detecting the displayed code, thereby improving user convenience.

[0070] For the purposes of this example, the camera 25 is positioned such that intersection PA is located between the first point P1 and the second point P2 on the first imaginary line L1, but this is not the only example. The above provision of a length up to half may be defined by other lengths, or it may be determined based on the angle of view or imaging range of the camera 25.

[0071] Figure 5 is a block diagram showing the configuration of the payment terminal 100 according to Embodiment 2. In the payment terminal 100 of Figure 5, components similar to those in the payment terminal 100 of Embodiment 1 shown in Figure 2 are denoted by the same reference numerals, and their descriptions are omitted or simplified.

[0072] The payment terminal 100 comprises a processor 20, an NFC antenna 120, an NFC IC 12, a camera 25, and a memory 22. The functions of each part are the same as in Embodiment 1. The memory 22 also stores mark image information relating to the image of the touch position mark M1. The mark image information may include, for example, the image of the touch position mark M1 itself, as well as information regarding the shape, size, and other characteristics of the touch position mark M1.

[0073] In this embodiment, the camera 25 sequentially captures images. In this case, the camera 25 may capture images sequentially at regular time intervals. The processor 20 sequentially captures images from the camera 25. For each captured image, the processor 20 determines, based on the captured image, whether or not there is an object held in the hand and whether or not there is a display area for the object. If the processor 20 detects that there is a display area for the object in each image, that is, that the object has a display area, it infers that a code is displayed on the display area of ​​the object, i.e., on the display of an electronic terminal such as a smartphone. The processor 20 refers to the mark image information in the memory 22 and extracts code elements based on the captured image for each captured image. In this case, the processor 20 extracts code elements by removing the touch position mark M1 portion from the captured image based on the mark image information for each captured image. The code elements are at least a part of the displayed code. The processor 20 synthesizes the code elements for each captured image to generate one code (the entire displayed code). The processor 20 reads the generated code to obtain code reading information and performs code payment based on the code reading information.

[0074] In other words, the touch position mark M1 is provided on the transparent member 132, and the touch position mark M1 is located between the object and the camera 25. Therefore, even if a code is displayed on the object, the touch position mark M1 and the code may overlap in the captured image. In response to this, the processor 20 extracts multiple code elements at regular time intervals based on images captured by the camera 25 at regular time intervals, and synthesizes the extracted code elements to generate a single code. The code elements are elements that constitute at least a part of the original code (the entire original code that was displayed), and may be included in each image acquired by the camera 25 at regular time intervals.

[0075] Furthermore, as the images are captured sequentially by camera 25, the electronic terminal displaying the code may be moving closer to the payment terminal 100. Therefore, the position of the code relative to camera 25 may change.

[0076] Next, the operation of the payment terminal 100 in this embodiment will be described.

[0077] Figure 6 is a flowchart showing the payment processing procedure by the payment terminal 100 according to Embodiment 2. In Figure 6, the explanation of processes similar to those shown in Figure 3 of the First Embodiment is omitted or simplified.

[0078] The processor 20 turns on the camera 25 (step S21). Based on the captured image, the processor 20 determines whether or not it has detected an object being held in the user's hand (step S22).

[0079] If an object held in the user's hand is detected (step S22; Yes), the processor 20 determines, based on the captured image, whether or not a display area of ​​the object has been detected (step S23).

[0080] If a display area of ​​an object is detected (step S23; Yes), the processor 20 determines that the approaching object is some object capable of displaying a code in its display area, such as an electronic terminal with a display, like a smartphone or tablet. The processor 20 then extracts multiple code elements at regular time intervals based on the captured images at regular time intervals (step S24). The processor 20 synthesizes the extracted code elements to generate a single code and reads the code (step S25).

[0081] The processor 20 determines whether the generated code has been read (step S26). If the code has been read (step S26; Yes), the processor 20 performs the code payment (step S27), turns off the camera 25 (step S28), and terminates the process shown in Figure 6.

[0082] In step S22, if no object is detected being held in the user's hand (step S22; No), the processor 20 determines that the user is not holding anything in their hand and is wearing a contactless IC medium such as a ring, pendant, or watch.

[0083] In step S23, if an object held in the hand is detected but the display area of ​​the object is not detected (step S23; No), the processor 20 determines that the detected object is a contactless IC medium such as a contactless IC card, ring type, pendant type, or watch type, or the side (back, side, etc.) of an electronic terminal (smartphone, etc.) that does not have a display.

[0084] In other words, in this state, the processor 20 determines that the object is an object related to a contactless IC medium unrelated to code payment and performs processing for contactless payment.

[0085] Specifically, if an object held in the user's hand is not detected (step S22; No), or if the display area of ​​an object is not detected (step S23; No), the processor 20 turns off the camera 25 (step S29). The processor 20 turns on the NFC function using the NFC antenna 120 and NFC IC 12 (step S30). Then, the processor 20 performs contactless payment (step S31).

[0086] After the contactless payment is completed, the processor 20 turns off the NFC function (step S32). Then, the process shown in Figure 6 is terminated.

[0087] Note that the processor 20 turns off the camera 25 in step S29, which is before contactless payment, but it is not limited to this, and may also turn off the camera 25 after contactless payment.

[0088] According to this embodiment, the payment terminal 100 sequentially captures images from, for example, the start of payment until the code is placed on the payment terminal 100 while facing the camera 25. The payment terminal 100 has a touch position mark M1 at a position including the center C1 of the transparent member 132, and even if a part of the displayed code overlaps with the touch position mark M1, it can extract multiple code elements at regular time intervals based on the image captured by the camera 25, synthesize these multiple code elements to generate a single code, and enable code payment. Therefore, the payment terminal 100 can automatically switch between code payment and contactless payment without the user having to select a payment method.

[0089] Furthermore, since the payment terminal 100 allows the location for scanning the code and the location for touching the contactless IC medium to be the same, the installation space required for the payment terminal 100 can be reduced.

[0090] In this embodiment, imaging and extraction of multiple code elements are exemplified as occurring at regular time intervals, but this is not limited to this. Multiple imaging and extraction of code elements may be performed at random time differences.

[0091] (Embodiment 3) Figure 7A is a perspective view of the payment terminal 100 according to Embodiment 3 when the touch position mark is displayed. Figure 7B is a perspective view of the payment terminal 100 according to Embodiment 3 when the touch position mark is not displayed. Figure 7C is a cross-sectional view of the payment terminal 100 according to Embodiment 3 when the touch position mark is displayed.

[0092] The payment terminal 100 of this embodiment, like the second embodiment, is equipped with a circular housing 10 when viewed from above, and a camera 25 and an NFC antenna 120 are provided on the housing 10. Note that the housing 10 having a circular surface is just one example, and the shape of the housing 10 is arbitrary.

[0093] The payment terminal 100 has a circular transparent display 134, made of, for example, resin, on the top surface 13 of the housing 10. The top surface 13 of the housing 10 is sloped downward from the rear surface 14 of the housing 10 toward the front surface 15 where the user is located. The transparent display 134 is also positioned at an angle similar to the top surface of the housing 10.

[0094] The transparent display 134 can display or not display the touch position mark M2. The transparent display 134 is composed of a liquid crystal display, an organic EL display, or the like. The transparent display 134 can display various types of data and information, such as characters or graphics. The function of the touch position mark M2 is the same as that of the touch position mark M1 described in the second embodiment.

[0095] The camera 25 is installed inside the housing 10 and positioned so that its lens faces the transparent display 134. The NFC antenna 120 is installed in the housing 10 along the edge (outer periphery) of the transparent display 134.

[0096] Next, the positional relationship between the optical axis of the camera 25 and the transparent display 134 will be explained using Figures 7A to 7C.

[0097] The second imaginary line L2 is defined as a straight line extending from the center C1 of the transparent display 134 to the edge of the front surface 15 of the transparent display 134. The intersection of the second imaginary line L2 and the edge of the touch position mark M2 is defined as the third point P3. The fourth point P4 is defined as being located on the second imaginary line L2 at a position half the length of the second imaginary line L2 from the center C2 of the transparent display 134. The length of the second imaginary line L2 along the transparent display 134 is A2, and the length from the center C2 to the fourth point P4 is (A2) / 2.

[0098] In this case, for example, the camera 25 is positioned inside the housing 10 such that the intersection point PB of the optical axis X of the camera 25 and the transparent display 134 is located between the third point P3 and the fourth point P4 on the second imaginary line L2.

[0099] As a result, the optical axis X of the camera 25 of the payment terminal 100 is positioned closer to the user than the center C2 of the transparent display 134, making it easier to capture the code displayed on the electronic terminal held by the user within the imaging range of the camera 25. Therefore, the payment terminal 100 can perform payment processing while reducing the probability of failing to detect or falsely detecting the displayed code, thereby improving user convenience.

[0100] For the example given, the camera 25 is positioned such that intersection point PB lies between the third point P3 and the fourth point P4 on the second imaginary line L2, but this is not the only example. The above provision of a length up to half may be defined by other lengths, or it may be determined based on the angle of view or imaging range of the camera 25.

[0101] Figure 8 is a block diagram showing the configuration of the payment terminal 100 according to Embodiment 3. In the payment terminal 100 of Figure 8, components similar to those in the payment terminal 100 of Embodiment 1 shown in Figure 2 and the payment terminal 100 of Embodiment 2 shown in Figure 5 are denoted by the same reference numerals, and their descriptions are omitted or simplified.

[0102] The payment terminal 100 includes a processor 20, an NFC antenna 120, an NFC IC 12, a camera 25, a memory 22, and a transparent display 134. The functions of each part are the same as in Embodiment 1.

[0103] In this embodiment, the camera 25 captures an image. The processor 20 captures the image from the camera 25. Based on the captured image, the processor 20 determines whether there is an object held in the hand and whether there is a display area for the object. At this time, the transparent display 134 displays a touch position mark M2, as shown in Figure 7A. If the processor 20 detects that the object has a display area, it hides the touch position mark M2 that was displayed on the transparent display 134, as shown in Figure 7B, and then performs code payment using the code detected from the image.

[0104] In other words, even if the payment terminal 100 sets the position where the code is held up during code payment and the position where the contactless IC medium is touched to the same location, in this case the display position of the touch position mark M2, the touch position mark M2 is not displayed during code payment, thus preventing the code from being read incorrectly due to the touch position mark M2.

[0105] Next, the operation of the payment terminal 100 in this embodiment will be described.

[0106] Figure 9 is a flowchart showing the payment processing procedure by the payment terminal 100 according to Embodiment 3. In Figure 9, the explanation of processes similar to those shown in Figure 3 of the First Embodiment or Figure 6 of the Second Embodiment is omitted or simplified.

[0107] The processor 20 turns on the camera 25 (step S41). Based on the captured image, the processor 20 determines whether or not it has detected an object being held in the user's hand (step S42).

[0108] If an object held in the user's hand is detected (step S42; Yes), the processor 20 determines, based on the captured image, whether or not it has detected a display area for the object (step S43).

[0109] If a display area of ​​an object is detected (step S43; Yes), the processor 20 determines that the approaching object is some object capable of displaying a code in its display area, such as an electronic terminal with a display, like a smartphone or tablet. The processor 20 then hides the touch position mark M2 on the transparent display 134 (step S44). The processor 20 then recognizes the code captured in the image based on the captured image and reads the code.

[0110] The processor 20 determines whether or not the code has been read (step S45). If the code has been read (step S45; Yes), the processor 20 performs the code payment (step S46) and turns off the camera 25 (step S47). Then, the processor 20 displays the touch position mark M2 on the transparent display 134 (step S48) and terminates the process shown in Figure 9.

[0111] In step S42, if no object is detected being held in the user's hand (step S42; No), the processor 20 determines that the user is not holding anything in their hand and is wearing a contactless IC medium such as a ring, pendant, or watch.

[0112] In step S43, if an object held in the hand is detected but the display area of ​​the object is not detected (step S43; No), the processor 20 determines that the detected object is a contactless IC medium such as a contactless IC card, ring type, pendant type, or watch type, or the side (back, side, etc.) of an electronic terminal (smartphone, etc.) that does not have a display.

[0113] In other words, in this state, the processor 20 determines that the object is an object related to a contactless IC medium unrelated to code payment and performs processing for contactless payment.

[0114] Specifically, if an object held in the user's hand is not detected (step S42; No), or if the display area of ​​an object is not detected (step S43; No), the processor 20 turns off the camera 25 (step S49). The processor 20 turns on the NFC function using the NFC antenna 120 and NFC IC 12 (step S50). Then, the processor 20 performs contactless payment (step S51).

[0115] After the contactless payment is completed, the processor 20 turns off the NFC function (step S52). Then, the process shown in Figure 9 is terminated.

[0116] Note that the processor 20 turns off the camera 25 in step S49, which is before contactless payment, but it is not limited to this, and may also turn off the camera 25 after contactless payment.

[0117] According to this embodiment, by switching the display and hiding of the touch position mark M2 using the transparent display 134, it is possible to prevent the touch position mark from interfering with code payments, even if the position where the code is held and the touch position of the contactless IC medium are the same. In other words, the payment terminal 100 can avoid a decrease in code reading accuracy due to the touch position mark M2 overlapping with the code during code payments. Therefore, the payment terminal 100 can automatically switch between code payments and contactless payments without the user having to select a payment method.

[0118] Furthermore, once the code payment is completed, the processor 20 may display a touch position mark M2 on the transparent display 134, such that it includes the center of the transparent display 134. In this case, the user can easily determine the touch position of the electronic medium or contactless IC medium on the payment terminal 100.

[0119] Based on the above, embodiments of this disclosure describe at least the following matters. Note that the components etc. in parentheses are examples of those corresponding to the embodiments described above, but are not limited to these.

[0120] (Item 1) A payment terminal (payment terminal 100) capable of code payment using a code and contactless payment using a contactless communication function with a contactless IC medium, comprising: a camera (camera 25) used for the code payment; an antenna (NFC antenna 120) used for the contactless communication function (NFC function); and a processor (processor 20), wherein the processor activates the camera when payment processing related to payment is started, detects an object held in the hand based on an image captured by the camera (captured image), and if it detects a display area of ​​the object, performs the code payment using the code detected based on the image.

[0121] As a result, even when contactless IC media come in various shapes, the payment terminal can easily and automatically switch between code payment and contactless payment without the user having to select a payment method, by determining whether or not there is an object held in the hand and whether or not there is a display area on that object.

[0122] (Item 2) The payment terminal according to Item 1, wherein the processor, if it does not detect an object held in the hand based on the image, determines that the hand has the contactless IC medium attached, turns on the contactless communication function, and performs the contactless payment.

[0123] This allows the payment terminal to infer that if the user attempting to make a payment is not holding an object in their hand, they are attempting to use a contactless IC medium such as a ring, pendant, or watch, rather than an electronic terminal. Therefore, the payment terminal can automatically select contactless payment even if the user does not select a payment method.

[0124] (Item 3) The payment terminal according to Item 1 or 2, wherein the processor detects the object held in the hand based on the image, and if the display area of ​​the object is not detected, determines that the object is the contactless IC medium, turns on the contactless communication function, and performs the contactless payment.

[0125] This allows the payment terminal to infer that a user attempting to make a payment is holding an object in their hand and has a display area, indicating that they are attempting to make a payment using an electronic device. Therefore, the payment terminal can automatically select contactless payment even if the user does not select a payment method.

[0126] (Item 4) A payment terminal according to any one of Items 1 to 3, further comprising: a housing (housing 10) comprising the camera, the antenna, and the processor; a transparent member (transparent member 132) disposed on the upper surface of the housing and having a touch position mark (touch position mark M1) in the center for guiding the contactless IC medium; and a memory (memory 22) that holds mark image information relating to the image of the touch position mark, wherein the camera is provided inside the housing and is positioned so that its lens faces the transparent member; the antenna is provided in the housing along the edge of the transparent member; the processor sequentially acquires images sequentially captured by the camera; for each of the sequentially acquired images, based on the image, detects the object held in the hand and, if it detects that the object has the display area, refers to the mark image information and extracts code elements contained in the image; synthesizes each code element extracted for each image to generate a single code; and performs the code payment using the generated code.

[0127] As a result, even if part of the code displayed on the electronic terminal overlaps with the touch position mark M1, the payment terminal can reconstruct the original single code based on the images acquired in chronological order. Therefore, the payment terminal 100 can easily and automatically switch between code payment and contactless payment without the user having to select a payment method.

[0128] (Item 5) The payment terminal according to Item 4, wherein the intersection of a first imaginary line (first imaginary line L1) extending from the center (center C1) of the transparent member to the edge on the front (front 15) side of the transparent member and the edge of the touch position mark is defined as the first point (first point P1), the position on the first imaginary line from the center of the transparent member to half the length of the first imaginary line is defined as the second point (second point P2), and the camera is positioned in the housing such that the intersection point (intersection point PA) of the optical axis X of the camera and the transparent member is located between the first point and the second point on the first imaginary line.

[0129] As a result, the payment terminal's camera's optical axis is positioned closer to the user than the center of the transparent material, making it easier to capture the code displayed on the user's electronic device within the camera's imaging range. Therefore, the payment terminal can perform payment processing while reducing the probability of failing to detect or falsely detecting the displayed code, thereby improving user convenience.

[0130] (Item 6) A payment terminal according to any one of Items 1 to 3, further comprising: a housing comprising the camera, the antenna, and the processor; a transparent display (transparent display 134) provided on the upper surface of the housing and capable of displaying a touch position mark (touch position mark M2); the camera being provided inside the housing and positioned so as to face the transparent display; the antenna being provided in the housing along the edge of the transparent display; and the processor activating the camera when the payment process is started, detecting the object held in the hand based on the image, and if the display area of ​​the object is detected, hiding the touch position mark displayed on the transparent display, and then performing code payment using the code detected based on the image.

[0131] This allows the payment terminal to switch between displaying and hiding touch position markers using a transparent display, preventing the touch position markers from interfering with code payments even if the code scanning position and the contactless IC media touch position are the same. Therefore, the payment terminal can easily and automatically switch between code payments and contactless payments without the user having to select a payment method.

[0132] (Item 7) The payment terminal according to Item 6, wherein the processor causes the touch position mark to be displayed on the transparent display in the center of the transparent display when the code payment is completed.

[0133] This allows users to easily remember the touch position of the contactless IC medium after making a code payment, in order to make the next payment.

[0134] (Item 8) A payment terminal according to Item 6 or 7, wherein the intersection of a second imaginary line (second imaginary line L2) extending from the center of the transparent display to the front edge of the transparent display and the edge of the touch position mark is defined as a third point (third point P3), a position on the second imaginary line from the center of the transparent display to half the length of the second imaginary line is defined as a fourth point (fourth point P4), and the camera is positioned in the housing such that the intersection point (intersection point PB) of the optical axis of the camera and the transparent display is located between the first point and the second point on the second imaginary line.

[0135] As a result, the payment terminal's camera's optical axis is positioned closer to the user than the center of the transparent display, making it easier to capture the code displayed on the user's electronic device within the camera's imaging range. Therefore, the payment terminal can perform payment processing while reducing the probability of failing to detect or falsely detecting the displayed code, thereby improving user convenience.

[0136] (Item 9) A payment support method that enables at least code payment using a code and contactless payment using a contactless communication function with a contactless IC medium, wherein when payment processing related to payment is started, a camera used for the code payment is activated, and based on the image captured by the camera, an object held in the hand is detected, and if a display area of ​​the object is detected, the code contained in the image is detected, and the code payment is performed using the code.

[0137] This means that the payment support method will have the same effect as item 1.

[0138] (Item 10) A program to cause a computer to execute the payment support method described in Item 9.

[0139] This means that the payment support method will have the same effect as item 1.

[0140] Although various embodiments have been described above with reference to the drawings, it goes without saying that this disclosure is not limited to such examples. It is clear to those skilled in the art that various modifications or alterations can be conceived within the scope of the claims, and these will naturally also fall within the technical scope of this disclosure. Furthermore, the components of the above embodiments may be combined in any way without departing from the spirit of the invention.

[0141] Furthermore, the above embodiment may also apply to a program that realizes the functions of the above method, which is supplied to a computer (e.g., a payment terminal) via a network or various storage media, and which is read and executed by the processor of this computer, as well as a recording medium on which this program is stored.

[0142] This disclosure is useful for payment terminals, payment support methods, and programs that allow users to easily and automatically switch between code-based payments and contactless payments without having to select a payment method.

[0143] 10 Chassis 13 Top 14 Rear 15 Front 16s First card slot 17s Second card slot 20 Processor 22 Memory 25 Camera 100 Payment terminal 120 NFC antenna (antenna) 130 Touch panel 132 Transparent component 134 Transparent display 140 LCD module M1, M2 Touch position marks

Claims

1. A payment terminal capable of code payment using a code and contactless payment using a contactless communication function with a contactless IC medium, comprising: a camera used for the code payment; an antenna used for the contactless communication function; and a processor, wherein the processor activates the camera when payment processing related to payment is started, detects an object held in the hand based on the image captured by the camera, and if it detects a display area of ​​the object, performs the code payment using the code detected based on the image.

2. The payment terminal according to claim 1, wherein the processor, upon detecting a hand that is not grasping the object based on the image, determines that the hand is attached to the contactless IC medium, turns on the contactless communication function, and performs the contactless payment.

3. The payment terminal according to claim 1, wherein the processor detects the object held in the hand based on the image, and if it does not detect the display area of ​​the object, it determines that the object is the contactless IC medium, turns on the contactless communication function, and performs the contactless payment.

4. A payment terminal according to claim 1, further comprising: a housing comprising the camera, the antenna, and the processor; a transparent member disposed on the upper surface of the housing and having a touch position mark in its center for guiding the contactless IC medium; and a memory for holding mark image information relating to the image of the touch position mark, wherein the camera is provided inside the housing and positioned so as to face the transparent member; the antenna is provided in the housing along the edge of the transparent member; the processor sequentially acquires images sequentially captured by the camera; for each of the sequentially acquired images, based on the image, detects the object held in the hand and, if it detects that the object has the display area, refers to the mark image information and extracts code elements contained in the image; generates a single code by synthesizing each code element extracted for each image; and performs the code payment using the generated code.

5. The payment terminal according to claim 4, wherein the intersection of a first dashed line extending from the center of the transparent member to the front edge of the transparent member and the edge of the touch position mark is defined as the first point, the position on the first dashed line from the center of the transparent member to half the length of the first dashed line is defined as the second point, and the camera is positioned in the housing such that the intersection of the optical axis of the camera and the transparent member is located between the first point and the second point on the first dashed line.

6. A payment terminal according to claim 1, further comprising: a housing comprising the camera, the antenna, and the processor; a transparent display provided on the upper surface of the housing and capable of displaying touch position marks, wherein the camera is provided inside the housing and positioned so as to face the transparent display; the antenna is provided in the housing along the edge of the transparent display; and the processor, when the payment process is started, activates the camera, detects the object held in the hand based on the image, and if it detects the display area of ​​the object, hides the touch position marks displayed on the transparent display, and then performs the code payment using the code detected based on the image.

7. The payment terminal according to claim 6, wherein the processor causes the touch position mark to be displayed on the transparent display in the center of the transparent display when the code payment is completed.

8. The payment terminal according to claim 6, wherein the intersection of a second dashed line extending from the center of the transparent display to the front edge of the transparent display and the edge of the touch position mark is defined as a third point, a position on the second dashed line from the center of the transparent display to half the length of the second dashed line is defined as a fourth point, and the camera is arranged in the housing such that the intersection of the optical axis of the camera and the transparent display is located on the second dashed line between the third point and the fourth point.

9. A payment support method that enables at least code-based payment and contactless payment using a contactless communication function with a contactless IC medium, wherein when payment processing related to payment is started, a camera used for the code-based payment is activated, and based on the image captured by the camera, an object held in the hand is detected, and if a display area of ​​the object is detected, the code contained in the image is detected, and the code-based payment is performed using the code.

10. A program for causing a computer to execute the payment support method described in claim 9.

Images