Information processing device and payment support method

Abstract

To provide an information processor capable of easily guiding a camera for capturing the position of a code displayed on a medium when making a code payment.SOLUTION: The information processor is an information processor capable of paying using a code. The information processor includes: a display unit; an imaging unit that is located near the display unit for picking up an image of the code displayed on a medium; a light source located near the imaging unit; and a control unit that controls the display unit, the imaging unit, and the light source. The light source is configured to emit light before and after the imaging unit starts capturing the code according to the control by the control unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device and a payment support method capable of making payments using a code. [Background technology]

[0002] Conventionally, there are known devices that display guidance when performing code payment. For example, a self-checkout device is known that includes a scanner unit that reads code information to identify the product that the customer is purchasing, and a reader / notifier that is installed near the scanner unit and notifies the customer whether the scanner unit can be operated and its location (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-114341 A Summary of the Invention [Problem to be solved by the invention]

[0004] The self-checkout device in Patent Document 1 can suggest the location of the scanner unit, but in reality, a receipt showing the transaction information in a two-dimensional code is inserted below the position indicated by the reading and notifying means, and the code on the receipt is read. In other words, even if a receipt is held in front of the reading and notifying means, the two-dimensional code on the receipt cannot be read, making it difficult for the reading and notifying means to properly guide the user to the location of the two-dimensional code as transaction information.

[0005] Also, this self-checkout machine has one display device, but does not have multiple display devices. Therefore, this self-checkout machine does not perform code payment while the customer and the store clerk communicate with each other by displaying information for the customer and information for the store. Also, this self-checkout machine recognizes the details of the transaction using a receipt on which a two-dimensional code is printed, but the payment itself is made using cash, card, or electronic money, and does not perform code payment.

[0006] The present disclosure provides an information processing device and a payment support method that can easily guide the position of a medium to a camera that captures an image of a code displayed on the medium during code payment. [Means for solving the problem]

[0007] One aspect of the present disclosure is an information processing device capable of making payments using a code, the information processing device comprising: a display unit; An imaging unit arranged near the display unit and configured to capture an image of a code displayed on the medium; a light source disposed adjacent to the display unit, and a control unit that controls the display unit, the imaging unit, and the light source. The light source starts imaging the code by the imaging unit according to the control by the control unit. Illuminates before and after the start the control unit sequentially acquires images captured by the imaging unit, derives an image range of the code in the captured images, and changes a light emission state of the light source based on the image range of the code. It is an information processing device.

[0008] One aspect of the present disclosure is a payment support method for supporting payment using a code by an information processing device. The information processing device includes a display unit and a display device arranged in the vicinity of the display unit. The code is captured by an imaging unit, and a light source is disposed in the vicinity of the imaging unit. a step of imaging the code by a unit; and and causing the light source to emit light. the information processing device sequentially acquires captured images captured by the imaging unit, derives an image range of the code in the captured images, and changes a light emission mode of the light source based on the image range of the code. It is a payment assistance method. Effect of the Invention

[0009] According to the present disclosure, when making a code payment, the position of the medium can be easily guided to a camera that captures an image of the code displayed on the medium. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a top view showing an example of the appearance of a payment terminal according to a first embodiment; [Diagram 2] FIG. 1 is a side view showing an example of the appearance of a payment terminal; [Diagram 3] A front view showing an example of the appearance of a payment terminal [Figure 4] FIG. 2 is a rear perspective view showing an example of the appearance of the payment terminal; [Diagram 5] FIG. 1 is a block diagram showing an example of the electrical configuration of a payment terminal according to a first embodiment; [Figure 6] FIG. 13 is a diagram showing an example of a mobile terminal on which a code is displayed. [Figure 7A] Flowchart showing an example of the operation of a payment terminal [Figure 7B] Flowchart showing an example of the operation of a payment terminal (continuation of FIG. 7A) [Figure 8] A flowchart showing a first modified example of the operation of the payment terminal. [Figure 9] A flowchart showing a first modified example of the operation of the payment terminal. [Figure 10] First presentation example of camera position in the first embodiment [Figure 11] Second Presentation Example of Camera Position in First Embodiment [Figure 12] Third presentation example of camera position in the first embodiment [Figure 13] Fourth presentation example of camera position in the first embodiment [Figure 14] Fifth Presentation Example of Camera Position in First Embodiment [Figure 15] Sixth Presentation Example of Camera Position in First Embodiment [Figure 16] A diagram showing an example of guidance information presented to customers [Figure 17] FIG. 11 is a diagram showing a first example of guidance information presented to a store clerk. [Figure 18]FIG. 2 is a diagram showing a second example of how guidance information is presented to a store clerk. [Figure 19] FIG. 3 is a diagram showing a third example of how guidance information is presented to store clerks. [Figure 20] FIG. 13 is a schematic diagram showing an example of the appearance of a payment terminal according to a second embodiment; [Figure 21] FIG. 1 is a front perspective view showing an example of the appearance of a customer terminal; [Figure 22] FIG. 1 is a schematic cross-sectional view showing an example of a customer terminal as seen from the side; [Figure 23] FIG. 13 is a block diagram showing an example of the electrical configuration of a payment terminal according to a second embodiment. [Figure 24] First presentation example of camera position in the second embodiment [Diagram 25] Second presentation example of camera position in the second embodiment [Figure 26] Third presentation example of camera position in the second embodiment [Figure 27] Fourth presentation example of camera position in the second embodiment [Figure 28] Fifth Presentation Example of Camera Position in Second Embodiment [Figure 29] Sixth Presentation Example of Camera Position in Second Embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] (First embodiment) Fig. 1 is a top view showing an example of the appearance of payment terminal 100 in the first embodiment. Fig. 2 is a side view showing an example of the appearance of payment terminal 100. Fig. 3 is a front view showing an example of the appearance of payment terminal 100. Fig. 4 is a rear perspective view showing an example of the appearance of payment terminal 100.

[0013] The payment terminal 100 has a main body 10. The main body 10 has, for example, a generally box-like shape. Figures 1, 2, and 3 show a front surface 1A, a side surface 1B, a side surface 1C, and a rear surface 1D of the payment terminal 100. For example, a purchaser (customer) of a product operates the payment terminal 100 from the front surface 1A. For example, a store clerk who registers the purchase of a product operates the payment terminal 100 from the rear surface 1D. The customer may be a customer of the store. The payment terminal 100 is a stationary terminal that is placed on a placement surface α or the like of a placement stand in a store.

[0014] The payment terminal 100 includes a first touch panel 12, a first LED (light emitting diode) 13, an NFC (Near field communication) antenna 15, a first card slot 16s, a second card slot 17s, a camera 25, and a light source LS on the front surface 1A side. The payment terminal 100 includes a second touch panel 22 and a second LED 23 on the rear surface 1D side.

[0015] The payment terminal 100 is a composite type that allows a customer to specify multiple payment methods. The payment terminal 100 may be used, for example, in a state in which it is placed on a placement surface α on a counter in a store.

[0016] The multiple payment methods include, for example, credit card payment, electronic money payment, code (e.g., QR code (registered trademark)) payment, and cash payment. Credit card payment includes, for example, magnetic card payment, contact IC card payment, and contactless IC card payment. There may be multiple types of electronic money. Electronic money payment and contactless IC card payment are made using contactless communication (e.g., near field communication (NFC)), and are therefore collectively referred to here as contactless payment.

[0017] The multiple payment methods are performed using multiple corresponding payment interfaces. The multiple payment interfaces include, for example, a credit card, an electronic money card C32, a code, and cash. The credit card includes, for example, a magnetic card C1, a contact IC card C2, and a contactless IC credit card C31.

[0018] The magnetic card C1 is inserted into the first card slot 16s and used for payment. The contact IC card C2 is inserted into the second card slot 17s and used for payment. The contactless IC credit card C31 and the electronic money card C32 are used for payment by bringing them close to the NFC antenna 15. The contactless IC credit card C31 and the electronic money card C32 are collectively referred to as the "contactless IC card C3."

[0019] In the payment terminal 100, a first card slot 16s, a second card slot 17s, and a first touch panel 12 are arranged in this order from the vicinity of the placing surface α in the height direction from the placing surface α. An NFC antenna 15 is arranged around the first touch panel 12.

[0020] In addition, the first card slot 16s, the second card slot 17s, the first touch panel 12, and the NFC antenna 15 are arranged together on the front surface 1A side of the payment terminal 100 facing the customer. In this case, the customer can easily select one of the multiple payment methods corresponding to the multiple devices lined up in front of them. Since multiple devices corresponding to multiple payment methods are gathered in one place, payment according to each payment method can be smoothly executed.

[0021] In addition, a second touch panel 22 is disposed on the payment terminal 100. The second touch panel 22 is used by, for example, a store clerk, and is disposed on the rear surface 1D side facing the store clerk. In the payment terminal 100, the first touch panel 12 and the second touch panel 22 are disposed facing each other.

[0022] Furthermore, when viewed from the side, the upper part of payment terminal 100 has a mountain shape (see FIG. 2). The mountain shape has a first side and a second side. The first side has the surface of first touch panel 12 and is the operation surface used by customers to make payments. The second side has the surface of second touch panel 22 and is the operation surface used by store clerks to make payments.

[0023] With this configuration, the payment terminal 100 placed on the placement surface α can be operated simultaneously by a customer and a store clerk who are facing each other. For example, if the payment terminal 100 is installed on a counter in a store, the store clerk who is positioned inside the counter and the customer who is positioned outside the counter can operate the payment terminal 100 while facing each other.

[0024] In addition, the payment terminal 100 has a camera 25, a first LED 13, and a light source LS (for example, light source LS1) arranged on the front surface 1A side. The camera 25 and the first LED 13 may be arranged on the front surface 1A side on the rear surface 1D side of the first touch panel 12, that is, on the top side of the mountain shape, but the arrangement position is not limited to this. The light source LS is arranged near the camera 25. For example, the light source LS1 is arranged in a state of being separated from the camera 25 and in a state of being in the vicinity of the camera 25. The light source LS1 may be formed in any shape, for example, a perfect circle shape, an ellipse shape, a rectangular shape, other geometric shapes, or other shapes. The light source LS1 may be formed to imitate the shape of a Patlite (registered trademark) so that it is easy to understand that the position of the camera 25 is notified. The light source LS and the first LED 13 may be integrally formed and arranged in the vicinity of the camera 25.

[0025] Furthermore, a second LED 23 is arranged on the rear surface 1D side of the payment terminal 100. The second LED 23 may be arranged on the rear surface 1D side closer to the front surface 1A than the second touch panel 22, that is, on the top side of the mountain shape, but the arrangement position is not limited thereto.

[0026] Although the first touch panel 12 and the second touch panel 22 are shown as input means for the store clerk and the customer, the payment terminal 100 may be provided with other input means (for example, physical keys or buttons).

[0027] Furthermore, payment terminal 100 has a security protection area SR (see FIG. 5) in a part of payment terminal 100. Security protection area SR is an area with higher security than areas of payment terminal 100 other than security protection area SR. For example, security protection area SR is tamper-resistant. Security of security protection area SR may be logically increased by software processing, or may be physically increased by hardware structure or mechanism. Components used in payment processing are mainly stored in security protection area SR.

[0028] Furthermore, the payment terminal 100 includes, for example, a speaker 24, a printer 26, a printer outlet 26p, and an external terminal 27 on the rear surface side (the surface side in contact with the placement surface α) shown in FIG.

[0029] FIG. 5 is a block diagram showing an example of the electrical configuration of payment terminal 100. As shown in FIG.

[0030] Payment terminal 100 has a security protection area SR. Within security protection area SR, payment terminal 100 includes a first CPU (Central Processing Unit) 11, a first touch panel 12, a first LED 13, an NFC_IC 14, an NFC antenna 15, a first card reader 16, a second card reader 17, and a memory 18. Outside security protection area SR, payment terminal 100 includes a second CPU 21, a second touch panel 22, a second LED 23, a speaker 24, a camera 25, a printer 26, an external terminal 27, a memory 28, and a light source LS.

[0031] The first CPU 11 realizes various functions by executing programs stored in the memory 18. The first CPU 11 comprehensively controls each part in the security protection area SR. The first CPU 11 performs processes related to credit card payment and electronic money payment, for example. The first CPU 11 functions as a payment CPU that performs processes related to payment. The first CPU 11 also transmits and receives data to and from the second CPU 21, and cooperates with the second CPU 21. The first CPU 11 is an example of a processor, and may be another processor.

[0032] The first touch panel 12 has an input detection function that electrically detects contact or proximity of a customer's finger (an example of an object) as an input (input operation). The first touch panel 12 accepts, for example, an input operation by a customer. The first touch panel 12 accepts, for example, a PIN input operation for credit card payment or an electronic signature operation.

[0033] The first touch panel 12 also displays camera position identification information for the customer to identify (recognize) the position of the camera 25. The first touch panel 12 displays the camera position identification information, for example, when the customer needs to hold the mobile terminal 200 on which the code CD is displayed over the camera 25 during code payment. Code payment is a payment using a code such as a two-dimensional code. The camera position identification information includes, for example, a camera mark CM imitating the camera 25 and arrow information AR (for example, AR1, AR2, ...) indicating the direction of the camera 25. The mobile terminal 200 is, for example, a smartphone, a tablet terminal, or another mobile terminal, and has a display surface 200D that displays the code CD. The first touch panel 12 may display a preview image based on a captured image captured by the camera 25.

[0034] The first touch panel 12 may display the camera position identification information in various display modes. The display modes may include, for example, a display color (e.g., red, green, blue), a display timing (e.g., timing described below), a display pattern (e.g., always displayed, blinking, always hidden), a gradation display, and the like. The display timing includes a predetermined display timing (e.g., during a payment process), and particularly includes when the payment terminal 100 reads the code CD displayed on the mobile terminal 200, when the camera 50 captures the code CD, and the like. Furthermore, the first touch panel 12 may change the display mode of the camera position identification information when the camera 25 has succeeded or failed in reading the code CD.

[0035] The first touch panel 12 also displays guidance information GI1 that guides the placement method (e.g., placement position, placement distance, placement posture, placement duration time) of the mobile terminal 200 relative to the payment terminal 100 (e.g., the camera 25) during code payment. The guidance information GI1 may include, for example, an image indicating that the mobile terminal 200 should be brought closer to the camera 25, or information on a specific placement method. The information on a specific placement method may include, for example, information such as "the camera is located where the light source is lit (blinking)" or "please move the mobile terminal further away (closer)". By checking the guidance information GI1, the customer can check how to bring the mobile terminal 200 closer to the camera 25. Note that, during actual code payment, the customer may find it difficult to check the guidance information GI1 or may forget to check the guidance information GI1. Note that the guidance information GI1 does not need to include a preview image.

[0036] The first LED 13 displays various information. The first LED 13 may display in various display modes. The display modes may include, for example, a display color (e.g., red, green, blue), a display timing (e.g., display during payment processing, when payment is completed), and a display pattern (e.g., on, blinking, off).

[0037] The light source LS emits light to notify the customer of the location of the camera 50. The light source LS may be displayed in various light emission modes (display modes). The light emission modes may include, for example, a light emission color (e.g., red, green, blue), a light emission timing (e.g., timing described below), and a light emission pattern (e.g., on, blinking, off). The light emission timing includes a predetermined light emission timing (e.g., during a payment process), and particularly includes when the code CD is imaged by the camera 50 when the payment terminal 100 reads the code CD displayed on the mobile terminal 200, or when the code CD is placed in a position where it can be read by the camera 25. The light source LS may also change its display mode when the camera 25 succeeds or fails to read the code CD.

[0038] The customer faces the display surface 200D (see FIG. 6) of the mobile terminal 200 to the camera 25 to allow the camera 25 to capture an image, which may result in a state in which it is difficult for the customer to directly view the display surface 200D of the mobile terminal 200. Even in this case, the customer can check the positioning state of the code CD displayed on the mobile terminal 200 relative to the camera 25 by checking the light emission state of the light source LS1 and the display of the card position specifying information.

[0039] The NFC_IC 14 performs processing for the NFC antenna 15. For example, the NFC_IC 14 controls the power supply to the NFC antenna 15 and data communication via the NFC antenna 15.

[0040] The NFC antenna 15 is formed of, for example, a loop coil. The NFC antenna 15 receives power from the NFC_IC 14 and generates radio waves. An area within a predetermined distance from the NFC antenna 15 is an area where non-contact communication with the NFC antenna 15 is possible (non-contact communicable area). When a non-contact IC card C3 (an example of a communication medium capable of non-contact communication) is placed in the non-contact communicable area, radio waves from the NFC antenna 15 reach the non-contact IC card C3, and the NFC antenna 15 provides activation power to the non-contact IC card C3. As a result, the NFC antenna 15 communicates data with the non-contact IC card C3.

[0041] Furthermore, the center position of the surface defined by the NFC antenna 15 may approximately coincide with the center position of the surface defined by the first touch panel 12. This allows data to be communicated between the NFC antenna 15 and the non-contact IC card C3 by holding the non-contact IC card C3 over the first touch panel 12, making the operation easier for the user to understand.

[0042] The NFC_IC14 acquires (reads) information held by the contactless IC credit card C31 via the NFC antenna 15. The NFC_IC14 sends this information to the first CPU11 as contactless read information. The information held by the contactless IC credit card C31 and the contactless read information include, for example, the identification number of the credit card. The NFC_IC14 also acquires (reads) information held by the electronic money card C32 via the NFC antenna 15. The NFC_IC14 sends this information to the first CPU11 as electronic money read information. The information held by the electronic money card C32 and the electronic money read information include, for example, the identification number of the electronic money card C32.

[0043] The first card reader 16 is a magnetic card reader. The first card reader 16 reads information held by the magnetic card C1 and sends the read information as magnetically read information to the first CPU 11. The information held by the magnetic card C1 and the magnetically read information include, for example, a credit card identification number.

[0044] The second card reader 17 is a contact IC card reader. The second card reader 17 reads information held by the contact IC card C2 and sends the read information as contact read information to the first CPU 11. The information held by the contact IC card C2 and the contact read information include, for example, a credit card identification number.

[0045] The memory 18 may be configured to include, for example, a read only memory (ROM) and a random access memory (RAM). The memory 18 has various data, information, and programs.

[0046] The second CPU21 realizes various functions by executing programs stored in the memory 28. The second CPU21 comprehensively controls each part outside the security protection area SR. The second CPU21 performs, for example, processing related to code payment and cash payment, and processing related to non-payment. Therefore, the second CPU21 functions as a general-purpose CPU that performs general-purpose processing. In addition, the second CPU21 transmits and receives data to and from the first CPU11, and cooperates with the first CPU11. The second CPU21 is an example of a processor, and may be another processor. In addition, the second CPU21 may have higher performance than the first CPU11.

[0047] The second CPU21 obtains, from the camera 25, a captured image of a subject displayed on the mobile terminal 200. The second CPU21 analyzes the captured image and recognizes identification information required for payment indicated by the code. The second CPU21 performs payment processing related to the code payment using the identification information. The second CPU21 performs various processes to support the code payment.

[0048] The second CPU21 controls the display of the camera position identifying information and the guidance information GI1. When the second CPU21 displays the camera position identifying information and the guidance information GI1 on the first touch panel 12, the second CPU21 sends the camera position identifying information and the guidance information GI1 to the first CPU11 and instructs the first touch panel 12 to display the camera position identifying information and the guidance information GI1. The first touch panel 12 displays the camera position identifying information and the guidance information GI1 according to the instruction from the second CPU21 via the first CPU11.

[0049] The second CPU21 controls the display of guidance information GI2 for advising the customer on the camera position. The guidance information GI2 includes information for the store clerk to advise the customer on how to adjust the position of the code CD displayed on the mobile terminal 200 relative to the camera 25. When displaying the guidance information GI2 on the second touch panel 22, the second CPU21 instructs the guidance information GI2 to display a payment support image SG2. The second touch panel 22 displays the guidance information GI2 according to the instruction from the second CPU21.

[0050] The guidance information GI2 may include information for the store clerk to guide the customer on how to position the mobile terminal 200 relative to the payment terminal 100 (e.g., camera 25) during code payment (e.g., position, distance, attitude, duration of position). By checking the guidance information GI2, the store clerk can advise the customer on how to perform code payment using the mobile terminal 200.

[0051] The second touch panel 22 accepts input operations by, for example, a store clerk. For example, the price of a product purchase and the number of products to be purchased are input. The second CPU 21 calculates the payment amount based on, for example, the price of the product and the number of products to be purchased. The second touch panel 22 may also accept direct input of the payment amount. The second CPU 21 may obtain information on the payment amount from a POS, which is an external device, via a communication unit described later. The configuration of the second touch panel 22 may be the same as that of the first touch panel 12.

[0052] The second LED 23 displays various information. The second LED 23 may display in various display modes. The display mode may include, for example, a display color (e.g., red, green, blue), a display timing (e.g., display when purchasing information is input), and a display pattern (e.g., on, blinking, off).

[0053] The speaker 24 outputs various sounds. For example, the speaker 24 outputs sounds related to the processing in the payment terminal 100. For example, the speaker 24 may verbalize at least a part of the guidance information GI1 displayed by the first touch panel 12 and output it as a voice message during code payment.

[0054] The camera 25 captures an image of a subject and obtains a captured image. For example, the camera 25 captures an image of a code displayed on the mobile terminal 200 of the customer and transmits the captured image to the second CPU 21.

[0055] Printer 26 outputs, for example, information on a paper medium related to a process (for example, a payment process) in payment terminal 100. For example, printer 26 may print out the result of the payment process on a receipt or the like after the payment process.

[0056] The external terminal 27 can be connected to various cables (e.g., a LAN (Local Area Network) cable, a USB (Universal Serial Bus) cable, etc.). Therefore, the external terminal 27 can be connected to various external devices (e.g., a POS, a cash drawer) via various cables and can communicate with them. Therefore, the external terminal 27 functions as a communication unit. Note that the communication unit may perform wireless communication (e.g., wireless LAN communication, Bluetooth (registered trademark) communication) without going through the external terminal 27.

[0057] The memory 28 may be configured to include, for example, a ROM and a RAM, and has various data, information, and programs.

[0058] Next, an example of the operation of payment terminal 100 will be described. 7A and 7B are flowcharts showing an example of the operation of payment terminal 100. The processing in Fig. 7A and 7B is started, for example, when any product is purchased.

[0059] First, the second touch panel 22 displays a payment method selection screen for selecting a payment method (S11). The second CPU 21 designates the payment method (S12). In this case, for example, a store clerk operates the second touch panel 22, the second touch panel 22 accepts an input operation, and the second CPU 21 designates the payment method in response to this input operation. The payment method may be designated by the customer.

[0060] If code payment is specified as the payment method, the second CPU21 continues the payment process according to the code payment method. The second CPU21 displays a screen for inputting the payment amount on the second touch panel 22. The second CPU21 obtains information on the payment amount, for example, by accepting an input operation of the payment amount from a store clerk via the second touch panel 22.

[0061] In the payment process for code payment, the second CPU21 may cause the first touch panel 12 to display guidance information GI1 via the first CPU11 (S14).

[0062] Further, the second CPU 21 may cause the speaker 24 to output the guidance information GI1 by voice (S14). By outputting the guidance information GI1 by voice, the customer can understand how to arrange the mobile terminal 200 relative to the payment terminal 100 (e.g., the camera 25) without visually checking the display surface 200D of the mobile terminal 200 to confirm how the mobile terminal 200 is arranged relative to the camera 25.

[0063] In addition, the second CPU 21 causes the light source LS to emit light (S15). This makes it easier for the customer to recognize the camera 25 located near the light source LS, and makes it easier for the customer to grasp the positional relationship between the camera 25 and the mobile terminal 200.

[0064] The second CPU21 activates the camera 25 (S16). The customer adjusts his / her posture so that the display surface 200D on which the code CD is displayed faces the camera 25, and holds the code CD over the camera 25. The second CPU21 acquires an image (captured image) captured by the camera 25 (S17). The second CPU21 performs image analysis on the captured image and attempts to read the code CD in the captured image. The second CPU21 determines whether reading the code CD has succeeded (OK) or failed (NG) (S18). For example, reading the code CD may fail if the captured image does not include the code CD, or if the size of the code CD in the captured image is larger than the maximum size threshold or smaller than the minimum size threshold for code readability.

[0065] If it is determined that reading of the code CD has failed (No in step S18), the second CPU21 may cause the first touch panel 12 to display the guidance information GI1 again (S19). The payment support image SG1 here may be the same as or different from the guidance information GI1 in step S13. The second CPU21 may also cause the speaker 24 to output the guidance information GI1 as audio again (S20). The payment support message here may be the same as or different from the guidance information GI1 in step S14.

[0066] The customer checks the guidance information GI1 displayed again or the guidance information GI1 output again as voice, adjusts the position and attitude again so that the display surface 200D on which the code CD is displayed faces the camera 25, and holds the code CD over the camera 25 again. The second CPU 21 acquires an image captured by the camera 25 (captured image). The second CPU 21 performs image analysis on the captured image and attempts to read the code CD in the captured image. At this time, the second CPU 21 changes the light emission (e.g., light emission mode) of the light source LS according to, for example, the positional relationship between the camera 25 and the code CD, that is, according to a change in the position of the code CD relative to the camera 25 (S21). Note that the positional relationship between the camera 25 and the code CD may be derived (e.g., calculated) from the position or size of the code CD included in the captured image (i.e., the image range of the code CD). The second CPU 21 may derive (e.g., calculate) the image range of the code CD by performing image analysis on the captured image. Here, for example, when the distance between the camera 25 and the code CD becomes equal to or shorter than a predetermined distance, the second CPU 21 may notify the customer that the mobile terminal 200 is approaching the camera 25 by changing the light emission mode of the light source LS (for example, changing from blinking to lighting). Note that the above-mentioned distance equal to or shorter than the predetermined distance may be a distance at which the code can be read.

[0067] For example, the second CPU21 may control the light source LS to emit light in a first color when the distance between the camera 25 and the cord CD is longer than a predetermined distance, to emit light in a second color when the distance between the camera 25 and the cord CD is shorter than the predetermined distance, and to emit light in a third color when it is necessary to change the orientation of the cord CD relative to the camera 25. For example, the second CPU21 may control the light source LS to blink at a first time interval when the distance between the camera 25 and the cord CD is longer than a predetermined distance, and to blink (including lighting) at a second time interval shorter than the first time interval when the distance between the camera 25 and the cord CD is shorter than the predetermined distance.

[0068] After the process of step S21, the process proceeds to step S18. When the process proceeds from step S21 to step S18, the second CPU21 judges again whether reading of the code CD has succeeded or failed (S18). That is, in step S18, it is judged whether reading of the code CD has succeeded for the first time or for the second time or thereafter. The second CPU21 may repeatedly execute the processes of steps S18 to S21 until the code reading is successful.

[0069] If it is determined in step S18 that the code CD has been successfully read (No in S18), the second CPU21 stops emitting light from the light source LS (i.e., turns it off) (S22). This is because the customer does not need to know the position of the camera 25. Also, if it is determined that the code CD has been successfully read, the second CPU21 may stop emitting light from the light source LS after emitting light in a color that indicates successful reading. The second CPU21 displays code reading completion information indicating that the code reading has been completed on the first touch panel 12 via the first CPU11 (S23). As a result of the successful reading of the code CD, the identification information indicated by the code CD is acquired as the code reading information.

[0070] The second CPU21 cooperates with an external server (for example, a server of a payment center) for performing code payment, and performs payment processing using the code read information (server cooperation processing) (S24).

[0071] In the server linkage process, for example, the following process is performed. The second CPU21 transmits payment request information including the code reading information and the payment amount to the external server via a communication unit (for example, external terminal 27). The external server receives the payment request information from the payment terminal 100, collates it with information held by the external server, subtracts the payment amount from the retained amount associated with the identification number indicated by the code CD, sets the subtraction result as the new retained amount, and completes the transaction for purchasing the product. The external server transmits a payment completion notification to the payment terminal 100. When the second CPU21 receives the payment completion notification via the communication unit, it completes the server linkage process. The flow of the server linkage process is not limited to this example.

[0072] When the server linkage process for code payment is completed, the second CPU21 displays on the second touch panel 22 a completion confirmation screen showing information on whether or not to complete the payment, and accepts a payment completion operation (S25). The second CPU21 completes the entire payment process shown in Figures 7A and 7B by accepting, as a payment completion operation, for example, an operation to complete the payment from the store clerk via the second touch panel 22. The second CPU21 displays, via the first CPU11, on the first touch panel 12 a payment completion screen indicating that the payment is completed (the entire payment process is completed) (S26).

[0073] In step S12, if a payment method other than code payment (e.g., credit card payment, electronic money payment, cash payment) is specified, the first CPU 11 or the second CPU 21 performs payment processing according to each payment method in cooperation with an external server (e.g., a server of a payment center) as necessary (S27). This payment processing may be a known payment processing, and may use, for example, read information from various cards.

[0074] According to such an operation during payment processing, the payment terminal 100 can clearly indicate the position of the camera 25 to the customer by emitting light from the light source LS during payment processing, specifically, by emitting light from the light source LS before and after the camera 25 starts capturing the image of the code CD. For example, the light emission from the light source LS is changed in step S21 after the image capture, so the light source LS emits light before and after the image capture starts. In addition, the light emission from the light source LS before and after the image capture starts may be continued as the light emission from the light source LS after the image capture, or the light emission from the light source LS after the image capture may be performed again after the light emission from the light source LS before the image capture ends. In addition, the payment terminal 100 can indicate the positional relationship between the camera 25 and the mobile terminal 200 by changing the light emission state of the light source LS according to the movement of the mobile terminal 200. Therefore, the customer can easily grasp the position of the camera 25 and the positional relationship between the camera 25 and the mobile terminal 200, and can easily hold the mobile terminal 200 over the camera 25, which allows the code payment processing to be performed smoothly.

[0075] Fig. 8 is a flowchart showing a first modified example of the operation of payment terminal 100. In Fig. 8, the same processes as those in Fig. 7A and Fig. 7B are given the same step numbers, and the description thereof will be simplified or omitted.

[0076] 8 differs from the operation example shown in Figures 7A and 7B in that in step S15A corresponding to step S15 and step S21A corresponding to step S21, the second CPU21, via the first CPU11, causes the light source LS to emit light in step S15 and causes the first touch panel 12 to display camera position identifying information. In other words, the payment terminal 100 may simultaneously cause the light source LS to emit light and the camera position identifying information to be displayed.

[0077] Also, in step S21A, similar to the change in the light emission mode of the light source LS, the second CPU21 changes the display (e.g., the display mode) of the camera position identification information, for example, according to the positional relationship between the camera 25 and the cord CD, that is, according to a change in the position of the cord CD relative to the camera 25.

[0078] For example, the second CPU 21 may control the first touch panel 12 to display in a first color when the distance between the camera 25 and the cord CD is longer than a predetermined distance, to display in a second color when the distance between the camera 25 and the cord CD is shorter than the predetermined distance, and to display in a third color when it is necessary to change the orientation of the cord CD relative to the camera 25. For example, the second CPU 21 may control the first touch panel 12 to flash at a first time interval when the distance between the camera 25 and the cord CD is longer than the predetermined distance, and to flash (including lit) at a second time interval shorter than the first time interval when the distance between the camera 25 and the cord CD is shorter than the predetermined distance.

[0079] This allows the customer to identify the position of camera 25 by checking the emission state of light source LS as well as the display of camera position identification information. Furthermore, payment terminal 100 can indicate the positional relationship between camera 25 and mobile terminal 200 by changing the light emission state of light source LS and the display state of camera position identification information in response to the movement of mobile terminal 200. Therefore, in the case of Fig. 8, the customer can more easily grasp the position of camera 25 during code payment compared to the operation examples of Figs. 7A and 7B.

[0080] Fig. 9 is a flowchart showing a second modified example of the operation of payment terminal 100. In Fig. 9, the same processes as those in Fig. 7A and Fig. 7B or Fig. 8 are given the same step numbers, and the description thereof will be simplified or omitted.

[0081] The second modified example shown in Fig. 9 differs from the first modified example shown in Fig. 8 in that, if code reading fails in step S18, the second CPU21 changes the light emission of the light source LS and the display of arrow information, etc. Specifically, in response to the failure of code reading, the second CPU21 changes the light emission of the light source LS, and changes the display of camera specific position information on the first touch panel 12 via the first CPU11 (S28).

[0082] For example, the second CPU21 may change the light emission mode of the light source LS (e.g., change the light emission color) before and after the code reading failure, or change the display mode of the camera position identification information before and after the code reading failure. Changing the light emission mode of the light source LS may include, for example, changing the light emission color from a first color to a second color. Changing the display mode of the camera position identification information may include, for example, changing the color of the arrow from a first color to a second color, making the size of the arrow after the code reading NG larger than the size of the arrow before the code reading NG, or changing the gradation of the arrow. Changing the display mode of the camera position identification information may include, for example, changing the color of the camera mark CM from a first color to a second color, making the size of the camera mark CM after the code reading NG larger than the size of the camera mark CM before the code reading NG, or changing the gradation of the camera mark CM. The second CPU21 may increase the color after the code reading failure.

[0083] This allows the customer to identify the location of camera 25 by checking the display of camera position identification information together with the emission status of light source LS when code reading fails. Since there are cases where the placement of mobile terminal 200 relative to camera 25 is not optimal when code reading fails, it is very useful to assist the customer in identifying the camera position. Therefore, in the case of Fig. 9, the customer can more easily grasp the location of camera 25 when making a code payment compared to the operation examples of Figs. 7A and 7B.

[0084] Next, examples of presenting the position of camera 25 (camera position) will be described. Here, first to sixth presentation examples are shown, but the position of camera 25 may be presented in other ways. Note that the first to sixth presentation examples are other presentation examples different from the example of presenting the camera position by light emission from light source LS1 shown in FIG. 1. The camera position is presented by at least one of light emission from light source LS and display of camera position identification information.

[0085] FIG. 10 is a diagram showing a first presentation example of the camera position. In FIG. 10, unlike FIG. 1, a light source LS2 is provided as an example of the light source LS. The light source LS2 is formed in a circular ring shape along the outer periphery of the camera 25. The light source LS2 may emit light in the same light emission manner (e.g., light emission color, light emission timing, light emission pattern) as the light source LS1. Also, in FIG. 10, as an example of the arrow information AR, the arrow information AR1 is displayed on the first touch panel 12. The arrow information AR indicates the direction from the position where the arrow information AR is displayed toward the camera 25 with an arrow. The light emission color of the light source LS and the display color of the arrow information AR may be different colors or may be the same color. If they are the same color, there is a sense of unity, so the light source LS and the arrow information AR can indicate the position of the camera 25 together, making it easier to grasp the camera position. Also, in FIG. 10, the arrow information AR1 is displayed by emitting light uniformly within one arrow without gradation. By having settlement terminal 100 emit light from light source LS2 and display arrow information AR1 at the same time, the customer can grasp the position of camera 25 more easily.

[0086] Fig. 11 is a diagram showing a second presentation example of the camera position. In Fig. 11, a light source LS2 is provided as in Fig. 10. Also, in Fig. 11, as an example of the arrow information AR, arrow information AR2 is displayed on the first touch panel 12. The arrow information AR2 is displayed with a gradation and illuminated unevenly within one arrow. Therefore, the payment terminal 100 simultaneously illuminates the light source LS2 and displays the arrow information AR1, and further displays the arrow with a gradation, so that the customer can more easily grasp the position of the camera 25.

[0087] FIG. 12 is a diagram showing a third presentation example of the camera position. In FIG. 12, similarly to FIG. 10, a light source LS2 is provided, and arrow information AR1 is displayed on the first touch panel 12. Also, in FIG. 12, a camera mark CM is displayed on the tip side of the arrow of the arrow information AR1 on the first touch panel 12. The tip of the arrow of the arrow information AR1 faces the camera 25 side. The camera mark CM is displayed at a position facing the camera 25 on the first touch panel 12. Therefore, the light source LS2, the camera mark CM, and the arrow information AR are arranged in a straight line. Therefore, the payment terminal 100 simultaneously emits light from the light source LS2, displays the arrow information AR1, and displays the camera mark CM, so that the customer can more easily grasp the position of the camera 25.

[0088] Fig. 13 is a diagram showing a fourth presentation example of the camera position. In Fig. 13, the light source LS is not provided, and the arrow information AR1 is displayed on the first touch panel 12. Even if only the arrow information AR1 is displayed, the customer can easily grasp the position of the camera 25.

[0089] Fig. 14 is a diagram showing a fifth presentation example of the camera position. In Fig. 14, the light source LS is not provided, and the arrow information AR2 is displayed on the first touch panel 12. Even in this case, the customer can easily grasp the position of the camera 25.

[0090] Fig. 15 is a diagram showing a sixth presentation example of the camera position. In Fig. 15, the light source LS is not provided, and the camera mark CM and the arrow information AR1 are displayed on the first touch panel 12. Even in this case, the payment terminal 100 can clearly show that the camera 25 is in the direction indicated by the arrow of the arrow information AR1, by the camera mark CM and the arrow information AR1. Therefore, the customer can easily understand the position of the camera 25.

[0091] Next, the presentation of the guide information GI1 will be described.

[0092] Fig. 16 is a diagram showing an example of how guidance information GI1 is presented to a customer. Fig. 16 illustrates an example in which first touch panel 12 displays guidance information GI1 that indicates how mobile terminal 200, on which code CD is displayed, should be held over payment terminal 100 (camera 25). Note that speaker 24 may output at least a part of guidance information GI1 as audio.

[0093] Next, the presentation of the guidance information GI2 to the store clerk will be described.

[0094] The second touch panel 22 displays guidance information GI2 for the store clerk. The guidance information GI2 is information for the store clerk to advise the customer on how to adjust the position of the code CD displayed on the mobile terminal 200 relative to the camera 25. The guidance information GI2 may include information indicating an operation method as viewed from the customer facing the store clerk. For example, assume that guidance information GI1 instructing the customer to "move the mobile terminal 200 further to the right" is displayed on the first touch panel 12. In this case, the mobile terminal 200 is moved to the left as viewed from the store clerk facing the customer, but guidance information GI2 instructing the customer to "instruct the customer to move the mobile terminal 200 further to the right" may be displayed on the second touch panel 22 in the same manner as the guidance information GI1. The second CPU 21 may display the guidance information GI2 at the same time as or at a different timing from the illumination of the light source LS and the display of the arrow information AR1.

[0095] FIG. 17 is a diagram showing a first example of the presentation of guidance information GI2 to a store clerk. In FIG. 17, it is assumed that the code CD is displayed on the mobile terminal 200, and the distance between the camera 25 and the mobile terminal 200 is shorter than a predetermined distance range in which the code can be read, that is, the camera 25 and the mobile terminal 200 are too close. In FIG. 17, the second touch panel 22 displays a message to guide the customer to "move 10 cm further away" together with a preview image PG based on an image captured by the camera 25. This allows the store clerk to instruct the customer to move the camera 25 and the mobile terminal 200 farther away than the current distance, and to instruct the customer on how to operate the mobile terminal 200 to suitably capture the code CD with the camera 25. Note that the preview image PG may be the captured image itself, or may be a captured image that has been subjected to a predetermined process (for example, a change in compression rate or size).

[0096] Fig. 18 is a diagram showing a second example of presentation of guidance information GI2 to a store clerk. In Fig. 18, it is assumed that the code CD is displayed on the mobile terminal 200, and the distance between the camera 25 and the mobile terminal 200 is longer than the predetermined distance range in which the code can be read, that is, the camera 25 and the mobile terminal 200 are too far away. In Fig. 18, the second touch panel 22 displays a preview image PG based on an image captured by the camera 25, along with a message to guide the customer to "move 5 cm closer". This allows the store clerk to instruct the customer to move the camera 25 and the mobile terminal 200 closer than the current distance, and to instruct the customer on how to operate the mobile terminal 200 to suitably capture the code CD with the camera 25.

[0097] Fig. 19 is a diagram showing a third example of presentation of guidance information GI2 to a store clerk. In Fig. 19, it is assumed that the code CD is not displayed on the mobile terminal 200, and the first CPU 11 or the second CPU 21 detects that the code CD is not displayed on the mobile terminal 200 by performing image analysis on the image captured by the camera 25. In Fig. 19, the second touch panel 22 displays a message to the customer, "Please display the code," along with a preview image PG based on the image captured by the camera 25. This allows the store clerk to advise the customer to display the code CD and to instruct the customer on how to operate the mobile terminal 200 to suitably capture the code CD with the camera 25.

[0098] In this way, the store clerk can verbally convey to the customer appropriate instructions required for code payment while visually checking the guidance information GI2.

[0099] In order to enable the camera 25 to capture an image of the code CD during code payment, the customer needs to hold the display surface of the mobile terminal 200, on which the code CD is displayed, over the camera 25 in an inverted position so that it is not visible to the customer. This makes it difficult for the customer to confirm the instructions on the display surface of the mobile terminal 200, and can also make it difficult for the customer to understand the direction in which to move the mobile terminal 200. In contrast, the payment terminal 100 of this embodiment displays the light source LS and camera position identification information, allowing the customer to easily confirm the position of the camera 25. Even in this case, the customer can clearly understand the camera 25 by visually checking the light source LS and camera position identification information, and can easily hold the code CD over the camera 25.

[0100] Furthermore, by making the camera position identification information simple visual information such as a camera mark CM or arrow information AR, customers can easily and quickly intuitively understand the position of the camera 25 and how to operate (position) the mobile terminal 200 relative to the camera 25.

[0101] In addition, the store clerk can check the guidance information GI2 and give advice to the customer. Therefore, it is not necessary to indicate the position of the camera 25 with a label or the like that is configured separately from the payment terminal.

[0102] In addition, by checking the guidance information GI1 output as voice, the customer can understand how to position the mobile terminal 200 relative to the camera 25 even if the display surface of the mobile terminal 200 is difficult to see and it is difficult for the customer to check the guidance information GI1.

[0103] Second embodiment In the first embodiment, a payment terminal 100 as one terminal is illustrated as having two display units (e.g., a first touch panel 12 and a second touch panel 22). In the second embodiment, as shown in FIG. 20, a payment terminal 100A is described as having two terminals, a customer terminal 100A1 and a store terminal 100A2. Note that in the second embodiment, the description of matters similar to those in the first embodiment will be omitted or simplified.

[0104] FIG. 21 is a front perspective view showing an example of the appearance of the customer terminal 100A1. The customer terminal 100A1 has a main body 10. The main body 10 has, for example, a generally box-shaped shape. For example, a customer operates the customer terminal 100A1 from the front surface 1A side of the customer terminal 100A1. The customer terminal 100A1 is connected to a store terminal 100A2 operated by a store clerk. The customer terminal 100A1 can execute various payment processes in cooperation with the store terminal 100A2. The store terminal 100A2 inputs products, inputs amounts, selects payment methods, and the like, for example, via an input device (for example, the second touch panel 22) provided in the store terminal 100A2.

[0105] The customer terminal 100A1 includes a first touch panel 12, a first LED 13, an NFC antenna 15, a first card slot 16s, a second card slot 17s, and a camera 25. The customer terminal 100A1 includes a cable CA on the rear surface 1D side. The cable CA may include a power cable, a communication cable, a LAN (Local Area Network) cable, a USB (Universal Serial Bus) cable, etc.

[0106] The customer terminal 100A1 is of a composite type, which is capable of executing payment processing according to a plurality of payment methods in cooperation with the store terminal 100A2.

[0107] The camera 25 includes a camera module md and a lens ls (see FIG. 22). When viewed from the outside of the customer terminal 100A1, the lens ls of the camera 25, the second card slot 17s, and the first touch panel 12 are arranged in the height direction from the placement surface α, in that order, starting from the vicinity of the placement surface α, in the customer terminal 100A1. When viewed from the inside of the customer terminal 100A1, the camera module md of the camera 25, the second card reader 17, the NFC antenna 15, and the first touch panel 12 are arranged in the height direction from the placement surface α, in that order, starting from the vicinity of the placement surface α. The NFC antenna 15 and the first touch panel 12 may be at the same height from the placement surface α, that is, the NFC antenna 15 may be arranged around the first touch panel 12 on the same surface. The surface on which the first touch panel 12 is arranged is also referred to as the panel arrangement surface 10a. The panel arrangement surface 10a may be the upper surface of the main body 10.

[0108] The first card slot 16s is arranged along the side on the right or left side as viewed from the front surface 1A, for example, on the right side in Fig. 21. In this case, the customer can easily select one of the multiple payment methods corresponding to the multiple devices lined up in front of him or her.

[0109] The customer terminal 100A1 is higher on the rear surface 1D side than on the front surface 1A side. In other words, the panel arrangement surface 10a of the main body 10 of the customer terminal 100A1 gradually becomes lower toward the customer. In other words, when a customer faces the second card slot 17s, the panel arrangement surface 10a of the customer terminal 100A1 faces diagonally upward toward the customer.

[0110] A first LED 13 is arranged on the panel arrangement surface 10a of the main body 10 of the customer terminal 100A1. The arrangement position of the first LED 13 is not limited to this, and may be any position that is visible to the customer.

[0111] The customer terminal 100A1 has an opening 30 on the front surface 1A where the housing of the main body 10 is not present. The opening 30 is widest on the front surface 1A side, and narrows toward the rear surface 1D side. In other words, the opening 30 expands in diameter from the rear surface 1D side toward the front surface 1A side. The second card slot 17s and the lens ls of the camera 25 are disposed in the opening 30. For example, the second card slot 17s is located in the part of the opening 30 closest to the rear surface 1D side.

[0112] A lower surface 30b is disposed at the lower peripheral edge of the opening 30. The lower surface 30b may be a tapered surface that gradually approaches the placement surface α from the rear surface 1D side toward the front surface 1A side. The lower surface 30b is formed, for example, in a substantially planar shape. The surface 10b at the lower peripheral edge of the opening 30 on the front surface 1A side of the main body 10 of the customer terminal 100A1 and the lower surface 30b are connected. A part of the connecting portion between the surface 10b of the main body 10 and the lower surface 30b of the opening 30 is recessed to form a recess H1. The recess H1 is a part of the opening 30. The contour shape of the recess H1 is, for example, a semicircular arc shape or a semielliptical arc shape. The lens ls of the camera 25 is exposed and disposed in the recess H1. The front side of the lens ls is not covered by the housing of the main body 10. Therefore, the camera 25 can introduce light from outside the customer terminal 100A1 through the recess H1. Furthermore, by disposing the lens ls in the recess H1, it is difficult for the customer's fingers or dust to reach the lens ls during payment, and the lens ls is protected from damage and adhesion of dirt.

[0113] The customer terminal 100A1 also includes a light source LS (for example, light source LS1). The light source LS may be disposed near the camera 25, for example, on the lower surface 30b of the opening 30. For example, the light source LS1 is disposed near the camera 25 while being separated from the camera 25. The light source LS1 may be formed in any shape, for example, a perfect circle, an ellipse, a rectangle, other geometric shapes, or other shapes. The light source LS1 may be formed, for example, in the shape of a Patlite (registered trademark) so that it is easy to understand that the position of the camera 25 is notified. By emitting light from the light source LS, even if the camera 25 is not disposed on the panel arrangement surface 10a on which the first touch panel 12 is disposed, the customer can easily confirm the position of the camera 25 using the light source LS as a landmark, and the code CD displayed on the mobile terminal 200 can be easily captured by the camera 25.

[0114] Fig. 22 is a schematic cross-sectional view showing an example of the customer terminal 100A1 seen from the side, in which the first touch panel 12, the NFC antenna 15, etc. are omitted.

[0115] In the customer terminal 100A1, the camera 25 may be disposed closer to the front surface 1A than the second card slot 17s (on the left side in FIG. 22). In other words, when a customer faces the second card slot 17s from the front, the lens ls of the camera 25 may be disposed closer to the customer than the second card slot 17s. In this case, since the lens ls of the camera 25 is located relatively closer to the front surface 1A in the opening 30, the customer terminal 100A1 can easily introduce light from a subject (e.g., a mobile terminal 200 on which a code is displayed) located outside the customer terminal 100A1. Therefore, the customer terminal 100A1 can capture a high-quality image of the code CD displayed on the display surface of the mobile terminal 200, thereby improving the recognition accuracy of the code.

[0116] In addition, in the customer terminal 100A1, the camera 25 is disposed at a position closer to the placement surface α than the second card slot 17s. For example, the distance between the placement surface α and the position of the second card slot 17s, that is, the distance between the placement surface α and the contact IC card C2 inserted into the second card slot 17s, may be long enough to allow the finger of a customer who is about to insert the contact IC card C2 to enter between the contact IC card C2 and the placement surface α.

[0117] As a result, even with the position of the camera 25 in this embodiment, the customer can insert the contact IC card C2 into the second card slot 17s and make a payment using the contact IC card C2. Also, the side closer to the placement surface α than the second card slot 17s is likely to become dead space inside the customer terminal 100A1. By arranging the camera 25 in such a position, the dead space inside the customer terminal 100A1 can be effectively utilized, and the placement efficiency of the camera 25 can be improved. This leads to a reduction in the size of the customer terminal 100A1 equipped with the camera 25.

[0118] Further, the normal direction of the lens ls of the camera 25, i.e., the direction of the optical axis OC of the lens ls (optical axis direction), forms a predetermined angle θ (for example, about 50 degrees) with respect to the placement surface α. That is, the optical axis direction of the camera 25 is obliquely upward toward the customer.

[0119] If the payment terminal 100A is divided into a customer terminal 100A1 and a store terminal 100A2, the customer terminal 100A1 does not have to have the above-described configuration, and the external configuration of the customer terminal 100A1 is arbitrary. Also, the external configuration of the store terminal 100A2 is arbitrary.

[0120] Fig. 23 is a block diagram showing an example of the electrical configuration of payment terminal 100A. In Fig. 23, the same components as those in the electrical configuration of payment terminal 100 shown in Fig. 5 are given the same reference numerals, and the description thereof is omitted or simplified.

[0121] In the payment terminal 100A, the customer terminal 100A1 mainly includes the components arranged within the security protection area SR in the payment terminal 100 shown in Fig. 5. In the payment terminal 100A, the store terminal 100A2 mainly includes the components arranged outside the security protection area SR in the payment terminal 100 shown in Fig. 5. Also, although an example is shown in which the customer terminal 100A1 has a security protection area SR, it is not necessary for the customer terminal 100A1 to have a security protection area SR. The camera 25 and the light source LS are arranged in the customer terminal 100A1.

[0122] Specifically, the customer terminal 100A1 includes, within a security protection area SR, a first CPU 11, a first touch panel 12, a first LED 13, an NFC_IC 14, an NFC antenna 15, a first card reader 16, a second card reader 17, a memory 18, a camera 25, and a light source LS. The customer terminal 100A1 also includes a first communication unit 19. The camera 25 and the light source LS may be disposed outside the security protection area SR in the customer terminal 100A1.

[0123] Specifically, the store terminal 100A2 includes a second CPU 21, a second touch panel 22, a second LED 23, a speaker 24, a printer 26, a memory 28, and a light source LS outside the security protection area SR.

[0124] The first communication unit 19 communicates data with an external device (e.g., a store terminal 100A2) via a wired (e.g., cable CA) or wirelessly. The second communication unit 29 communicates data with an external device (e.g., a customer terminal 100A1) via a wired or wireless connection. An image captured by the camera 25 may be sent to the second CPU 21 via the first CPU 11, the first communication unit 19, and the second communication unit 29. The camera 25 and the light source LS may be connected to the first communication unit 19 and may be able to communicate with the second CPU 21 without going through the first CPU 11.

[0125] Next, an example of the operation of payment terminal 100A will be described.

[0126] An operation example of the payment terminal 100A of this embodiment is similar to the operation example of the payment terminal 100 of the first embodiment. In the payment terminal 100A, the customer terminal 100A1 and the store terminal 100A2 are separated, so data is transmitted and received between the components of the customer terminal 100A1 and the store terminal 100A2 by communicating with each other via the first communication unit 19 and the second communication unit 29.

[0127] Next, examples of presentation of the position of camera 25 equipped in customer terminal 100A1 will be described. Here, first to sixth presentation examples are shown, but the position of camera 25 may be presented in other ways. Note that the first to sixth presentation examples are examples different from the example of presenting the camera position by light emission from light source LS1 shown in FIG.

[0128] FIG. 24 is a diagram showing a first presentation example of the camera position. In FIG. 24, unlike FIG. 21, a light source LS2 is provided as an example of the light source LS. The light source LS2 is formed in a circular ring shape along the outer periphery of the camera 25. The light source LS2 may emit light in the same light emission manner (e.g., light emission color, light emission timing, light emission pattern) as the light source LS1. Also, in FIG. 24, as an example of the arrow information AR, the arrow information AR1 is displayed on the first touch panel 12. The arrow information AR indicates the direction from the position where the arrow information AR is displayed toward the camera 25 with an arrow. The light emission color of the light source LS and the display color of the arrow information AR may be different colors or may be the same color. If they are the same color, there is a sense of unity, so that the light source LS and the arrow information AR can integrally indicate the position of the camera 25, making it easier to grasp the camera position. Also, in FIG. 24, the arrow information AR1 is displayed by emitting light uniformly within one arrow without gradation. Therefore, by having the customer terminal 100A1 simultaneously emit light from the light source LS2 and display the arrow information AR1, the customer can grasp the position of the camera 25 more easily.

[0129] Fig. 25 is a diagram showing a second presentation example of the camera position. In Fig. 25, a light source LS2 is provided in the same manner as in Fig. 24. Also, in Fig. 25, as an example of the arrow information AR, arrow information AR2 is displayed on the first touch panel 12. The arrow information AR2 is displayed with a gradation and illuminated unevenly within one arrow. Therefore, the customer terminal 100A1 simultaneously illuminates the light source LS2 and displays the arrow information AR1, and further displays the arrow with a gradation, so that the customer can grasp the position of the camera 25 even more easily.

[0130] FIG. 26 is a diagram showing a third presentation example of the camera position. In FIG. 26, a light source LS2 is provided as in FIG. 24, and arrow information AR2 is displayed on the first touch panel 12. Also, in FIG. 26, a camera mark CM is displayed on the tip side of the arrow of the arrow information AR2 on the first touch panel 12. The tip of the arrow of the arrow information AR2 faces the front surface 1A side and the placement surface α side. The camera mark CM is displayed on the end of the first touch panel 12 on the front surface 1A side. In the customer terminal 100A1, the camera 25 and the panel placement surface 10a are on different surfaces, but the camera mark CM is located close to the camera 25 within the panel placement surface 10a. Also, the first touch panel 12 on which the camera mark CM and the arrow information AR2 are displayed approaches the placement surface α on which the customer terminal 100A1 is placed as it moves toward the front surface 1A. Therefore, the customer can easily intuitively understand that the camera 25, whose position is specified by the camera mark CM and the arrow information AR2, is located closer to the placement surface α than the panel placement surface 10a. Therefore, the customer can easily specify the position of the camera 25 by checking the camera mark CM. Therefore, the customer terminal 100A1 can more easily grasp the position of the camera 25 by simultaneously emitting light from the light source LS2, displaying the arrow information AR2, and displaying the camera mark CM.

[0131] Fig. 27 is a diagram showing a fourth presentation example of the camera position. In Fig. 27, the light source LS is not provided, and the arrow information AR1 is displayed on the first touch panel 12. Even if only the arrow information AR1 is displayed, it is easy for the customer to grasp the position of the camera 25.

[0132] Fig. 28 is a diagram showing a fifth presentation example of the camera position. In Fig. 28, the light source LS is not provided, and the arrow information AR2 is displayed on the first touch panel 12. Even in this case, the customer can easily grasp the position of the camera 25.

[0133] Fig. 29 is a diagram showing a sixth presentation example of the camera position. In Fig. 29, the light source LS is not provided, and the camera mark CM and the arrow information AR2 are displayed on the first touch panel 12. Even in this case, the camera mark CM and the arrow information AR2 can clearly show that the camera 25 is located in the direction indicated by the arrow of the arrow information AR2. Therefore, the customer can easily understand the position of the camera 25.

[0134] In this embodiment, the presentation of the guidance information GI1 to the customer and the presentation of the guidance information GI2 to the store clerk may be similar to the first embodiment.

[0135] In this way, according to the payment terminal 100A of this embodiment, even if the payment terminal 100A is separated into two terminals (customer terminal 100A1 and store terminal 100A2), the same effects as those of the payment terminal 100 of the first embodiment can be obtained.

[0136] In addition, when the customer terminal 100A1 has the configuration shown in FIG. 21 and FIG. 22, the camera 25 is located near the placement surface α. In addition, an opening 30 and a recess H1 are present around the camera 25, and the optical axis direction of the lens ls of the camera 25 is inclined with respect to the placement surface α and the direction perpendicular to the placement surface α. Therefore, in the customer terminal 100A1, the area around the camera 25 has a complex shape. Even in this case, the customer can clearly grasp the position of the camera 25 by the light source LS and the camera position identification information. In addition, the customer can receive suitable advice from the store clerk on how to operate the mobile terminal 200, so that the code CD can be easily operated so that it is preferably included in the imaging range of the camera 25. Therefore, the payment terminal 100A can easily adjust the position of the mobile terminal 200 with respect to the camera 25 that images the code CD displayed on the mobile terminal 200.

[0137] (Summary of the embodiments of the present disclosure) As described above, the payment terminal 100 (an example of an information processing device) of the above embodiment is capable of making a payment using the code CD. The payment terminal 100 includes a first touch panel 12 (an example of a display unit), a camera 25 (an example of an imaging unit) that is arranged near the first touch panel 12 and captures an image of the code CD displayed on the mobile terminal 200 (an example of a medium), a light source LS arranged near the camera 25, and a control unit (e.g., the second touch panel 22) that controls the first touch panel 12, the second touch panel 22, the camera 25, and the light source LS. The light source LS emits light before and after the camera 25 starts capturing an image of the code CD according to the control of the control unit.

[0138] This allows the payment terminal 100 to clearly indicate the position of the camera 25 using the light source LS during code payment processing. Therefore, the customer can visually confirm the light source LS to identify the position of the camera 25 and appropriately adjust the position of the code CD relative to the camera 25. In other words, the customer can easily understand that they need to hold the code near the light when the vicinity of the imaging unit lights up during code payment, and can proceed with code payment by holding the mobile terminal 200 over the camera 25.

[0139] The display unit may include a first touch panel 12 (an example of a first display unit) and a second touch panel 22 (an example of a second display unit). The camera 25 may be disposed near the first touch panel 12.

[0140] Even if the payment terminal 100 has two display units that can be used separately on the customer side and the store side, the position of the camera 25 can be clearly shown to a customer checking the first touch panel 12 using the light source LS during code payment processing.

[0141] Furthermore, first touch panel 12 may display arrow information AR (an example of directional information) indicating the direction of the position where camera 25 is placed.

[0142] This allows the payment terminal 100 to clearly indicate the position of the camera 25 by the arrow information AR during payment processing. Therefore, the customer can visually confirm the position of the camera 25 and appropriately adjust the position of the code CD relative to the camera 25. In other words, the customer can easily determine that the code can be read by holding the mobile terminal 200 in the direction of the arrow of the arrow information AR, and the position of the code information can be appropriately guided. This makes it easier for the customer to make a payment using the code.

[0143] Furthermore, the light source LS may be a light source LS2 arranged in a ring shape along the outer periphery of the camera 25.

[0144] This allows payment terminal 100 to match the position of camera 25 with the position of light source LS2. In addition, the customer can easily understand the shape of camera 25, and can hold code CD over camera 25 with certainty.

[0145] Furthermore, first touch panel 12 may display a camera mark CM, which indicates the presence of camera 25, at a position facing camera 25.

[0146] As a result, even if it is difficult for a customer to tell what is at the tip of the arrow from the arrow information AR alone, the customer can be sure that the camera 25 is present from the camera mark CM. Also, the customer can know that the camera 25 is present at the position opposite the camera mark CM, making it even easier to identify the position of the camera 25.

[0147] In addition, the control unit may sequentially acquire images captured by the camera 25, derive the image range of the code CD in the captured images, and change the light emission mode of the light source LS or the display mode of the arrow information AR based on the image range of the code CD.

[0148] The positional relationship between the camera 25 and the code CD can be estimated based on the image range of the code CD in the captured image, that is, the position and size of the code CD in the captured image. Therefore, the customer can estimate how to move the mobile terminal 200 by checking the light source LS and arrow information indicating the positional relationship between the camera 25 and the code CD.

[0149] In addition, the control unit may sequentially acquire images captured by the camera 25, read the code CD based on the captured images, and if reading of the code CD fails, change the light emission mode of the light source LS or the display mode of the arrow information AR.

[0150] As a result, if the customer fails to read the code CD, the customer can obtain information different from the light emitted by the light source LS and the display of the arrow information AR that was used as reference when the customer failed to read the code CD, thereby increasing the likelihood that the customer can appropriately position the mobile terminal 200 relative to the camera 25.

[0151] In addition, the control unit may acquire an image captured by the camera 25, and display a preview image PG based on the captured image and guidance information GI2 that guides a person (e.g., a customer) adjusting the position of the mobile terminal 200 on the position of the mobile terminal 200 relative to the payment terminal 100 on the second touch panel 22 at the same time as the light source LS is illuminated.

[0152] This allows the store clerk to visually check the preview image PG and the guidance information GI2 and advise the customer to appropriately adjust the position of the code CD relative to the camera 25. Therefore, the payment terminal 100 makes it easier to identify the position of the camera 25, and can also provide the store clerk providing a service to the customer with the guidance information GI2 that facilitates code payment.

[0153] Furthermore, the control unit may detect, based on the captured image, that the code CD is not displayed on the mobile terminal 200. The guidance information may be information that guides a person who adjusts the position of the mobile terminal 200 to display the code CD.

[0154] This allows the customer to recognize that the code CD is not displayed on the mobile terminal 200 and that the code CD needs to be displayed, and allows the customer to smoothly proceed with the payment process using the code CD.

[0155] Furthermore, payment terminal 100 may include speaker 24. Speaker 24 may output guidance information GI2, which provides guidance on how to place mobile terminal 200 relative to payment terminal 100, by voice, under the control of the control unit.

[0156] When holding the code CD over the camera 25, the customer brings the mobile terminal 200 on which the code CD is displayed close to the camera 25 so as to face the camera 25, and therefore cannot directly check the display state of the code CD. Even in this case, the customer can easily hold the code CD over the camera 25 thanks to the audio guidance of the guidance information GI2, without having to check the screen of the mobile terminal 200.

[0157] Furthermore, payment terminal 100 may be a single terminal. The single terminal may include first touch panel 12, second touch panel 22, camera 25, light source LS, and a control unit.

[0158] As a result, even when the payment terminal 100 is configured as a single terminal, the position of the mobile terminal 200 can be easily indicated to the camera 25 that captures the image of the code CD displayed on the mobile terminal 200 at the time of code payment.

[0159] The payment terminal 100A may include a customer terminal 100A1 (an example of a first terminal) and a store terminal 100A2 (an example of a second terminal). The customer terminal 100A1 may include a first touch panel 12, a camera 25, and a light source LS. The store terminal 200A2 may include a second touch panel 22 and a second CPU 21 (an example of a control unit).

[0160] As a result, even when payment terminal 100A is configured with a plurality of terminals, it can easily guide the position of mobile terminal 200 to camera 25 that captures the image of code CD displayed on mobile terminal 200 during code payment.

[0161] Furthermore, payment terminal 100 may be placed on a placement stand. Camera 25 may be placed on the same surface as the display surface of first touch panel 12 (i.e., panel placement surface 10a), or on the placement surface α side of first touch panel 12.

[0162] In this case, in order to enable the camera 25 to capture an image of the code CD, the customer needs to hold the mobile terminal 200, on which the code CD is displayed, over the camera 25 in an inverted position so that the display surface of the mobile terminal 200 is not visible to the customer. Even in this case, the customer can clearly understand the camera 25 by visually checking the light source LS and the camera position identification information, and can easily hold the code CD over the camera 25.

[0163] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or amended examples within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present invention. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention.

[0164] In the above embodiment, the payment terminal 100, 100A is illustrated as having two touch panels, the first touch panel 12 and the second touch panel 22, but is not limited to this. The payment terminal 100, 100A may have a single touch panel. In this case, for example, a store clerk can operate the payment terminal 100, 100A via the POS or operate the same touch panel as a customer.

[0165] In the above embodiment, the code CD used for code payment is displayed on the mobile terminal 200, but this is not limited to the above. A medium other than the mobile terminal 200 (e.g., a paper medium) may be displayed. For example, code payment using a printed code is also possible. Even in this case, the payment terminal 100, 100A can guide the code displayed on the medium to an appropriate position with respect to the camera 25 for the payment terminal 100, 100A.

[0166] The above embodiment may be applied to other applications, not limited to code reading for code payment. For example, the above embodiment may be applied to guide a point card or passport with a code CD printed thereon to an appropriate position relative to a camera of a reader. In code reading by camera 25, the above embodiment may be applied to position a passport or the like in an appropriate position relative to the camera of the reader when optically reading characters by OCR (Optical Character Recognition) or the like.

[0167] In addition, the above embodiment may also be applicable to a program that realizes the functions of the payment support method of the above-mentioned embodiment, which is supplied to an information processing device that is a computer (e.g., a payment terminal) via a network or various storage media, and which is read and executed by a processor of this information processing device, as well as a recording medium on which this program is stored.

[0168] In the above embodiment, the processor may be physically configured in any way. If a programmable processor is used, the processing contents can be changed by changing the program, so that the degree of freedom in processor design can be increased. The processor may be configured as one semiconductor chip, or may be physically configured as multiple semiconductor chips. When configured as multiple semiconductor chips, each control in the above embodiment may be realized by a different semiconductor chip. In this case, it can be considered that the multiple semiconductor chips constitute one processor. The processor may be configured as a semiconductor chip and a member (such as a capacitor) having a different function. A single semiconductor chip may be configured to realize the functions of the processor and other functions. A single processor may also be configured as multiple processors. [Industrial Applicability]

[0169] The present disclosure is useful for an information processing device and a payment support method that can easily guide the position of a medium to a camera that captures an image of a code displayed on the medium during code payment. [Explanation of symbols]

[0170] 100,100A Payment terminal 100A1 Customer terminal 100B1 Store terminal 1A front 1B Side 1C side 1D rear 10 Main unit 11 1st CPU 12 First touch panel 13 1st LED 14 NFC_IC 15 NFC antenna 16 First card reader 17 Second Card Reader 18 Memory 19 First Communications Department 21 2nd CPU 22 Second touch panel 23 2nd LED 24 Speakers 25 Camera 26 Printers 27 External terminal 28 Memory 29 2nd Communications Department 30 Opening AR,AR1,AR2 Arrow information CD Code GI1,GI2 Guide Information H1 recess LS,LS1,LS2 light source PG Preview Image α Placement surface

Claims

1. An information processing device capable of making payments using a code, A display unit; an imaging unit arranged near the display unit and configured to capture an image of the code displayed on the medium; A light source disposed near the imaging unit; a control unit that controls the display unit, the imaging unit, and the light source; Equipped with The light source starts imaging the code by the imaging unit according to the control by the control unit. It lights up front and back, The control unit is Sequentially acquiring images captured by the imaging unit; Deriving an image range of the code in the captured image; changing a light emission mode of the light source based on the image range of the code; Information processing device.

2. The display unit includes a first display unit and a second display unit, The imaging unit is disposed in the vicinity of the first display unit. The information processing device according to claim 1 .

3. the first display unit displays directional information indicating a direction of a position where the imaging unit is disposed; The information processing device according to claim 2 .

4. The light source is arranged in a ring shape along the outer periphery of the imaging unit. The information processing device according to claim 1 .

5. The first display unit has a camera display indicating the presence of the imaging unit at a position facing the imaging unit. Show the work, The information processing device according to claim 3 .

6. The control unit is The captured images captured by the imaging unit are sequentially acquired, reading the code based on the captured image; If the code reading fails, the light emission mode of the light source is changed.

3. The information processing device according to claim 1 or 2.

7. The control unit is The captured images captured by the imaging unit are sequentially acquired, Deriving the image range of the code in the captured image; changing a display mode of the direction information based on the image range of the code; The information processing device according to claim 3 .

8. The control unit is The captured images captured by the imaging unit are sequentially acquired, reading the code based on the captured image; If the code reading fails, a display mode of the direction information is changed. The information processing device according to claim 3 .

9. The control unit is Acquire the captured image captured by the imaging unit; a preview image based on the captured image and guidance information for guiding a person adjusting a position of the medium as to a position of the medium relative to the information processing device are displayed on the second display unit simultaneously with the emission of light from the light source. The information processing device according to claim 2 .

10. The control unit detects, based on the captured image, that the code is not displayed on the medium; and The guidance information is information that guides a person adjusting the position of the medium to display the code. The information processing device according to claim 9.

11. a speaker; The speaker outputs, in a voice form, guidance information that provides guidance on a method of arranging the medium in the information processing device in accordance with the control by the control unit.

3. The information processing device according to claim 1 or 2.

12. the information processing device is a single terminal, The single terminal includes the display unit, the imaging unit, the light source, and the control unit.

3. The information processing device according to claim 1 or 2.

13. The information processing device includes a first terminal and a second terminal; the first terminal includes the first display unit, the imaging unit, and the light source; The second terminal includes the second display unit and the control unit. The information processing device according to claim 2 .

14. The information processing device is placed on a placement surface, The imaging unit is disposed on the same surface as a display surface of the first display unit, or on the placement surface side of the first display unit. The information processing device according to claim 2 .

15. A payment support method for supporting a payment using a code by an information processing device, comprising: the information processing device includes a display unit, an imaging unit arranged near the display unit and configured to capture an image of a code displayed on a medium, and a light source arranged near the imaging unit; capturing an image of the code by the imaging unit; causing the light source to emit light before and after the imaging unit starts imaging the code; Including, The information processing device includes: Sequentially acquiring images captured by the imaging unit; Deriving an image range of the code in the captured image; The light emission mode of the light source is changed based on the image range of the code. Payment assistance methods.

Images