Payment system, recognition device, and program thereof

Abstract

To enable credit card settlement at the time of off line without using any dedicated printers and the like.SOLUTION: A settlement system includes imaging means, specification means, acquisition means, and recording means. The specification means specifies a commodity from an image imaged by the imaging means. The acquisition means acquires an image of a medium used by online settlement from the image imaged by the imaging means. The recording means records information about the transaction of the commodity specified by the specification means together with the image of the medium acquired by the acquisition means in a recording medium.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Embodiments of the present invention relate to a payment system, a recognition device for the system, and a program for the recognition device.

Background Art

[0002] Generally, credit card payment reads credit card data with a dedicated terminal, transmits the data to an online-connected authentication server to authenticate the credit card, and when the credit card is approved, the payment becomes possible. Therefore, when going offline due to network failure or authentication server failure, etc., it becomes impossible to make a payment with a credit card.

[0003] As a countermeasure, conventionally, there is a method of using a dedicated printer that transfers the characters embossed on the card. On the credit card, the card number, expiration date, cardholder's name, etc., which are information necessary for authentication, are embossed. Therefore, this is a method of making it possible to pay with a credit card by transferring the embossed characters onto paper with a dedicated printer and obtaining the signature of the credit card user on the paper.

[0004] However, this method requires the above-mentioned dedicated printer. Since the frequency of going offline is extremely low, many stores do not prepare a dedicated printer at the cash register. For this reason, for example, if it suddenly goes offline during business hours, it becomes impossible to make a payment with a credit card until the printer is prepared, which causes trouble to many customers.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] The problem to be solved by the embodiments of the present invention is to provide a settlement system that enables offline credit card settlement without using a dedicated printer or the like, a recognition device for this system, and a program for the recognition device.

Means for Solving the Problem

[0007] In one embodiment, the settlement system includes an imaging means, a specifying means, an acquiring means, and a recording means. , processing means and The specifying means specifies a product from an image captured by the imaging means. The acquiring means acquires an image of a medium used for online settlement from the image captured by the imaging means. The recording means records, on a recording medium, information related to a transaction of the product specified by the specifying means, together with the image of the medium acquired by the acquiring means. The processing means makes the image of the medium obtained by the acquisition means invisible while leaving the part of the information necessary for the authentication of online payment. The recording means records the image of the medium processed by the processing means.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

[0009] Hereinafter, some embodiments of the settlement system will be described with reference to the drawings. [First Embodiment] First, the first embodiment will be described. FIG. 1 is a schematic configuration diagram of a settlement system 100 according to the first embodiment. The settlement system 100 includes a recognition device 1 and an accounting machine 2. The settlement system 100 connects the recognition device 1 and the accounting machine 2 with a communication line 3. The communication line 3 may be wired or wireless.

[0010] The recognition device 1 includes an imaging unit 4. The imaging unit 4 can also be referred to as imaging means. The recognition device 1 recognizes a product from an image captured by the imaging unit 4. For example, the recognition device 1 reads a barcode from the image and recognizes the product from the barcode. For example, the recognition device 1 extracts the appearance feature amount of the product from the image and recognizes the product from the appearance feature amount. Since such object recognition technology using images is well-known, detailed description here is omitted.

[0011] The accounting machine 2 includes a recording unit 5. The recording unit 5 can also be referred to as a recording means. The recording unit 5 records data on recording paper. The recording paper on which data is recorded is issued as, for example, a purchase receipt, a credit card slip, a certificate, a settlement report, an inspection report, etc. Since such a recording paper issuing technique is also well-known, detailed description here is omitted.

[0012] In order to enable settlement by credit card, the settlement system 100 connects the accounting machine 2 to a system network 6 dedicated to credit cards. An authentication server 7 of each credit card issuing company is connected to the system network 6. The authentication server 7 authenticates the credit card based on the credit card data etc. received from the accounting machine 2 via the system network 6, and determines whether to approve or deny the settlement. The authentication server 7 transmits the authentication result to the accounting machine 2 via the system network 6. When the settlement is approved, the accounting machine 2 processes the settlement by credit card. When the settlement is denied, the accounting machine 2 regards the settlement by credit card as an error.

[0013] In the settlement system 100 having such a configuration, the present embodiment takes measures when it becomes offline due to a failure of the system network 6 or a failure of the authentication server 7, that is, when online credit card settlement becomes impossible. Hereinafter, this measure will be described in detail.

[0014] FIG. 2 is a block diagram showing the main circuit configuration of the accounting machine 2. The accounting machine 2 includes a processor 21, a main memory 22, an auxiliary storage device 23, a clock 24, a communication interface 25, a keyboard 26, a display 27, a printer 28, a card reader 29, a change machine interface 30, a recognition device interface 31, a system transmission path 32, etc. The system transmission path 32 includes an address bus, a data bus, control signal lines, etc. The system transmission path 32 connects the processor 21 and other parts directly or via a signal input / output circuit, and transmits data signals exchanged therebetween.

[0015] The accounting machine 2 constitutes a computer by connecting a processor 21, a main memory 22, an auxiliary storage device 23, a clock 24, and a communication interface 25 via a system transmission path 32. Then, the accounting machine 2 connects devices such as a keyboard 26, a display 27, a printer 28, a card reader 29, etc., and device interfaces such as a change machine interface 30 and a recognition device interface 31 to the computer via the system transmission path 32.

[0016] The processor 21 corresponds to the central part of the computer. The processor 21 controls each part in order to realize various functions as the accounting machine 2 according to an operating system or an application program. The processor 21 is, for example, a CPU (Central Processing Unit).

[0017] The main memory 22 corresponds to the main storage part of the computer. The main memory 22 includes a non-volatile memory area and a volatile memory area. The main memory 22 stores an operating system or an application program in the non-volatile memory area. The main memory 22 may store data necessary for the processor 21 to execute processes for controlling each part in either the non-volatile or volatile memory area. The main memory 22 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 21. The non-volatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory).

[0018] The auxiliary storage device 23 corresponds to the auxiliary storage part of the above computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive) etc. can be the auxiliary storage device 23. The auxiliary storage device 23 stores data used when the processor 21 performs various processes, data created by the processes in the processor 21, etc. The auxiliary storage device 23 may also store the above application program.

[0019] The clock 24 measures the date and time. The processor 21 processes the date and time measured by the clock 24 as the current date and time.

[0020] The communication interface 25 connects to the system network 6. The accounting machine 2 performs data communication with an authentication server 7 etc. connected to the system network 6 via the communication interface 25.

[0021] The keyboard 26 is a device that, in addition to the numeric keys for inputting numerical values, has various function keys necessary for the accounting machine 2 such as a subtotal key, a cancel key, a close key, etc., and accepts the input of various data.

[0022] The display 27 is a device that displays various screen information such as an accounting screen, a detail screen, etc. The display 27 includes an operator display and a customer display. The display 27 may be a touch panel with a touch sensor arranged on the screen.

[0023] The printer 28 is a device that prints data on receipt paper, cuts it, and issues a sales receipt, a credit card slip, a certificate, a settlement report, an inspection report, etc. The printer 28 is an example of the recording unit 5.

[0024] The card reader 29 is a device that reads data recorded on a card medium such as a credit card, an electronic money card, or a point card. When the card medium is a magnetic card, the card reader 29 is a magnetic card reader. When the card medium is an IC card, the card reader 29 is an IC card reader. The accounting machine 2 may be provided with either a magnetic card reader or an IC card reader as the card reader 29, or may be provided with both. Note that the card reader 29 may be a card reader / writer having a function of writing data to a card.

[0025] The change machine interface 30 constitutes an interface with an automatic change machine (not shown). The change machine interface 30 inputs the amount data of the currency inserted into the automatic change machine from the automatic change machine. The change machine interface 30 outputs change data from the accounting machine 2 to the automatic change machine. The automatic change machine that has input the change data automatically pays out the currency corresponding to the change data as change.

[0026] The recognition device interface 31 constitutes an interface with the recognition device 1. The recognition device interface 31 inputs the information recognized by the recognition device 1. The recognition device interface 31 outputs display data and the like from the accounting machine 2 to the recognition device 1.

[0027] The accounting machine 2 configured as described above is generally referred to as a POS (Point Of Sales) terminal, an electronic cash register, a money register, or the like. Note that the accounting machine 2 is not limited to the configuration described above. For example, the accounting machine 2 may be connected with a drawer instead of the change machine interface 30. The accounting machine 2 may be connected with a settlement terminal such as a PIN pad instead of the card reader 29. In this case, the accounting machine 2 is connected to the system network 6 via the settlement terminal.

[0028] FIG. 3 is a block diagram showing the main circuit configuration of the recognition device 1. The recognition device 1 includes a processor 11, a main memory 12, an auxiliary storage device 13, a camera 14, a touch panel 15, a cash register interface 16, a system transmission path 17, and the like. The system transmission path 17 includes an address bus, a data bus, control signal lines, and the like. The system transmission path 17 connects the processor 11 to each of the other units directly or via a signal input / output circuit, and transmits data signals exchanged therebetween.

[0029] The recognition device 1 constitutes a computer by connecting the processor 11, the main memory 12, and the auxiliary storage device 13 via the system transmission path 17. Then, the recognition device 1 connects devices such as the camera 14 and the touch panel 15, and device interfaces such as the cash register interface 16 to the computer via the system transmission path 17.

[0030] The processor 11 corresponds to the central part of the computer. The processor 11 controls each unit in order to realize various functions as the recognition device 1 according to an operating system or an application program. The processor 11 is, for example, a CPU.

[0031] The main memory 12 corresponds to the main storage part of the computer. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or an application program in the non-volatile memory area. The main memory 12 may store data necessary for the processor 11 to execute processes for controlling each unit in the non-volatile or volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 11. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0032] The auxiliary storage device 13 corresponds to the auxiliary storage part of the above computer. For example, an EEPROM, HDD, or SSD, etc. can be the auxiliary storage device 13. The auxiliary storage device 13 stores data used when the processor 11 performs various processes, data created by the processes in the processor 11, etc. The auxiliary storage device 13 may also store the above application program.

[0033] The camera 14 is a device that images an object occluded by the reading window. The frame images captured by the camera 14 are sequentially written into the image memory. The image memory is, for example, in the volatile memory area of the main memory 12. The camera 14 is an example of the imaging unit 4.

[0034] The touch panel 15 functions as a display device and an input device of the recognition device 1. For example, the touch panel 15 displays product information such as the product name and price of the product recognized by the recognition device 1. For example, the touch panel 15 displays various button images such as an accounting button for instructing a transition to accounting, and accepts touch input of the button image.

[0035] The accounting machine interface 16 constitutes an interface with the accounting machine 2. The accounting machine interface 16 outputs the information recognized by the recognition device 1 to the accounting machine 2. The accounting machine interface 16 inputs display data, etc. from the accounting machine 2.

[0036] The recognition device 1 with such a configuration is generally referred to as a scanner device, a reading device, etc. Note that the recognition device 1 is not limited to the above-described configuration. For example, the recognition device 1 may be provided with a display and a keyboard instead of the touch panel 15 or in combination with the touch panel 15. Also, the recognition device 1 may be provided with a card reader similar to the card reader 29 provided in the accounting machine 2.

[0037] Now, as the above-mentioned countermeasure, the recognition device 1 implements a control program so that the processor 11 functions as the specifying means 111, the acquisition means 112, the processing means 113, and the control means 114. The control program is one of the application programs stored in the main memory 12 or the auxiliary storage device 13. The method of installing the control program in the main memory 12 or the auxiliary storage device 13 is not particularly limited. The control program can be recorded on a removable recording medium, or distributed by communication via a network and installed in the main memory 12 or the auxiliary storage device 13. The recording medium may be in any form as long as it can store the program non-temporarily and can be read by the device, such as a CD-ROM, a memory card, etc.

[0038] The specifying means 111 is a function of specifying a product from the image captured by the camera 14. The product may be specified by recognizing the barcode shown in the image. The product may also be specified by the appearance feature amount of the product image.

[0039] The acquisition means 112 is a function of acquiring an image of the medium used for online payment from the above image. The medium is typically a credit card. The medium may be other than a credit card. For example, the medium may be a cash card, an electronic money card, etc.

[0040] The processing means 113 is a function of making the image of the medium acquired by the acquisition means 112 invisible, leaving only the part of the information necessary for online payment authentication. For example, in the case of a credit card, the information necessary for online payment authentication is the card number, the expiration date, and the cardholder's name. Incidentally, the card number, the expiration date, and the cardholder's name are embossed. Note that the information necessary for online payment authentication does not have to include all of the card number, the expiration date, and the cardholder's name. Alternatively, it may include other information such as the card issue date.

[0041] The control means 114 has a function of controlling the printer 28 of the accounting machine 2 to record the information related to the transaction of the product identified by the identification means 111 together with the image of the medium acquired by the acquisition means 112 or the image of the medium processed by the processing means 113. The information related to the transaction of the product is, for example, the transaction amount and the transaction date and time. The information related to the transaction of the product may be only the transaction amount. The information related to the transaction of the product may include information other than the transaction amount and the transaction date and time.

[0042] Then, the recognition device 1 manages a card database 131 on the auxiliary storage device 13 in order to support the functions as the identification means 111, the acquisition means 112, the processing means 113, and the control means 114. The card database 131 is an aggregate of data records generated for each type of credit card available for settlement. Hereinafter, the data records stored in the card database 131 are referred to as card records 1311. Note that the card database 131 does not necessarily have to be managed by the auxiliary storage device 13 of the recognition device 1. For example, it may be managed by the auxiliary storage device 23 of the accounting machine 2 connected by the communication line 3.

[0043] FIG. 4 is a schematic diagram showing the main data structure of the card record 1311. As shown in the figure, the card record 1311 includes items such as a card ID, a card company, a card name, appearance feature data, and mask data.

[0044] The card ID is a unique code (identification information) set for each type of credit card to identify the type of credit card. The card company is information for identifying the issuing company of the credit card identified by the card ID. The card name is the unique name of the same credit card.

[0045] The appearance feature data represents the appearance features on one side of the credit card. One side is the side where the card number, expiration date, cardholder's name, etc. are embossed. Hereinafter, this one side is referred to as the front side, and the other side is referred to as the back side. The appearance feature data is data obtained by digitizing the shape, dimensions, color, pattern, degree of brightness and darkness, etc. of the front surface of the credit card.

[0046] The mask data is data for masking a part of the image captured of the front surface of the credit card to make it invisible. In this embodiment, information necessary for credit card authentication, that is, the areas where the card number, expiration date, cardholder's name, etc. are embossed are excluded and made invisible by masking. The embossing positions of the card number, expiration date, cardholder's name, etc. vary depending on the type of credit card. However, for the same type of credit card, the embossing position is fixed. Therefore, in this embodiment, mask data is prepared for each type of credit card identified by the card ID and stored on the card record 1311.

[0047] FIG. 5 and FIG. 6 are flowcharts showing the procedure of information processing executed by the processor 11 of the recognition device 1 according to the control program. FIG. 7 and FIG. 8 are flowcharts showing the procedure of information processing executed by the processor 21 of the accounting machine 2 according to the control program. Hereinafter, the main operations of the settlement system 100 will be described using each flowchart. Note that the procedure of information processing described below is an example. The procedure or content can be appropriately changed if the same effect can be obtained.

[0048] First, the recognition device 1 and the accounting machine 2 constituting the settlement system 100 are installed opposite to each other at the accounting location (cash register) of the store. When a store clerk in charge of accounting is requested by a customer to settle the purchased goods, the clerk holds each item in front of the reading window of the recognition device 1. By holding the item in front of the reading window, the item is imaged by the camera 14.

[0049] When the processor 11 of the recognition device 1 receives a transaction start command from the accounting machine 2, for example, it starts information processing according to the procedure shown in the flowchart of FIG. 5. First, the processor 11 acquires the image captured by the camera 14 as ACT1. Then, the processor 11 uses the object recognition technology as ACT2 to identify the product from the image.

[0050] The processor 11 checks whether the product can be identified as ACT3. If the product can be identified, the processor 11 determines YES in ACT3 and proceeds to ACT4. The processor 11 controls to send a product registration command to the accounting machine 2 as ACT4. By this control, the product registration command is sent from the accounting machine interface 16 to the accounting machine 2 via the communication line 3. The product registration command includes the product code which is the identification information of the identified product. Here, the processor 11 realizes the function as the specifying means 111 by the processing of ACT1 to ACT4.

[0051] When the processor 21 of the accounting machine 2 receives the product registration command at the recognition device interface 31, it starts information processing according to the procedure shown in the flowchart of FIG. 7. First, the processor 21 detects the product code from the product registration command as ACT21. The processor 21 acquires product information such as the product name and price of the product identified by the product code as ACT22. For example, in the auxiliary storage device 23 of the accounting machine 2, a data file, so-called PLU (Price Look Up) file, in which product information such as the product name and price is preset in association with the product code of each product is stored. The processor 21 searches the PLU file to acquire the product information. Note that the PLU file may be stored not in the auxiliary storage device 23 of the accounting machine 2 but in the storage device of a server connected to the outside of the accounting machine 2.

[0052] The processor 21 that has acquired the product information executes product sales data processing as ACT23. Specifically, the processor 21 generates product sales data based on the product information. The product sales data includes items such as product code, product name, price, number of sales, and sales amount. The processor 21 performs a registration process on the product sales data in the transaction memory. The transaction memory is a part of the volatile memory area in the main memory 22.

[0053] The processor 21 edits the display data as ACT24. The display data includes the product name, price, number of sales, and sales amount of the product sales data. The display data may only include the product name and price. The processor 21 controls to send the display data to the recognition device 1 as ACT25. By this control, the display data is sent from the recognition device interface 31 to the recognition device 1 via the communication line 3. Thus, the processor 21 finishes the information processing of the procedure shown in the flowchart of FIG. 7.

[0054] Return to the description of FIG. 5. The processor 11 of the recognition device 1 that has received the display data at the accounting machine interface 16 displays the information of the display data on the touch panel 15 as ACT5. Thereby, the product name, price, etc. of the product specified from the image captured by the camera 14 are displayed on the touch panel 15.

[0055] The processor 11 checks whether an accounting instruction has been received as ACT6. As described above, an accounting button is displayed on the touch panel 15, and when this accounting button is touched, the processor 11 receives the accounting instruction. If the accounting instruction has not been received, the processor 11 determines NO in ACT6 and returns to ACT1. The processor 11 acquires the next image captured by the camera 14 and identifies the product from that image.

[0056] Incidentally, when object recognition is performed on the image captured by the camera 14 but the product cannot be identified, the processor 11 determines NO in ACT3 and proceeds to ACT6. That is, the processor 11 waits for the product to be identified from the image captured by the camera 14 or for an accounting instruction to be input. Then, when the product is identified, the processes shown in ACT4 and ACT5 are executed.

[0057] When the product information such as the product name and price is displayed on the touch panel 15, the clerk in charge of accounting recognizes that the purchased product placed on the reading window has been correctly registered in the accounting machine 2. Then, the clerk places the next purchased product on the reading window. When the clerk recognizes that all the purchased products have been registered in the accounting machine 2, the clerk touches the accounting button.

[0058] When the accounting button is touched, the processor 11 recognizes that there is an accounting instruction. The processor 11 determines YES in ACT6 and proceeds to ACT7. The processor 11 controls to send an accounting command to the accounting machine 2 as ACT7. By this control, the accounting command is sent from the accounting machine interface 16 to the accounting machine 2 via the communication line 3.

[0059] The processor 21 of the accounting machine 2 that has received the accounting command at the recognition device interface 31 starts the information processing of the procedure shown in the flowchart of FIG. 8. First, the processor 21 calculates the transaction amount based on the product sales data registered in the transaction memory as ACT31. The transaction amount is the amount to be billed to the customer. The transaction amount is, for example, the amount obtained by adding the tax amount imposed on the product to the total amount of the products purchased by the customer. The processor 21 causes the transaction amount to be displayed on the display 27 as ACT32.

[0060] The processor 21 waits for a payment method to be selected as ACT33. For example, keys for selecting payment methods such as cash, credit card, and electronic money are arranged on the keyboard 26. The clerk inputs the key for the payment method desired by the customer.

[0061] When the payment method is selected, the processor 21 determines YES in ACT33 and proceeds to ACT34. The processor 21 checks, as ACT34, whether a credit card has been selected as the payment method. If a payment method other than a credit card is selected, the processor 21 determines NO in ACT34 and proceeds to ACT35. The processor 21 executes a settlement process according to the selected payment method as ACT35.

[0062] For example, when cash is selected as the payment method, the processor 21 waits for cash to be inserted into the cash dispenser. Then, when cash equal to or more than the transaction amount is inserted, the difference is displayed as change on the display 27 and the change data is output to the cash dispenser. Thus, the change is paid out from the cash dispenser. Also, the processor 21 generates print data for the purchase receipt and controls the printer 28 to issue the purchase receipt. Thus, a purchase receipt recording the details of the transaction, the payment amount in cash, the change amount, etc. is issued, so the store clerk hands the purchase receipt to the customer together with the change.

[0063] When electronic money is selected as the payment method, the processor 21 waits for the data of the electronic money card to be read by the card reader 29. Then, when the data of an electronic money card holding an electronic money amount equal to or more than the transaction amount is read, a process of subtracting the transaction amount from the electronic money amount is executed. Also, the processor 21 generates print data for the purchase receipt and controls the printer 28 to control the printing of the purchase receipt. Thus, a purchase receipt recording the details of the transaction, the payment amount by electronic money, etc. is issued, so the store clerk hands the purchase receipt to the customer.

[0064] When a credit card is selected as the payment method, the processor 21 determines YES in ACT 34 and proceeds to ACT 36. The processor 21 checks, in ACT 36, whether the system network 6 is offline. If the system network 6 is not offline, that is, if communication with the authentication server 7 is established, the processor 21 determines NO in ACT 36 and proceeds to ACT 37. The processor 21 executes credit settlement processing in ACT 37.

[0065] Specifically, the processor 21 controls to read the credit card data with the card reader 29 and transmit an authentication command including the card data and the transaction amount. By this control, the authentication command is transmitted to the authentication server 7 of the credit card issuing company via the system network 6. At the authentication server 7, authentication of the settlement such as whether the credit card is valid and whether the transaction amount is within the allowable range is performed. Then the authentication result is returned from the authentication server 7 to the accounting machine 2.

[0066] When the credit card settlement is approved at the authentication server 7, the processor 21 controls the printer 28 to control the issuance of a credit slip. Thus, a credit slip recording the details of the credit transaction is issued, and the store clerk hands the credit slip to the customer.

[0067] After finishing the settlement processing according to the payment method by the above-described processing of ACT 35 or ACT 37, the processor 21 proceeds to ACT 38. The processor 21 controls to transmit a settlement completion command to the recognition device 1 in ACT 38. By this control, the settlement completion command is transmitted from the recognition device interface 31 to the recognition device 1 via the communication line 3. Thus, the processor 21 finishes the information processing of the procedure shown in the flowchart of FIG. 8.

[0068] On the one hand, if a credit card is selected as the payment method and the system network 6 is offline, the processor 21 determines YES in ACT36 and proceeds to ACT39. The processor 21 acquires the transaction date and time and the transaction amount as ACT39. The transaction date and time are, for example, the date and time measured by the clock 24 when the accounting command is received. The processor 21 controls to send an offline settlement command to the recognition device 1 as ACT40. By this control, the offline settlement command is sent from the recognition device interface 31 to the recognition device 1 via the communication line 3. The offline settlement command includes the transaction date and time and the transaction amount.

[0069] Return to the description of FIG. 5. The processor 11 of the recognition device 1 that controlled the transmission of the accounting command checks whether it has received a settlement completion command as ACT8. If it has not received the settlement completion command, the processor 11 determines NO in ACT8 and proceeds to ACT9. The processor 11 checks whether it has received an offline settlement command as ACT9. If it has not received the offline settlement command, the processor 11 determines NO in ACT9 and returns to ACT8. Here, the processor 11 waits to receive either the settlement completion command or the offline settlement command.

[0070] When receiving the settlement completion command via the accounting machine interface 16, the processor 11 determines YES in ACT8. Receiving the settlement completion command means that the settlement has been completed in the accounting machine 2. Therefore, the processor 11 ends the information processing of the procedure shown in the flowchart of FIG. 5.

[0071] On the other hand, when an offline settlement command is received via the accounting machine interface 16, the processor 11 determines YES in ACT9 and proceeds to ACT10. Receiving an offline settlement command means that the system is offline due to a failure of the system network 6 or the authentication server 7, and online credit card settlement is not possible. Therefore, the processor 11 executes offline settlement processing as ACT10.

[0072] Figure 6 is a flowchart showing the specific procedure of offline settlement processing. When entering the offline settlement processing, the processor 11 acquires the transaction date and time and the transaction amount from the offline settlement command as ACT11. Also, the processor 11 acquires the image captured by the camera 14 as ACT12. Then, the processor 11 uses the object recognition technology as ACT13 to identify the medium used for online settlement, such as a credit card, from the image.

[0073] The processor 11 checks whether the credit card can be identified as ACT14. If the credit card cannot be identified, the processor 11 determines NO in ACT14 and returns to ACT12. In this way, the processor 11 sequentially acquires the images captured by the camera 14 and waits for the credit card to be identified by the object recognition process.

[0074] When the credit card is identified, the processor 11 determines YES in ACT14 and proceeds to ACT15. The processor 11 calculates the feature amount of the image of the part where the credit card is identified as ACT15, refers to the card database 131, and compares it with the appearance feature data of each credit card. Then, the processor 11 checks whether a credit card with similar appearance features can be identified as ACT16. If the credit card cannot be identified, the processor 11 determines NO in ACT16 and returns to ACT12.

[0075] If the credit card can be identified, the processor 11 determines YES in ACT16 and proceeds to ACT17. The processor 11 cuts out the area where the credit card is copied from the frame image in which the credit card could be identified as ACT17, and acquires the image of the credit card. Here, the processor 11 realizes the function as the acquisition means 112 through the processes of ACT12 to ACT17.

[0076] The processor 11 executes a masking process on the image of the credit card as ACT18. That is, the processor 11 acquires the mask data of the identified credit card from the card database 131. Then, the processor 11 covers the image of the credit card with this mask data to make a part of the image invisible. Specifically, the processor 11 makes the image of the area excluding the embossed card number, expiration date, and cardholder name in the image of the credit card invisible. Here, the processor 11 realizes the function as the processing means 113 through the process of ACT18.

[0077] After finishing the masking process, the processor 11 edits the print data as ACT19. The print data is data including the image of the credit card with a part made invisible by the masking process, the transaction amount and transaction date and time information acquired in the process of ACT11, and a signature field. The signature field is a blank for the credit card user to sign. The processor 11 commands the accounting machine 2 to print the print data as ACT20. By this command, the print data is transmitted from the recognition device 1 to the accounting machine 2 via the communication line 3. After finishing the print command, the processor 11 ends the offline settlement process. Thus, the processor 11 ends the information processing of the procedure shown in the flowchart of FIG. 5.

[0078] Return to the description of FIG. 8. The processor 21 of the accounting machine 2 that controls the transmission of offline payment commands waits for a print command as ACT41. When a print command is received via the recognition device interface 31, the processor 21 determines YES in ACT41 and proceeds to ACT42. The processor 21 controls the printer 28 to print the print data included in the print command on the receipt paper as ACT42. Thus, for example, an offline payment receipt 80 with the layout shown in FIG. 9 is printed and issued by the printer 28. Here, the processor 11 realizes the function as the control means 114 through the processes of ACT19 and ACT20.

[0079] As shown in FIG. 9, on the offline payment receipt 80, together with header information 81 specific to the receipt such as the store name or logo, an image 82 of the credit card, the transaction amount (credit amount) and the transaction date and time 83, a signature field 84, etc. are printed. In the image 82 of the credit card, the second region 822 excluding the first region 821 of the embossed card number, expiration date and cardholder name is made invisible by the masking process.

[0080] In this way, on the offline payment receipt 80, the transaction amount and the transaction date and time are recorded together with the information necessary for authenticating the card number, expiration date and cardholder name embossed on the credit card. Also, the signature field 84 is formed. Therefore, when the credit card user signs in the signature field 84, the offline payment receipt 80 will perform the same function as a printed matter printed by a conventional dedicated printer. That is, even if it goes offline due to a failure of the system network 6 or the authentication server 7, etc., payment with a credit card is possible.

[0081] Furthermore, the recognition device 1 and the cash register 2 for issuing the offline settlement receipt 80 are devices that are always available at the store's cashier location (cash register). Therefore, when going offline, it is possible to quickly switch to offline-compatible credit card settlement. As a result, it is possible to avoid keeping customers waiting or asking for payment methods other than credit cards, and to improve the customers' trust in the store. Also, for the store, there is the merit that a dedicated printer is not required, thus reducing management costs.

[0082] In addition, the store clerk only needs to hold the credit card over the reading window, so the operation is simple and not burdensome. Incidentally, when the store clerk holds the back of the credit card over the reading window, the credit card cannot be identified, so the offline settlement receipt 80 is not issued. The back of the credit card contains important information from a security perspective, such as the cardholder's signature and security number. However, since these important pieces of information are never recorded on the offline settlement receipt 80, the store clerk can safely handle the situation when offline.

[0083] On the other hand, on the second region 822 on the surface of the credit card, there is displayed the logo of the credit card issuing company, etc. Also, there may be a display of the cardholder's face photo. In the present embodiment, the second region 822 is made invisible by mask processing. Therefore, it also has the effect of preventing the leakage of information of the credit card issuing company or the personal information of the cardholder from the offline settlement receipt 80.

[0084] [Second Embodiment] Incidentally, the offline payment receipt is sent from the store to the credit card issuing company. Upon receiving this transmission, the person in charge at the credit card issuing company needs to register information such as the card number, expiration date, cardholder name, transaction date and time, and transaction amount recorded on the offline payment receipt in the authentication server 7. This registration work is extremely burdensome. Next, a second embodiment of the payment system that can reduce the burden of the above-described registration work will be described. Here, the points different from the first embodiment will be described in detail, and the same parts as those in the first embodiment will be denoted by the same reference numerals and their description will be omitted.

[0085] Also in the second embodiment, the payment system includes a recognition device and a cash register 2. And the cash register 2 can be directly applied as that of the first embodiment. The recognition device is partially different in function from that of the first embodiment. Therefore, hereinafter, the recognition device in the second embodiment will be referred to as recognition device 10.

[0086] FIG. 10 is a block diagram showing the main circuit configuration of the recognition device 10. The difference between the recognition device 10 and the recognition device 1 of the first embodiment lies in a part of the functions of the processor 11. That is, the recognition device 10 implements a control program so that the processor 11 functions as a recognition unit 115 and a conversion unit 116 in addition to a specifying unit 111, an acquisition unit 112, a processing unit 113, and a control unit 114.

[0087] The recognition unit 115 is a unit that recognizes information necessary for online payment authentication from the image of the medium acquired by the acquisition unit. As described in the first embodiment, the information necessary for online payment authentication is, for example, the card number, expiration date, and cardholder name. The recognition unit 115 specifies the area where the card number, expiration date, and cardholder name are embossed from the image of the medium, and executes character recognition processing on the image of that area to recognize the card number, expiration date, and cardholder name.

[0088] The conversion means 116 is a means for converting the information recognized by the recognition means into a code that can be read by the code reader. The code reader is, for example, a reader for two-dimensional codes such as QR Code (registered trademark). The conversion means 116 encrypts the information recognized by the recognition means with a predetermined encryption key and converts it into a code. Therefore, the recognition device 10 stores the encryption key 132 for encrypting the code in the auxiliary storage device 13.

[0089] FIG. 11 is a schematic diagram showing the main data structure of the card record 1312 stored in the card database 131 in the second embodiment. As shown in the figure, the card record 1312 includes items of character recognition area data in addition to the card ID, card company, card name, appearance feature data, mask data, etc.

[0090] The character recognition area data is data for specifying the area where the card number, expiration date, and cardholder name are embossed on the credit card identified by the card ID.

[0091] FIG. 12 is a flowchart showing the specific procedure of the offline payment process in the second embodiment. In FIG. 12, the same reference numerals are given to the processing steps common to the flowchart of the offline payment process of the first embodiment shown in FIG. 6. That is, when entering the offline payment process, the processor 11 executes the same processing as in the first embodiment from ACT11 to ACT18.

[0092] After finishing the mask processing of ACT18, the processor 11 executes character recognition processing as ACT51. That is, the processor 11 acquires the character recognition area data of the identified credit card from the card record 1312. Then, the processor 11 extracts the area specified by the character recognition area data from the image of the credit card obtained in the process of ACT17, and executes character recognition processing on that area using an application program for character recognition. By this processing, the characters of the card number, expiration date, and cardholder name embossed in the area specified by the character recognition area data are recognized. Here, the processor 11 realizes the function as the recognition means 115 by the process of ACT51.

[0093] The processor 11 converts the recognized characters as ACT52, that is, the information of the card number, expiration date, and cardholder name, and the information of the transaction date and time and transaction amount obtained in the process of ACT11, into a code readable by the code reader. For example, the processor 11 converts it into a two-dimensional code such as a QR code (registered trademark). At this time, the processor 11 encrypts at least the card number with the encryption key 132 and then converts it into a two-dimensional code. Note that the information to be encrypted is not limited to the card number. At least one of the expiration date, cardholder information, transaction amount, or transaction date and time may be encrypted together with the card number and then converted into a two-dimensional code. Here, the processor 11 realizes the function as the conversion means 116 by the process of ACT52.

[0094] The processor 11 edits the print data as ACT53. The print data is data including the image of the credit card partially made invisible by the mask processing, the information of the transaction amount and transaction date and time obtained in the process of ACT11, the two-dimensional code converted in the process of ACT52, and the signature field. The processor 11 issues a print command for the print data to the accounting machine 2 as ACT54. By this command, the print data is transmitted from the recognition device 10 to the accounting machine 2 via the communication line 3. After finishing the print command, the processor 11 ends the offline settlement process.

[0095] Thus, in the second embodiment, for example, the receipt 90 for offline payment with the layout shown in FIG. 13 is printed and issued by the printer 28. As shown in FIG. 13, on the receipt 90 for offline payment, in addition to the header information 91 unique to the receipt such as the store name or logo, an image 92 of the credit card, the transaction amount (credit amount) and the transaction date and time 93, a signature field 94, etc., a two-dimensional code 95 is printed. In the image 92 of the credit card, the second region 922 excluding the first region 921 of the embossed card number, expiration date and cardholder name is made invisible by mask processing.

[0096] The two-dimensional code 95 is obtained by converting the information of the credit card number, expiration date and cardholder name, and the information of the transaction date and time and the transaction amount into a two-dimensional code. And at least the card number is encrypted by the encryption key 132.

[0097] The receipt 90 for offline payment is sent from the store to the credit card issuing company. Upon receiving this sending, the person in charge at the credit card issuing company reads the two-dimensional code 95 recorded on the receipt 90 for offline payment with a code reader. Then, in an information processing device connected to the code reader, for example, in a personal computer, the information of the credit card number, expiration date and cardholder name, and the information of the transaction date and time and the transaction amount included in the two-dimensional code 95 are acquired. At this time, since the card number is encrypted by the encryption key 132, it is decrypted by a decryption key corresponding to the encryption key 132. The person in charge only needs to upload the information of the credit card number, expiration date and cardholder name, and the information of the transaction date and time and the transaction amount acquired by the information processing device to the authentication server 7. That is, the person in charge can greatly reduce the trouble of registering the information such as the card number, expiration date, cardholder name, transaction date and time, and transaction amount recorded on the receipt 90 for offline payment to the authentication server 7.

[0098] The embodiments of the payment system have been described above, but such embodiments are not limited thereto.

[0099] In the above embodiment, the processing means 113 made a part of the image of the credit card, i.e., the second region 822 or 922, invisible by mask processing. The processing for making it invisible is not limited to mask processing. Processing such as blurring or mosaic processing may be used. Also, trimming processing for removing the region to be made invisible may be used.

[0100] In the above embodiment, the embossed region was made visible. The region to be made visible does not necessarily have to be an embossed region. Even for a medium on which information necessary for online payment authentication is displayed by a method other than embossing, by making the display region visible or making the region other than the display region invisible, the same operational effects as those of the present embodiment can be achieved.

[0101] In the second embodiment, the case where the conversion means 116 converts the information recognized by the recognition means 115 into the two-dimensional code 95 was illustrated. The code is not limited to the two-dimensional code 95. Any code that can be read by a code reader, such as a barcode, may be used.

[0102] In the above embodiment, the payment system 100 in which the recognition device 1 and the accounting machine 2 are separate was illustrated. The payment system may be a system in which the recognition device 1 and the accounting machine 2 are integrated, such as a self-POS terminal.

[0103] In the above embodiment, the processor 21 of the accounting machine 2 recognized whether the system network 6 was offline or not, and when it was offline, it sent an offline payment command to the recognition device 1. Regarding this point, for example, the accounting machine 2 or the recognition device 1 is provided with a mode switch for manually switching to the offline mode. And when the offline mode is selected by this mode switch, the recognition device 1 forcibly executes offline payment processing. Even with such a configuration, the same operational effects as those of the present embodiment can be achieved.

[0104] In addition, although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope of the invention and are included in the invention described in the claims and the equivalent scope thereof. Incidentally, the description of the claims of the present application at the time of filing is appended below. [C1] imaging means, and identifying means for identifying a product from the image captured by the imaging means, acquisition means for acquiring an image of a medium used in online payment from the image captured by the imaging means, recording means for recording information related to the transaction of the product identified by the identifying means on a recording medium together with the image of the medium acquired by the acquisition means, A payment system comprising: [C2] processing means for making the image of the medium acquired by the acquisition means invisible while leaving the part of the information necessary for the authentication of the online payment, further comprising The recording means records the image of the medium processed by the processing means. The payment system according to C1. [C3] recognition means for recognizing information necessary for the authentication of the online payment from the image of the medium acquired by the acquisition means, conversion means for converting the information recognized by the recognition means into a code readable by a code reader, further comprising The recording means further records the code converted by the conversion means on the recording medium. The payment system according to C1 or 2. [C4] The conversion means encrypts the information recognized by the recognition means with a predetermined encryption key to convert the code. The payment system according to C3. [C5] imaging means, and communication means with an accounting machine equipped with recording means, identifying means for identifying a product from the image captured by the imaging means, acquisition means for acquiring an image of a medium used in online payment from the image captured by the imaging means, control means for controlling to record information related to the transaction of the product identified by the identifying means together with the image of the medium acquired by the acquisition means in the recording means of the accounting machine, A recognition device comprising: [C6] A computer of a recognition device comprising imaging means and communication means with an accounting machine equipped with recording means, identifying means for identifying a product from the image captured by the imaging means, acquisition means for acquiring an image of a medium used in online payment from the image captured by the imaging means, and Control means for controlling the recording means of the accounting machine to record information related to the transaction of the product identified by the identifying means together with the image of the medium acquired by the acquiring means. A program for causing the system to function as such.

Description of Symbols

[0105] 1, 10… Recognition device, 2… Accounting machine, 4… Imaging unit, 5… Recording unit, 6… System network, 7… Authentication server, 11, 21… Processor, 12, 22 Main memory, 23, 33… Auxiliary storage device, 14… Camera, 15… Touch panel, 16… Accounting machine interface, 24… Clock, 25… Communication interface, 26… Keyboard, 27… Display, 28… Printer, 29… Card reader, 30… Change machine interface, 31… Recognition device interface, 80, 90… Offline settlement receipt, 111… Specifying means, 112… Acquisition means, 113… Processing means, 114… Control means, 115… Recognition means, 116… Conversion means, 131… Card database, 132… Encryption key.

Claims

1. An imaging means, A specifying means for specifying a product from an image captured by the imaging means, An acquiring means for acquiring an image of a medium used for online payment from an image captured by the imaging means, A recording means for recording information related to a transaction of the product specified by the specifying means together with the image of the medium acquired by the acquiring means on a recording medium, A processing means for making the image of the medium acquired by the acquiring means invisible except for a portion of information necessary for authentication of the online payment, comprising, The recording means is a payment system that records the image of the medium processed by the processing means.

2. A recognizing means for recognizing information necessary for authentication of the online payment from the image of the medium acquired by the acquiring means, A converting means for converting the information recognized by the recognizing means into a code readable by a code reader, further comprising, The recording means further records the code converted by the converting means on the recording medium. The payment system according to claim 1.

3. The converting means encrypts the information recognized by the recognizing means with a predetermined encryption key to convert the code. The payment system according to claim 2.

4. An imaging means, A communication means with an accounting machine equipped with a recording means, A specifying means for specifying a product from an image captured by the imaging means, An acquiring means for acquiring an image of a medium used for online payment from an image captured by the imaging means, A control means for controlling to record information related to a transaction of the product specified by the specifying means together with the image of the medium acquired by the acquiring means in the recording means of the accounting machine, Processing means for visualizing the image of the medium acquired by the acquisition means, leaving only the portion of the information necessary for authentication of the online payment. comprising The recording means is a recognition device that records the image of the medium processed by the processing means.

5. A computer of a recognition device including an imaging means and a communication means with an accounting machine having a recording means, Identification means for identifying a product from an image captured by the imaging means, Acquisition means for acquiring an image of a medium used in online payment from an image captured by the imaging means, Control means for controlling to record, in the recording means of the accounting machine, information related to the transaction of the product identified by the identification means, together with the image of the medium acquired by the acquisition means, and Processing means for visualizing the image of the medium acquired by the acquisition means, leaving only the portion of the information necessary for authentication of the online payment. to function as The recording means is a program that records the image of the medium processed by the processing means.

Images