Payment device and program
The payment device addresses the issue of forgotten items by comparing pre- and post-transaction images to notify users, thereby reducing item loss in self-service checkout systems.
Patent Information
- Application Number
- JP2021031968
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-01
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2041-03-01
AI Technical Summary
Conventional self-service checkout devices struggle to effectively reduce the occurrence of items left behind by customers.
A payment device equipped with an imaging unit that captures images before and after a transaction, comparing these images to detect discrepancies and notify the user if items are left behind, utilizing a reading unit, payment unit, and notification unit to facilitate accurate item retrieval.
Reduces the likelihood of customers forgetting items by providing real-time notifications when items are left in the payment device, enhancing the efficiency and accuracy of self-checkout processes.
Smart Images

Figure 0007588005000001 
Figure 0007588005000002 
Figure 0007588005000003
Abstract
Description
[Technical field]
[0001] An embodiment of the present invention relates to a payment device and a program. [Background technology]
[0002] In recent years, stores such as supermarkets have been provided with self-service checkout machines where customers can register products and make payments. Such checkout machines may also be equipped with a camera that captures an image of the customer operating the checkout machine. Conventionally, a technology has been proposed for checking whether a customer has left anything behind when using the checkout machine by using the captured image.
[0003] However, with the conventional checkout devices described above, if a customer leaves something behind, it is possible to identify the customer and the item by looking at the captured image, but it is difficult to reduce the occurrence of lost items. Summary of the Invention [Problem to be solved by the invention]
[0004] An object of the present invention is to provide a payment device and a program that can reduce the number of items left behind at the payment device. [Means for solving the problem]
[0005] The payment device according to the present embodiment includes a reading unit that reads products to be purchased, a payment unit that performs payment processing for the products read by the reading unit for one transaction, a placement area in which items can be placed, an imaging unit that images the placement area, and a notification unit that compares, among the images acquired by the imaging unit, a first image taken before the products related to the one transaction are read and a second image taken at the time of completion of the payment processing, and issues a notification if the two images differ. a storage unit that stores an image captured after the transaction as the first image for a next transaction when the first image before the reading of the commodity related to the transaction matches the second image at the time of completion of the payment process; Equipped with. The notification unit compares the first image stored in the storage unit with the second image of a next transaction. [Brief description of the drawings]
[0006] [Figure 1] FIG. 1 is a front view showing the appearance of a self-checkout device according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating a hardware configuration of the self-checkout device according to the embodiment. [Diagram 3] FIG. 3 is a functional configuration diagram illustrating functions of the settlement device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a state in which an imaging area of a camera of a self-checkout device according to an embodiment is viewed from above. [Diagram 5] FIG. 5 is a diagram illustrating an example of an imaging area of the self-checkout device according to the embodiment when the camera is rotated, as viewed from above. [Figure 6] FIG. 6 is a flowchart illustrating an example of the flow of the imaging process of the self-checkout apparatus according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0007] An embodiment of a payment device will be described in detail below with reference to the accompanying drawings. In this embodiment, a payment device is a self-checkout device that allows customers to register products and make payments by themselves.
[0008] 1 is a front view showing the appearance of a self-checkout terminal 100 according to an embodiment. As shown in FIG. 1, the self-checkout terminal 100 includes a payment device 1, a basket placement shelf 2, and a bagging shelf 3.
[0009] The settlement device 1 comprises a first housing 11 and a second housing 12. The first housing 11 comprises a door 111 that can be opened and closed. The door 111 rotates vertically around a hinge portion 112. The first housing 11 houses therein a banknote change machine (banknote deposit and withdrawal device) and a coin change machine (coin deposit and withdrawal device) that constitute the deposit and withdrawal unit 40. The second housing 12 houses therein the control unit 10.
[0010] The basket shelf 2 is a storage stand on which the basket is placed when an item in the basket is taken out and held over the scanner 50. The basket shelf 2 is provided on one side of the payment device 1.
[0011] The bagging shelf 3 is a table for bagging the scanned products. A temporary storage table 34 is also provided on the bagging shelf 3. The temporary storage table 34 is a table for temporarily placing products, etc. For example, fragile products such as eggs and tofu are temporarily placed on the temporary storage table 34 without being immediately put into a bag when the symbol is read by the scanner 50, in order to store them at the top of the bag. The bagging shelf 3 is provided on the other side of the payment device 1 (opposite the basket storage shelf 2).
[0012] The scanner 50 reads the appearance of the product to be purchased and the code (such as a barcode) attached to the product in order to identify the product. The scanner 50 also includes a printer 51 that prints receipts related to the product sales data processing executed by the control unit 10. The printer 51 has a receipt discharge tray 52 that supports the discharged receipt protruding from the first housing 11. In other words, the receipt discharge tray 52 is a convex-shaped protrusion that protrudes from the first housing 11. The card reader 53 reads credit cards related to the payment processing executed by the control unit 10.
[0013] A monitor 61 is provided on the top surface of the scanner 50. The monitor 61 displays an image under the control of the control unit 10. A touch panel 62 is provided on the surface of the monitor 61, and outputs to the control unit 10 information based on the position touched by the operator.
[0014] The camera 71 is an example of an imaging unit. The camera 71 is provided, for example, above the monitor 61. The camera 71 captures an image of an area provided on the device itself where an item can be placed (hereinafter also referred to as a placement area). The area that the camera 71 can capture (hereinafter also referred to as an imaging area) will be described later. The camera 71 may be located anywhere other than above the monitor 61 as long as it captures an image of a placement area provided on the device itself where an item can be placed.
[0015] As described later, the camera 71 may be configured to include a rotation mechanism that can change the area that can be captured (hereinafter also referred to as the imaging area) in the left-right direction (or the up-down direction) in the figure. In this case, the imaging control unit 104 described later controls the rotation mechanism of the camera 71 and rotates the camera 71 to change the imaging area of the camera 71.
[0016] Next, a description will be given of a hardware configuration of the self-checkout terminal 100. FIG 2 is a block diagram showing an example of a hardware configuration of the self-checkout terminal 100.
[0017] 2, the settlement device 1 includes a control unit 10, an I / O device control unit 81, and a communication I / F 82. The communication I / F (interface) 82 connects the device itself to be able to communicate with the bagging shelf 3. The I / O device control unit 81 connects the banknote change machine 41, the coin change machine 42, the LEDs 43-47, the scanner 50, the printer 51, the card reader 53, the monitor 61, the touch panel 62, the camera 71, and the sensor 73 to the control unit 10.
[0018] Meanwhile, the bagging shelf 3 further includes an I / O device control unit 31, a communication I / F 32, and a weighing machine 33. The weighing machine 33 weighs the weight of the items placed on the bagging shelf 3. The communication I / F (interface) 32 connects the device itself to the payment device 1 so as to be able to communicate with it. That is, the I / O device control unit 31 connects the weighing machine 33 to the control unit 10 via the communication I / Fs 32 and 82. The weighing machine 33 weighs the weight of the items on the bagging shelf 3 to prevent fraud.
[0019] The control unit 10 has a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The ROM stores various computer programs and various data executed by the CPU. The RAM temporarily stores data and computer programs when the CPU executes a computer program.
[0020] Next, the functional configuration of the control unit 10 of the payment device 1 according to the embodiment will be described. Fig. 3 is a block diagram showing the functional configuration of the payment device 1. The control unit 10 functions as a reading unit 101, a registration unit 102, a payment unit 103, an imaging control unit 104, an acquisition unit 105, a notification unit 106, and a storage unit 107 by the CPU operating according to a control program stored in the ROM or RAM. Note that each of the above functional configurations may be realized by hardware, and it is sufficient that the payment device 1 has the above functions.
[0021] The reading unit 101 is an example of a reading unit. The reading unit 101 performs a reading process of a product to be purchased in cooperation with the scanner 50. For example, when a customer holds an image of a product code over the scanner 50, the scanner 50 reads the code and outputs the product code. When the scanner 50 outputs the product code, for example, a PLU (Price Look Up) file stored in a storage unit of the scanner itself or an external device connected online is referenced. The PLU file records the name and price of the product in association with the product code, for example, in the form of a table.
[0022] The registration unit 102 is an example of a registration unit. The registration unit 102 records information associated with the product code read by the scanner 50, among information stored in the PLU file referenced by the control unit 10, as information on the product to be purchased, and adds the price of the product to the purchase amount.
[0023] The settlement unit 103 is an example of a settlement unit. The settlement unit 103 performs settlement processing for one transaction of products read by the reading unit 101. For example, when a customer operates to proceed to settlement, the total price of the registered products is displayed on the monitor 61, and the settlement unit 103 starts accepting the payment processing by the customer. In the case of cash settlement, when money is deposited in the bill change machine and the coin change machine, the settlement unit 103 performs processing to calculate the difference with the price (change). Furthermore, when change is available, the settlement unit 103 performs processing to dispense the change from the bill change machine and the coin change machine.
[0024] The imaging control unit 104 is an example of an imaging control unit. The imaging control unit 104 controls the camera 71 to perform a process of imaging a placement area provided in the device itself. Specifically, the imaging control unit 104 performs a process of imaging the placement area with the camera 71 before a commodity related to one transaction is read. In addition, when the payment process is completed, that is, when one transaction is finished, the imaging control unit 104 performs a process of imaging the placement area with the camera 71.
[0025] Here, the imaging area of the camera 71 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a diagram showing an example of the imaging area of the camera 71 of the self-checkout device 100 as viewed from above. As shown in Fig. 4, the first housing 11 is provided with an insertion slot (coin insertion slot) 421 for coins to be deposited into the coin change machine 42 on one end side of the upper surface.
[0026] The first housing 11 (deposit / withdrawal section 40) has a coin discharge tray 422, a reject tray 423, a banknote deposit slot 411 and a banknote discharge slot 412 arranged in a stepped manner from the rear side, where the money placement section 70 and coin deposit slot 421 are provided, to the front side.
[0027] Moreover, the coin discharge tray 422 located in the middle tier is located closer to the front in the depth direction of the first housing 11 than the money placement unit 70 and the coin insertion slot 421 located in the upper tier. Moreover, the banknote insertion slot 411 and the banknote ejection slot 412 located in the lower tier are located closer to the front in the depth direction of the first housing 11 than the coin ejection tray 422 located in the middle tier.
[0028] The coin discharge tray 422 is a tray that receives coins discharged from the coin change machine 42. The reject tray 423 is a tray that receives coins that should not be stored in the coin change machine 42 (rejected coins), such as deformed coins, foreign coins, and counterfeit coins.
[0029] As shown in FIG. 4, the coin discharge tray 422 is provided at the end portion of the settlement apparatus 1 opposite to the end portion in the width direction where the coin insertion slot 421 is provided.
[0030] The banknote input port 411 is an input port for inputting banknotes to be deposited into the banknote change machine 41. The banknote discharge port 412 is an discharge port for discharged banknotes from the banknote change machine 41.
[0031] In addition, LEDs 43 to 46 for notifying operation procedures and errors are provided near the coin insertion slot 421, the coin ejection tray 422, the reject tray 423, the bill insertion slot 411, and the bill ejection slot 412, respectively.
[0032] In the above-described configuration, the camera 71 captures an image of the imaging area 92. Here, the imaging area 92 is designed in advance to include the entire area of the self-checkout terminal 100. Specifically, the imaging area 92 is designed to include a placement area (e.g., the temporary table 34) provided in the self-checkout terminal 100. With this configuration, the camera 71 is able to capture an image of the placement area provided in the self-checkout terminal 100.
[0033] It is also possible that the imaging area of camera 71 is narrower than imaging area 92 in Fig. 4, and therefore it may be impossible to image a desired area (such as temporary stand 34). In such a case, for example, camera 71 may be provided with a rotation mechanism that can change the imaging area in the left-right direction in the figure, so that the entire area of self-checkout terminal 100 or a desired area can be imaged by rotating camera 71, as shown in Fig. 5.
[0034] FIG. 5 is a diagram showing an example of an imaging area of the self-checkout terminal 100 according to the embodiment when the camera 71 is rotated, as viewed from above.
[0035] 5, it is assumed that the default imaging direction of the camera 71 is the front direction of the self-checkout terminal 100, and that the imaging area 931 including the customer operating the self-checkout terminal 100 is imaged. Note that the imaging area 931 is narrower than the imaging area 92 described in FIG. 4, and does not include the temporary stand 34 in the default state.
[0036] In this case, the imaging control unit 104 changes the imaging area 931 of the camera 71 to the imaging area 932, for example, by rotating the camera 71 to the left in the figure when the payment process is completed.As a result, the imaging control unit 104 can cause the camera 71 to capture an image of the temporary storage table 34, where items are likely to be left behind, upon completion of the payment process.
[0037] When a new transaction is started, it is preferable that the imaging control unit 104 captures the actions of the customer, such as scanning the product, by returning the imaging area of the camera 71 to the default state (imaging area 931). This makes it possible to detect fraudulent acts, for example, based on the actions of the customer captured by the camera 71.
[0038] Returning to the explanation of Fig. 3, the acquisition unit 105 is an example of an acquisition unit. The acquisition unit 105 acquires an image of the placement area captured by the camera 71 before the commodity related to one transaction is read, that is, before the transaction (hereinafter referred to as a first image), and stores it in the RAM of the control unit 10 or the like. The acquisition unit 105 also acquires an image of the placement area captured by the camera 71 upon completion of the payment process (hereinafter referred to as a second image), and stores it in the RAM of the control unit 10 or the like.
[0039] The notification unit 106 is an example of a notification unit. The notification unit 106 judges whether or not there is a difference between images captured by the camera 71 before and after a transaction. Specifically, the notification unit 106 judges whether or not the first image and the second image acquired by the acquisition unit 105 match. In addition, the notification unit 106 performs processing to notify when the first image and the second image differ.
[0040] Specifically, when the images captured by the camera 71 before and after the transaction are different, the notification unit 106 performs a process of notifying the settlement device 1 of the presence of a left-behind item. For example, after the settlement process in the settlement unit 103, the notification unit 106 outputs a sound to notify the presence of a left-behind item and displays a message such as "You have left something behind" on the monitor 61 of the settlement device 1. The notification may also be made via the LEDs 43 to 46 of the settlement device itself. In this way, the customer can recognize that he or she has left something behind by receiving the notification, and can prevent the customer from leaving behind a wallet, coins, etc. placed in the placement area.
[0041] The storage unit 107 is an example of a storage unit. Based on the determination result of the notification unit 106, the storage unit 107 stores the second image acquired by the acquisition unit 105 as the first image of the next transaction. Specifically, when the first image of the product related to one transaction before the reading and the second image at the time of completion of the settlement process of the transaction match, the storage unit 107 stores the second image as the first image of the next transaction. In this case, the notification unit 106 compares the first image stored by the storage unit 107 with the second image of the next transaction. Note that the configuration may not use the storage unit 107, in which case the acquisition unit 105 acquires the first image for each transaction.
[0042] FIG. 6 is a flowchart showing an example of a process executed by the self-checkout terminal 100 according to the embodiment.
[0043] First, the acquisition unit 105 acquires a first image of the placement area captured before a transaction is performed before the product related to the transaction is read, and stores the first image in the RAM or the like of the control unit 10 (step S1). After the acquisition process is performed, the process proceeds to step S2.
[0044] The reading unit 101 cooperates with the scanner 50 to perform a reading process of the product to be purchased (step S2). After the reading unit 101 completes the reading process, the process proceeds to step S3.
[0045] The registration unit 102 registers the products to be purchased read by the reading unit 101, and determines whether the registration process is complete. If the registration process of the products to be purchased in one transaction is complete (step S3: Yes), the process proceeds to step S4. If the registration process of the products to be purchased in one transaction is not complete (step S3: No), the process proceeds to step S2.
[0046] In step S4, the settlement unit 103 of the control unit 10 performs a settlement process for the products for one transaction read by the reading unit 101 (step S4). After the settlement process is completed, the process proceeds to step S5.
[0047] When the payment process is completed, the image capturing control unit 104 controls the camera 71 to capture an image of the temporary placement table 34, which is the placement area. Next, the acquisition unit 105 acquires a second image of the placement area captured by the camera 71 (step S5), stores the image in the RAM of the control unit 10, and then proceeds to step S6.
[0048] As described in FIG. 5, if the camera 71 is configured to be rotatable, the imaging control unit 104 may rotate the camera 71 in the direction of the placement area to be monitored (temporary placement stand 34) upon completion of the payment process, thereby causing the camera 71 to capture an image of the placement area.
[0049] The notification unit 106 compares the first image of the product before it is read and the second image at the completion of the payment process among the captured images acquired by the acquisition unit 105, and determines whether there is a difference between the two images. If there is a difference between the captured images (step S6: No), the notification unit 106 performs a process to notify (step S7). Next, the process returns to step S5, and notification is continued until the first image and the second image match.
[0050] On the other hand, if it is determined in step S6 that there is no difference between the captured images (step S6: Yes), this process ends.
[0051] As described above, in the payment device according to this embodiment, the reading unit reads the products to be purchased. The payment unit performs payment processing for the products for one transaction read by the reading unit. The imaging unit then images a placement area where items can be placed. Furthermore, the notification unit compares, among the images acquired by the imaging unit, a first image taken before the products for one transaction are read with a second image taken at the completion of the payment processing, and issues a notification if the two images differ.
[0052] In this way, if a customer leaves an item behind, the payment device will be notified that the item has been left behind. This notification will enable the customer to become aware of the presence of the item left behind, thereby reducing the number of customers forgetting to take back items placed on the payment device.
[0053] The above-described embodiment can be modified as appropriate by changing a part of the configuration or function of the above-described device. Therefore, some modified examples of the above-described embodiment will be described below as other embodiments. Note that the following mainly describes the differences from the above-described embodiment, and a detailed description of the common points with the contents already described will be omitted. The modified examples described below may be implemented individually or in appropriate combination.
[0054] (Variation 1) For example, when a customer enters the imaging area of camera 71, the imaging control unit 104 detects that the customer is in front of the self-checkout terminal 100, and at the time of detection, performs a process of imaging the loading area of the terminal using camera 71, and the acquisition unit 105 acquires the first image as the first captured image, which is an image captured before the transaction.
[0055] (Variation 2) For example, the acquisition unit 105 may acquire a first captured image before the reading of a commodity related to one transaction as a reference image stored in advance in a ROM or the like of the control unit 10. By acquiring the first captured image as a reference, the processing of the imaging control unit 104 is reduced, and the CPU resources of the control unit 10 can be reduced.
[0056] (Variation 3) For example, when the images captured by the camera 71 before and after the transaction are different, the notification unit 106 may notify an external device of the presence of a left-behind item. Here, the external device is, for example, an attendant terminal used by a store clerk or an external server that stores information on left-behind items. By notifying the external device of the presence of a left-behind item, even if there is no store clerk near the self-checkout terminal 100, the information that the item is left behind can be grasped. The store clerk can quickly provide the customer who left the item with information on how to deal with the lost item, which reduces the number of items left at the payment device being left behind.
[0057] (Variation 4) In the above embodiment, the temporary table 34 is the placement area, but it may be another part. For example, the placement area may be the money placement unit 70, the bill discharge port 412, the coin discharge tray 422, the reject tray 423, etc. of the first housing 11 shown in FIG. 4 (FIG. 5). In addition, when monitoring a plurality of placement areas, the notification unit 106 may compare the state of each placement area before and after the transaction. This can achieve the same effect as the above embodiment, and therefore it is possible to reduce forgetting to take articles placed on the temporary table 34, the money placement unit 70, the bill discharge port 412, the coin discharge tray 422, the reject tray 423, etc.
[0058] The computer program executed by the self-checkout terminal 100 of this embodiment is provided in the form of an installable or executable file recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).
[0059] The computer program executed by the self-checkout terminal 100 of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The computer program executed by the self-checkout terminal 100 of the present embodiment may be provided or distributed via a network such as the Internet.
[0060] Furthermore, the computer program executed by the self-checkout terminal 100 of the present embodiment may be provided by being pre-installed in a ROM or the like.
[0061] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]
[0062] 1 Payment device 2 Shelves 3. Bag Packing Shelf 10 Control section 11 First cabinet 12 Second cabinet 34 Temporary Stand 43 LED 44 LED 45 LED 46 LED 50 Scanner 61 Monitor 71 Camera 100 Self-checkout machine 101 Reading unit 102 Registration Department 103 Payment Department 104 Imaging control unit 105 Acquisition Department 106 Notification Department 107 Holding part [Prior art documents] [Patent documents]
[0063] [Patent Document 1] JP 2018-136692 A
Claims
1. A reading unit that reads the product to be purchased; a settlement unit that performs settlement processing for the merchandise read by the reading unit for one transaction; a placement area in which an item can be placed; An imaging unit that images the placement area; a notification unit that compares a first image captured by the imaging unit before the reading of the commodity related to one transaction with a second image captured at the time of completion of the settlement process, and issues a notification when the two images differ; a storage unit that stores an image captured after the transaction as the first image of a next transaction when the first image before the reading of the commodity related to the transaction and the second image at the time of completion of the payment process match; Equipped with The notification unit compares the first image stored in the storage unit with the second image of a next transaction. Payment device.
2. and an imaging control unit that changes an imaging area of the imaging unit when the payment process is completed, to cause the imaging unit to capture the placement area. The payment device according to claim 1 .
3. The notification unit compares the first image stored in advance with the second image. The settlement device according to claim 1 or 2.
4. the placement area is a temporary placement table for temporarily placing the product after the product has been read by the reading unit, The payment device according to any one of claims 1 to 3.
5. The computer of the payment device A reading step of reading a product to be purchased; a payment step of performing a payment process for the products read by the reading unit for one transaction; An imaging step of imaging a placement area on which an article can be placed; a notification step of comparing a first image obtained in the imaging step, which is obtained before the reading of the commodity related to the one transaction, with a second image obtained at the completion of the settlement process, and notifying the user when the two images are different; a storing step of storing an image captured after the transaction as the first image for a next transaction when the first image before the reading of the commodity related to the transaction matches the second image at the time of completion of the payment process; A program for executing The notification step compares the first image stored in the storage step with the second image of a next transaction. program.
Citation Information
Patent Citations
Crime prevention device and crime prevention program
JP2013152634A
Information processing apparatus and program
JP2018136692A
Toilet management system and toilet management method
JP2019113958A
Settlement device
JP2020095755A
