Self-payment device and program

Abstract

To provide a sales data processing device, a self adjustment device, and a program that can identify a gift voucher handled at a shop.SOLUTION: The sales data processing device executes settlement with a gift voucher in adjustment processing for registered commodities, and includes an identification unit. The identification unit compares a captured image output from an image capturing unit that captures an image of a product and reference information stored in a predetermined storage unit as information to be used as a reference for recognizing the commodities and the gift voucher from the captured image, thereby identifying the commodities and the gift voucher. Further, the identification unit compares the captured image output from the image capturing unit during adjustment processing after commodity registration with the reference information of the gift voucher.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] An embodiment of the present invention comprises: S The present invention relates to a self-service payment device and a program. [Background technology]

[0002] Conventionally, various kinds of gift certificates are available, and some stores do not handle them. Gift certificates that cannot be handled cannot be used for payment, but it is difficult for all store clerks to distinguish gift certificates reliably. For this reason, in a sales data processing device operated by a store clerk as an operator, it is required to easily determine whether a gift certificate presented by a customer is one that is handled by the store.

[0003] Furthermore, in the case of self-payment devices operated by customers as operators, a store clerk must come and check the gift certificate every time a customer tries to use the gift certificate for payment. Therefore, even if the gift certificate in hand is not handled by the store, the customer must wait for a store clerk. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide a method for dealing in gift certificates and cashless payments at stores. Ruse The present invention aims to provide a self-service payment device and program. [Means for solving the problem]

[0005] The self-payment device of the embodiment accepts an operation by a purchaser of a product and executes a payment process using a gift certificate, and includes an identification unit that identifies the gift certificate by comparing an image output by an imaging unit that images an item with reference information that is information used as a reference for recognizing the gift certificate, and a control unit that performs a payment process to settle the price of registered products, and the control unit uses the gift certificate to pay for the payment during the payment process. To show that of Controlson a display device installed in the device itself, The control is operated and displaying on the display device content prompting the user to photograph the gift certificate with the imaging unit, determining whether the gift certificate identified by the recognition unit is handled at the store, and if the gift certificate identified by the recognition unit is not handled at the store, the display device provides a notice that the gift certificate identified by the recognition unit is not handled at the store, and if the identified gift certificate is handled at the store, displaying candidate gift certificates as options on the display device, and when a selection is made from one of the options, the settlement process is paused and the user waits for an attendant to respond, and when the attendant's response is accepted, the pause on the settlement process is resumed. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a perspective view showing a configuration of a checkout system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing the hardware configuration of the POS terminal and the reading device. [Diagram 3] FIG. 3 is a diagram showing an example of the configuration of a PLU file, and is a diagram showing an example of classification of the PLU file. [Figure 4] FIG. 4 is a diagram showing an example of the data structure of each dictionary included in a PLU file. [Diagram 5] FIG. 5 is a block diagram illustrating an example of a functional configuration of the control unit. [Figure 6] FIG. 6 is a flowchart showing an example of the flow of the settlement process executed by the control unit. [Figure 7] FIG. 7 is a perspective view illustrating an example of the appearance of the self-service POS terminal according to the second embodiment. [Figure 8] FIG. 8 is a block diagram showing an example of a hardware configuration of the self-checkout POS terminal. [Figure 9] FIG. 9 is a block diagram illustrating an example of a functional configuration of the control unit. [Figure 10] FIG. 10 is a flowchart showing an example of the flow of a settlement process performed by the self-service POS terminal. [Figure 11] FIG. 11 is a diagram showing an example of a selection screen that the control unit causes to be displayed on the display unit. [Figure 12] FIG. 12 is a diagram showing an example of an instruction screen that the control unit causes the display unit to display. [Figure 13] FIG. 13 is a diagram showing an example of a selection screen that the control unit causes to be displayed on the display unit. [Figure 14] FIG. 14 is a diagram showing an example of a guide screen that the control unit causes to be displayed on the display unit. [Figure 15] FIG. 15 is a diagram showing an example of an instruction screen that the control unit causes the display unit to display. [Figure 16] FIG. 16 is a diagram showing an example of an error screen that the control unit causes the display unit to display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] (First embodiment) An embodiment will be described with reference to the drawings. Fig. 1 is a perspective view showing the configuration of a checkout system 1. The checkout system 1 is an example of a sales data processing device, and includes a POS terminal 11, a drawer 21, and a reading device 101. The operator in this embodiment is a store clerk.

[0008] Drawer 21 is placed on checkout table 51, and POS terminal 11 is placed on the upper surface of drawer 21. Drawer 21 is a box for storing money, and its opening operation is controlled by POS terminal 11.

[0009] The POS terminal 11 registers products read by the reading device 101, and settles and settles the prices of the registered products. The POS terminal 11 is equipped with a keyboard 22, a display device 23, a customer display device 24, and a touch panel 25. The keyboard 22 is provided on the top surface of the main body of the POS terminal 11, and is operated by an operator.

[0010] The display device 23 is disposed behind the keyboard 22 as viewed from the operator who operates the keyboard 22, and displays information on a display surface 23a provided facing the operator. The touch panel 25 is provided over the display surface 23a, and accepts operations according to the display content of the display device 23 at the position touched by the operator.

[0011] The customer display device 24 is disposed further back than the display device 23, and has a display surface 24a that displays information to be provided to customers. Note that, although the customer display device 24 has the display surface 24a facing the front side in Fig. 1, the orientation of the display surface 24a can be adjusted as desired so that information can be provided to customers in an optimal manner.

[0012] The reading device 101 is placed on a goods receiving surface 152 on the upper surface of a counter table 151. The counter table 151 is a horizontally long table, and is disposed so as to form an L shape together with the checkout table 51 on which the POS terminal 11 is placed.

[0013] A shopping basket 153 for storing product A is placed on the goods receiving surface 152. The shopping baskets 153 include a first shopping basket 153a brought in by a customer and a second shopping basket 153b positioned on either side of the reading device 101 from the first shopping basket 153a. Note that the shopping basket 153 is not limited to a so-called basket shape, and for example, the first shopping basket 153a may be a tray, and the second shopping basket 153b may be a paper box used in stores such as donut shops.

[0014] The reading device 101 is connected so as to be able to freely send and receive data to and from the POS terminal 11. The reading device 101 includes a housing 102, a reading window 103, a display / operation unit 104, a keyboard 107, a card reading groove 108, a customer display device 109, and a reading unit 110 (see FIG. 2).

[0015] The housing 102 is a thin rectangular case. The reading window 103 is made of a transparent material and constitutes a part of the front surface of the housing 102. The display / operation unit 104 includes a touch panel 105 and a display device 106, and is attached to the upper part of the housing 102. The touch panel 105 is provided overlapping the surface of the display device 106. The keyboard 107 is provided to the right of the display / operation unit 104.

[0016] The card reading groove 108 is part of a card reader that reads information stored on a magnetic tape such as a credit card, and is provided to the right of the keyboard 107. The customer display device 109 is disposed on the rear left side of the back of the display / operation unit 104 as seen by the operator, and provides information to customers. The reading unit 110 is equipped with an imaging unit 164 (see FIG. 2) on the rear side of the reading window 103.

[0017] The first shopping basket 153a brought in by the customer contains the product A for one transaction. The product A is moved to the second shopping basket 153b by the operator. During this movement, the product A is directed toward the reading window 103 of the reading device 101.

[0018] At this time, the imaging unit 164 arranged on the back side of the reading window 103 captures an image of the product A. The reading device 101 detects all or part of the product A included in the image (captured image) captured by the imaging unit 164. When the reading device 101 detects that all or part of the product A is included in the captured image, it outputs the captured image to the POS terminal 11.

[0019] The POS terminal 11 refers to a PLU file F1 (details will be described later, see Figure 3) in which information related to the sales registration of product A is associated with an image of product A for each product A, and identifies product A for which sales registration is to be performed by recognizing product A, which is a specific item, from the captured image, and records information related to the sales registration of the identified product A, such as the ID, classification, name, and unit price, in a sales master file (not shown) or the like, to perform sales registration.

[0020] 2 is a block diagram showing the hardware configuration of the POS terminal 11 and the reading device 101. The POS terminal 11 includes a control unit 60 that executes information processing. The control unit 60 is configured by connecting a ROM 62 (Read Only Memory) and a RAM 63 (Random Access Memory) via a bus to a CPU 61 (Central Processing Unit) that executes various arithmetic processes and controls each unit. The ROM 62 stores programs executed by the CPU 61.

[0021] The above-mentioned drawer 21, keyboard 22, display device 23, touch panel 25, and customer display device 24 are connected to the CPU 61 of the POS terminal 11. These (drawer 21, keyboard 22, display device 23, touch panel 25, and customer display device 24) are controlled by the control unit 60.

[0022] The keyboard 22 includes a numeric keypad 22d on which numbers such as "1," "2," "3," etc. and the multiplication operator "x" are displayed on the upper surface, a temporary closing key 22e, and a closing key 22f. The temporary closing key 22e accepts an instruction to start settlement for products registered up until the time of accepting operation of the temporary closing key 22e. The closing key 22f accepts an instruction to finalize the deposit amount.

[0023] The display / operation unit 104 of the reading device 101 also has keys corresponding to the numeric keypad 22d, the temporary closing key 22e, and the closing key 22f described above.

[0024] An HDD 64 (Hard Disk Drive) is connected to the CPU 61 of the POS terminal 11. The HDD 64 is an example of a storage unit, and stores programs and various files. When the POS terminal 11 is started, all or part of the programs and various files stored in the HDD 64 are copied to the RAM 63 and sequentially executed by the CPU 61. An example of a program stored in the HDD 64 is a program PR for processing sales data. An example of a file stored in the HDD 64 is a PLU file F1 distributed and stored from the store computer SC.

[0025] The PLU file F1 is a product file in which, for each product A displayed and sold in a store, information related to sales registration of the product A is associated with an image of the product A. Fig. 3 is a diagram showing an example of the configuration of the PLU file F1, and is a diagram showing an example of classification of the PLU file F1.

[0026] The PLU file F1 is divided into an agricultural produce dictionary F11, a fruit and vegetable dictionary F12, a fresh fish dictionary F13, a packed meat dictionary F14, and a gift certificate dictionary F15. The agricultural produce dictionary F11, the fruit and vegetable dictionary F12, the fresh fish dictionary F13, the packed meat dictionary F14, and the gift certificate dictionary F15 are dictionaries that store information about products that do not have code symbols assigned to them. In addition to these dictionaries, the PLU file F1 also stores information about products that have code symbols assigned to them.

[0027] Fig. 4 shows an example of the data structure of each dictionary included in the PLU file F1, and shows an example of the data structure of (a) the fruit and vegetable dictionary F12 and (b) the gift certificate dictionary F15 among the dictionaries F11 to F15. As shown in Fig. 4, the PLU file F1 stores, for each product A, information about the product (ID, classification, name, unit price, etc.), an image of the product, and feature values.

[0028] The gift certificate dictionary F15 stores information such as classification, name, and unit price, as well as images and feature values ​​for the many types of gift certificates. Here, feature values ​​are an example of reference information that is used as a criterion for recognizing products and gift certificates from captured images. The gift certificate dictionary F15 also has an item for setting usability / unusability. A gift certificate marked "usable" in this item is available at the store (cannot be used for payment). A gift certificate marked "unusable" in this item is not available at the store (cannot be used for payment).

[0029] Returning to Fig. 2, a communication interface 71 is connected to the CPU 61 of the POS terminal 11. The communication interface 71 executes data communication with the store computer SC. The store computer SC is also called a store server, and is installed in the back yard of the store. A PLU file F1 to be distributed to the POS terminal 11 is stored in an HDD (not shown) of the store computer SC.

[0030] Furthermore, a connection interface 72 connects the CPU 61 of the POS terminal 11 to the reading device 101, enabling data transmission and reception between the CPU 61 and the reading device 101. A printer 26 that prints on receipts and the like is also connected to the CPU 61 of the POS terminal 11. Under the control of the control unit 60, the POS terminal 11 prints the details of one transaction on a receipt.

[0031] The reading device 101 includes a control unit 160. The control unit 160 is configured by connecting a ROM 162 and a RAM 163 to a CPU 161 via a bus. The ROM 162 stores a program executed by the CPU 161. An imaging unit 164 and an audio output unit 165 are connected to the CPU 161. The operations of the imaging unit 164 and the audio output unit 165 are controlled by the control unit 160. The display / operation unit 104 is connected to the POS terminal 11 via a connection interface 171. The operation of the display / operation unit 104 is controlled by the control unit 60 of the POS terminal 11.

[0032] The imaging unit 164 is, for example, a color CCD image sensor or a color CMOS image sensor. The imaging unit 164 captures an image of an object through the reading window 103 under the control of the control unit 160, and outputs the captured image. For example, the imaging unit 164 captures a moving image at 30 fps. The frame images captured by the imaging unit 164 in sequence at a predetermined frame rate are stored in the RAM 163.

[0033] The audio output unit 165 is an audio circuit and a speaker for generating a preset warning sound, etc. The audio output unit 165 performs notification by audio such as a warning sound under the control of the control unit 160.

[0034] Furthermore, a connection interface 172 is connected to the CPU 161, which is connected to the connection interface 72 of the POS terminal 11 and enables data transmission and reception between the CPU 161 and the POS terminal 11. Under the control of the control unit 160, an image captured by the imaging unit 164 of the reading device 101 (an image including all or part of product A) is output via the connection interface 172 and input to the POS terminal 11 via the connection interface 72.

[0035] Next, the functional units of the control unit 160 and the control unit 60 that are realized by the CPU 161 and the CPU 61 sequentially executing programs will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the functional configuration of the control unit 160 and the control unit 60.

[0036] 5, the control unit 160 of the reading device 101 executes programs in sequence to realize the functions of an image capture unit 1601, an item detection unit 1602, and an image output unit 1603. Similarly, the control unit 60 of the POS terminal 11 executes programs in sequence to realize the functions of an item recognition unit 601, an item registration unit 602, and a gift certificate acceptance unit 603.

[0037] The image capturing unit 1601 outputs an imaging on signal to the imaging unit 164 to cause the imaging unit 164 to start an imaging operation. After the imaging operation starts, the image capturing unit 1601 sequentially captures frame images captured by the imaging unit 164 and stored in the RAM 163. The image capturing unit 1601 captures the frame images in the order in which they were stored in the RAM 163.

[0038] The item detection unit 1602 detects all or part of the item (item A or a gift certificate) included in the frame image captured by the image capture unit 1601, for example, using a pattern matching technique. Specifically, it extracts contour lines and the like from a binarized image of the captured frame image. It then compares the contour lines extracted from the most recent frame image with the contour lines extracted from the current frame image, and detects any changes, i.e., the reflection of the item pointed toward the reading window 103 for sales registration.

[0039] The image output unit 1603 outputs, to the POS terminal 11 via the connection interface 172, frame images captured by the image capture unit 1601 in which an article has been entirely or partially detected by the article detection unit 1602.

[0040] The item recognition unit 601 of the POS terminal 11 is an example of an identification unit. The item recognition unit 601 compares the captured image output by the imaging unit 164 with the basic information, and identifies the item (item A or a gift certificate) included in the captured image.

[0041] The item recognition unit 601 refers to the image in the PLU file F1 and recognizes item A as a specific item by obtaining surface conditions such as color tone and surface unevenness as features from an image of all or part of item A captured by the imaging unit 164 of the reading device 101.

[0042] The feature quantity is, for example, a parameterized external feature of a commodity or a gift certificate, such as a standard shape, a surface color, a pattern, a bumpy state, etc. Based on the recognition result of the item recognition unit 601, the POS terminal 11 specifies the commodity read by the reading device 101 from the commodities stored in advance in the PLU file F1.

[0043] This method of recognizing objects contained in an image is called generic object recognition.

[0044] The product registration unit 602 records sales registration information related to the product recognized by the item recognition unit 601, i.e., the product ID, classification, name, unit price, etc. identified from the captured image output by the reading device 101, in a sales master file or the like, and performs sales registration.

[0045] Here, when the POS terminal 11 finishes registering the product, it moves to the settlement process. The product recognition unit 601 compares the captured image output by the imaging unit 164 during the settlement process after the product registration with the reference information (e.g., feature amount) of the gift certificate. In other words, for the captured image input during the settlement process, the product recognition unit 601 estimates what has been read by the reading device 101 from among the captured images (gift certificates) pre-stored in the gift certificate dictionary F15 in the PLU file F1. More specifically, the product recognition unit 601 extracts, from the gift certificate dictionary F15, information on gift certificates whose similarity to the feature amount of the captured image is higher than a predetermined threshold value as being likely to match the captured image.

[0046] If the extracted gift certificate information has a usable / unusable setting of "unusable," the product recognition unit 601 outputs a message indicating that the gift certificate cannot be used. Also, if the extracted gift certificate information has a usable / unusable setting of "usable," the product recognition unit 601 outputs the gift certificate as an option.

[0047] Here, the color and pattern of the face of the gift certificate varies depending on the issuer. Hereinafter, gift certificates with the same issuer (i.e., the same color and pattern) but different amounts written on the face are referred to as gift certificates of the same type but different amounts.

[0048] The item recognition unit 601 recognizes gift certificates by general object recognition, and therefore also recognizes the amount printed on the face of the gift certificate as a pattern on the face of the certificate. Therefore, the item recognition unit 601 does not recognize the amount as a numerical value. Therefore, the item recognition unit 601 outputs gift certificates of a certain type with different amounts from various types of gift certificates as options, as gift certificates with a high degree of similarity.

[0049] By applying OCR (Optical Character Recognition / Reader) technology, it is possible to read the numbers indicating the amount printed on the face of the voucher. However, even in this case, the accuracy of OCR reading is not yet high enough to guarantee correct results, so a human (store clerk) must confirm the amount. On the other hand, misrecognition of gift certificate types has become rare, and there are often only two or three different amounts for the same type of gift certificate. Therefore, at the current stage, it is considered optimal to present all gift certificates of the same type but different amounts as options and leave the selection to the store clerk.

[0050] The gift certificate acceptance unit 603 displays the images of the gift certificates extracted by the item recognition unit 601 as options on the display device 23, and accepts an operation to select from the options using the touch panel 25. The operator first checks whether the type of gift certificate selected matches the gift certificate received from the customer, and if it does match, selects from the options the one that matches the amount on the face of the gift certificate received from the customer. The selection operation is performed by touching the position on the touch panel 25 where the option to be selected is displayed. In response to this, the control unit 60 of the POS terminal 11 determines that the amount of the gift certificate has been deposited for the purchase amount, and if there is a balance (also called the remaining amount) after deducting the amount of the gift certificate from the purchase amount, it requests this.

[0051] Since there are many types of gift certificates, it is difficult for an operator to determine whether the gift certificate presented by a customer is one that is accepted for use at the store. However, as described above, the image data of the gift certificate captured by the imaging unit 164 can be checked against the gift certificate dictionary F15, eliminating the hassle of visually comparing the gift certificate with the comparison table.

[0052] Next, a detailed description will be given of the operation of the checkout system 1. Fig. 6 is a flow chart showing an example of the flow of the settlement process executed by the control unit 60.

[0053] The control unit 60 starts the settlement process in response to a predetermined operation by the operator. The operation for starting the settlement process is received by the temporary settlement key 22e or a key equivalent to the temporary settlement key 22e provided on the display / operation unit 104.

[0054] In the following, an example will be described in which the screen display and operation reception during the settlement process are performed using the display device 23, touch panel 25, and keyboard 22 of the POS terminal 11, but in practice, these may also be performed using the display / operation unit 104 (display device 106, touch panel 105, and keyboard 107) of the reading device 101.

[0055] In the payment process, the control unit 60 displays payment options on the display device 23 (step S1). In the checkout system 1, payment can be made by the options of cash, credit card, and gift certificate. The control unit 60 causes the display device 23 to display buttons including letters or designs that distinguish each option, and receives operations on each button via the touch panel 25. The operator uses the touch panel 25 to declare which of the above options the customer will use to make the payment, based on what the customer says, the presentation of a gift certificate, or the like.

[0056] When payment by gift certificate is selected by the operator (Yes in step S2), the control unit 60 waits until the item recognition unit 601 recognizes the gift certificate (No in step S3). When the item recognition unit 601 recognizes the gift certificate (Yes in step S3), it refers to the usable / unusable setting in the gift certificate dictionary F15 for the recognized gift certificate, and determines whether the gift certificate is one that is handled at the store (step S4).

[0057] In step S4, if the item recognition unit 601 determines that the gift certificate is acceptable (Yes in step S4), the gift certificate acceptance unit 603 displays the candidate gift certificates recognized by the item recognition unit 601 as options on the display device 23 (step S5). The options here are gift certificates of the same type but different amounts.

[0058] Next, the gift certificate acceptance unit 603 waits for a selection from the candidates (No in step S6). The operator selects an option that matches the amount printed on the face of the gift certificate received from the customer. When the gift certificate acceptance unit 603 accepts the operation to select an option (Yes in step S6), the control unit 60 settles the remaining balance (step S7). In step S7, specifically, for example, the control unit 60 calculates the remaining balance by subtracting the amount of the gift certificate selected in step S6 from the settlement amount, and if the remaining balance is a positive number, accepts the settlement of the remaining balance in cash or the like.

[0059] In step S2, if an option other than a gift certificate (cash, credit card, etc.) is selected (No in step S2), the control unit 60 performs payment by other means (cash, credit card, etc.) (step S8).

[0060] Furthermore, if the item recognition unit 601 determines that the gift certificate recognized in step S3 cannot be used (No in step S4), the control unit 60 notifies the operator that the gift certificate cannot be used by displaying that on the display device 23 (step S9).

[0061] As described above, according to this embodiment, it is possible to determine whether a gift certificate is available at a store without relying on the memory of the store clerk. This allows even store clerks who are not knowledgeable about gift certificates to smoothly accept gift certificates available at the store and proceed with settlement and payment. It is also possible to eliminate inconveniences such as settling a payment with a gift certificate that is not available at the store.

[0062] Second Embodiment Next, a second embodiment will be described. In this embodiment, the description of the same parts as those described in the first embodiment will be omitted, and only the parts different from the first embodiment will be described. In the description, the same reference numerals will be used for the parts already described in the first embodiment.

[0063] 7 is a perspective view showing an example of the appearance of the self-service POS terminal 2. The self-service POS terminal 2 is an example of a self-service checkout device. The self-service POS terminal 2 is a device in which a customer himself acts as an operator to register products and make payments, and is also called a self-checkout device.

[0064] The self-service POS terminal 2 is a terminal for customers to register products to be purchased and make payments by themselves. The self-service POS terminal 2 includes a first loading platform 210 provided on the right side of the front, a second loading platform 220 provided on the left side of the front, and a first housing 230 provided in the center of the front.

[0065] A customer using the self-service POS terminal 2 places a basket or the like containing the products to be purchased on the first loading platform 210. The customer also places a bag to put the registered products in on the second loading platform 220. The customer uses a device placed on the first housing 230 to register the products removed from the basket. The customer then places the registered products in the bag placed on the second loading platform 220. The customer performs this registration for each product collected in the basket. When the customer has completed registration of each product, the customer uses a device provided in the first housing 230 to perform payment processing for the registered products. Through these steps, the customer performs registration processing and payment processing for the products to be purchased.

[0066] More specifically, the second loading platform 220 includes a base 221, a bag hanging hook 222, and a temporary placement platform 223. The bag hanging hook 222 and the temporary placement platform 223 are supported by a support 224 provided on the base 221 and are provided above the base 221. The base 221 is a platform on which products that are not suitable for being placed in a bag, such as products that are larger than a bag, are placed. The bag hanging hook 222 is a hook for hanging a bag for storing a registered product. The temporary placement platform 223 is a platform on which products that require careful bagging, such as fragile products, are temporarily placed.

[0067] The first housing 230 has therein an deposit / withdrawal unit 231 (see FIG. 8) that deposits and withdraws coins, banknotes, and the like. The first housing 230 also has a coin insertion slot 232, a coin dispensing outlet 233, a banknote insertion slot 234, and a banknote dispensing outlet 235. The coin insertion slot 232 is an entrance for coins that a customer deposits into the deposit / withdrawal unit 231 as payment for merchandise. The coin dispensing outlet 233 is an entrance for coins that are dispensed from the deposit / withdrawal unit 231 as change. The banknote insertion slot 234 is an entrance for banknotes that a customer deposits into the deposit / withdrawal unit 231 as payment for merchandise. The banknote dispensing outlet 235 is an entrance for banknotes that are dispensed from the deposit / withdrawal unit 231 as change. It is assumed that the amount (or quantity) of banknotes and coins stored in the deposit / withdrawal unit 231 is counted for each denomination using known technology.

[0068] The self-service POS terminal 2 includes a first housing 230 and, on the top surface thereof, a second housing 240, a display unit 250, a handy scanner 260, a reader / writer 270, and a warning light 280.

[0069] Second housing 240 includes scanner 241 (see FIG. 8) and printer 242 (see FIG. 8) therein. Second housing 240 also includes a reading window 243 through which scanner 241 reads a product code registered in a code symbol such as a barcode attached to a product. Reading window 243 transmits laser light emitted by scanner 241 to the outside of second housing 240, and transmits reflected light of the laser light to the inside of second housing 240.

[0070] Furthermore, the scanner 241 captures an image of a commodity that does not have a code symbol attached thereto, and recognizes the commodity name of the captured commodity by a general object recognition process. Here, the scanner 241 performs a function equivalent to the imaging unit 164 in the first embodiment. Therefore, the scanner 241 is an example of an imaging unit.

[0071] The scanner 241 first recognizes whether a code symbol is attached to a product held over the reading window 243. If a code symbol is attached, the scanner 241 reads the code symbol. On the other hand, if a code symbol is not attached, the scanner 241 recognizes the product by general object recognition.

[0072] The second housing 240 includes a receipt issuing port 244 for discharging receipts and the like output by the printer 242. The printer 242 discharges from the receipt issuing port 244 a receipt on which sales information of the processed merchandise is printed on paper.

[0073] The second housing 240 also supports a display unit 250 provided on the upper part of the second housing 240. The display unit 250 performs functions equivalent to the display device 23 and the display device 106 in the first embodiment, and is, for example, a liquid crystal display. The display unit 250 displays information on candidate products that are candidates for the recognized products. The display unit 250 also displays product information of registered products, etc. Furthermore, the display unit 250 displays a guide screen for informing the customer how to operate the self-service POS terminal 2, a total price of products, a deposit amount, a change amount, etc., and a settlement screen for selecting a payment method, etc.

[0074] The display unit 250 includes a touch panel 251 for operating the self-service POS terminal 2. The touch panel 251 performs functions corresponding to the touch panels 25 and 105 in the first embodiment. The touch panel 251 detects an operated (touched) location on the display unit 250, and determines that an operation request corresponding to a display element displayed on the display unit 250 has been made.

[0075] The handy scanner 260 is a handheld scanner that is used when it is difficult to hold a barcode or the like attached to a product over the reading window 243, for example, when the product is heavy or large.

[0076] The reader / writer 270 reads and writes information relating to electronic payments from and to storage media such as card media used for electronic payments, such as credit cards and electronic money.

[0077] The warning light 280 flashes, for example, in red, to notify a store clerk that an abnormality has occurred in the self-service POS terminal 2. The warning light 280 also notifies a store clerk that a customer has operated the self-service POS terminal 2 incorrectly.

[0078] Next, the hardware configuration of the self-service POS terminal 2 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing an example of the hardware configuration of the self-service POS terminal 2.

[0079] The self-service POS terminal 2 includes a control unit 201, a storage unit 202, a communication interface 204, a deposit / withdrawal unit 231, a scanner 241, a printer 242, a display unit 250, a touch panel 251, a handy scanner 260, a reader / writer 270, and a warning light 280. These units are connected to each other via a system bus 205 such as a data bus or an address bus.

[0080] The control unit 201 is a computer that controls the overall operation of the self-POS terminal 2 and realizes various functions of the self-POS terminal 2. The control unit 201 includes a CPU, a ROM, and a RAM. The CPU controls the overall operation of the self-POS terminal 2. The ROM is a storage medium that stores various programs and data. The RAM is a storage medium that temporarily stores various programs and rewrites various data. The CPU executes programs stored in the ROM or the storage unit 202, etc., using the RAM as a work area. In other words, the control unit 201 has the configuration of a general computer.

[0081] The storage unit 202 is a storage device such as an HDD or an SSD (Solid State Drive). The storage unit 202 stores a program PR and a PLU file F1 provided by a store computer SC that manages the self-service POS terminal 2.

[0082] The program PR is a program for implementing an operating system and functions of the self-service POS terminal 2. The program PR includes a program for implementing characteristic functions according to the present embodiment. By executing these programs, the control unit 201 realizes each function unit (described later) shown in FIG. 9.

[0083] The communication interface 204 is a communication interface for communicating with the store computer SC and the attendant terminal 300 via a network (not shown). The attendant terminal 300 is a terminal device used by a store clerk who is an attendant. The attendant (store clerk) looks after customers who are operating the self-service POS terminals 2 as necessary, and manages and monitors the self-service POS terminals 2.

[0084] 9 is a block diagram showing an example of the functional configuration of the control unit 201. The control unit 201 functions as an image capture unit 1601, an item detection unit 1602, an image output unit 1603, an item recognition unit 601, an item registration unit 602, a gift certificate acceptance unit 603, a standby unit 2011, and a release unit 2012. In other words, the control unit 201 has both the functions of the control unit 60 in the first embodiment and the functions of the control unit 160, and further has the functions of the standby unit 2011 and the release unit 2012.

[0085] A waiting unit 2011 suspends the payment process and waits for an attendant to respond when an operation to select from the options output by the item recognition unit 601 is received. A release unit 2012 releases the suspension of the payment process and resumes it when an attendant's response is received.

[0086] Fig. 10 is a flow chart showing an example of the flow of the settlement process performed by the self-service POS terminal 2. Steps S11 to S16 in this process correspond to steps S1 to S6 of the settlement process shown in Fig. 6 in the first embodiment, and therefore a description thereof will be omitted. Steps S19 to S21 in this process correspond to steps S7 to S9 of the settlement process shown in Fig. 6 in the first embodiment, and therefore a description thereof will be omitted. In other words, in this process, a step of notifying the attendant (step S17) and a step of the attendant confirming (step S18) are added between steps S6 and S7 in the previous embodiment.

[0087] 11 is a diagram showing an example of a selection screen 510 that the control unit 201 causes to be displayed on the display unit 250. The selection screen 510 is displayed on the display unit 250 in step S11. The selection screen 510 includes a cash payment selection button 511, a credit card payment selection button 512, a gift certificate payment selection button 513, and a call attendant button 514.

[0088] The cash payment selection button 511 is an operator for indicating an intention to make payment by cash. The credit card payment selection button 512 is an operator for indicating an intention to make payment by credit card. The gift certificate payment selection button 513 is an operator for indicating an intention to use a gift certificate for payment. The attendant call button 514 is an operator for calling an attendant.

[0089] The self-service POS terminal 2 allows payment by cash, credit card, and gift certificate. A customer operates one of the selection buttons 511-513 included in the selection screen 510 according to the payment method to be used. If the customer has a matter to ask a question about, for example, the customer operates the attendant call button 514. When the customer operates one of the buttons 511-514, the touch panel 251 outputs a signal according to the position touched by the customer, and the control unit 201 performs processing based on the signal.

[0090] 12 is a diagram showing an example of instruction screen 520 that control unit 201 causes display unit 250 to display. Instruction screen 520 is displayed by control unit 201 on display unit 250 when step S12 is Yes, that is, when gift certificate payment selection button 513 is operated on selection screen 510.

[0091] The instruction screen 520 includes a guidance message 521 and an attendant call button 524. The attendant call button 524 is an operator for calling an attendant. The guidance message 521 is a message urging the user to have the gift certificate read by the scanner 241, such as "Please hold your gift certificate over the reading window."

[0092] 13 is a diagram showing an example of a selection screen 530 displayed on the display unit 250 by the control unit 201. The selection screen 530 is displayed on the display unit 250 by the gift certificate acceptance unit 603 in step S15.

[0093] Selection screen 530 includes gift certificate selection buttons 531-533 and a no match button 535. Gift certificate selection buttons 531-533 correspond to each of the options output by item recognition unit 601. That is, for example, when there are three options, gift certificate selection button 531 is displayed as a button for selecting the first option, gift certificate selection button 532 is displayed as a button for selecting the second option, and gift certificate selection button 533 is displayed as a button for selecting the third option.

[0094] The no match button 535 is a button for notifying the user when the options displayed by the gift certificate selection buttons 531 to 533 do not match the gift certificate held over the reading window 243. When the no match button 535 is operated, the control unit 201 may, for example, call an attendant, or may return the process to step S11.

[0095] 14 is a diagram showing an example of a guide screen 540 that the control unit 201 causes to be displayed on the display unit 250. The guide screen 540 is displayed on the display unit 250 by the waiting unit 2011 when step S16 is Yes, that is, when any of the gift certificate selection buttons 531 to 533 is operated on the selection screen 530.

[0096] The guidance screen 540 includes a guidance message 541. The guidance message 541 includes a message such as "We will check the gift certificate. Please wait a moment," which asks the customer (the operator) to wait.

[0097] The waiting unit 2011 displays the guide screen 540 and notifies the attendant terminal 300 of information capable of identifying the self-POS terminal 2 for which the customer wishes to use the gift certificate (step S17), and waits for confirmation by the attendant (No in step S18).

[0098] The attendant terminal 300 that has received the notification from the waiting unit 2011 notifies the customer of information that can identify the self-service POS terminal 2 at which the customer wishes to use the gift certificate. The notification here is performed, for example, by displaying characters or patterns on a display device or by emitting sound from a speaker.

[0099] The attendant who has received the notification from the attendant terminal 300 goes to the self-service POS terminal 2 where the customer wishes to use the gift certificate. The attendant then receives the gift certificate from the customer and checks the authenticity and amount of the gift certificate. If the gift certificate matches the gift certificate selected in step S16 (Yes in step S18), the attendant performs an operation to advance the settlement process to step S19.

[0100] 15 is a diagram showing an example of an instruction screen 550 that the control unit 201 causes the display unit 250 to display. The instruction screen 550 is displayed by the control unit 201 on the display unit 250 in step S19.

[0101] The instruction screen 550 includes a guide message 551, an amount display 552, and a deposit completion button 556. The guide message 551, for example, "The remaining balance is as follows. Please deposit cash," encourages the customer, who is the operator, to deposit the amount equivalent to the remaining balance. The amount display 552 shows the remaining amount obtained by subtracting the face value of the gift certificate from the price of the registered product. The deposit completion button 556 accepts an operation to notify that the deposit is complete. When the deposit completion button 556 is operated, the control unit 201 proceeds to calculate and dispense the change.

[0102] 16 is a diagram showing an example of an error screen 560 that the control unit 201 causes the display unit 250 to display. The error screen 560 is displayed by the control unit 201 on the display unit 250 in step S21.

[0103] The error screen 560 includes a message 561, a call attendant button 564, and a back button 567. The message 561 informs the customer that the gift certificate held over the reading window 243 is not currently being handled, such as "This gift certificate cannot be handled at our store." The call attendant button 564 is an operator for calling an attendant. The back button 567 indicates its function to the customer, for example by displaying the message "Return to payment method selection." When the back button 567 is operated, the control unit 201 returns the process to step S11.

[0104] As described above, according to this embodiment, the checkout system 1 can determine whether a gift certificate is eligible for handling at a store without relying on a store clerk.

[0105] This allows the attendant to check the authenticity and amount only when a payment is requested using a gift certificate that is eligible for handling, so compared to the conventional operation in which a store clerk checks the gift certificate every time a customer tries to use it for payment, the attendant's burden can be reduced to the extent that the attendant is not called if the gift certificate is not eligible for handling at the store. Similarly, if a customer has a gift certificate that is not eligible for handling at the store, the inconvenience of having to wait for a store clerk can be eliminated.

[0106] In addition, even if the attendant is not familiar with gift certificates, the attendant can smoothly accept gift certificates available at the store and proceed with settlement and payment. It is also possible to eliminate inconveniences such as settling the account with a gift certificate not available at the store.

[0107] (Modification) An embodiment of a so-called semi-self-checkout system will be described below. The semi-self-checkout system comprises a registration device and an accounting device. The registration device is an example of a sales data processing device, has a configuration similar to the reading device 101 in the first embodiment, and is responsible for product registration. The accounting device is an example of a self-payment device, has a configuration similar to the self-POS terminal 2 in the second embodiment except for the loading tables 210, 220 and scanner 241, and is responsible for payment.

[0108] In the semi-self-checkout system configured as described above, if a gift certificate is accepted by a registration device operated by a store clerk as an operator, the settlement process is performed as in the first embodiment. This makes it possible to improve the convenience of making payments with gift certificates even in the semi-self-checkout system.

[0109] Furthermore, in a semi-self-checkout system configured as described above, if a gift certificate is accepted at an accounting device operated by a customer as an operator, the settlement process is performed as in the second embodiment. This makes it possible to improve the convenience of paying with a gift certificate even in a semi-self-checkout system.

[0110] The programs executed by the sales data processing device and the self-payment device of the above-described embodiment are provided in a state that they are pre-installed in a ROM or the like.

[0111] In addition, the programs executed by the sales data processing device and self-checkout device of the above embodiments may be configured to be provided by recording them on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk) in an installable or executable format.

[0112] Furthermore, the programs executed by the sales data processing device and the self-checkout device of the above-mentioned embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by the sales data processing device and the self-checkout device of the above-mentioned embodiments may be provided or distributed via a network such as the Internet.

[0113] The programs executed by the sales data processing device and the self-payment device of the above-mentioned embodiment are modularized to appropriately include the above-mentioned units (image capture unit 1601, item detection unit 1602, image output unit 1603, item recognition unit 601, item registration unit 602, gift certificate acceptance unit 603, standby unit 2011, and release unit 2012). The CPU (processor) loads the above-mentioned units onto the main storage device by reading and executing the programs from the above-mentioned storage medium. As a result, the image capture unit 1601, item detection unit 1602, image output unit 1603, item recognition unit 601, item registration unit 602, gift certificate acceptance unit 603, standby unit 2011, and release unit 2012 are generated on the main storage device.

[0114] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0115] 1. Checkout system 11 ... POS terminal, 21 ... drawer 22...keyboard, 22d...numeric keypad, 22e...temporary closing key, 22f...closing key 23 ... display device, 23a ... display surface 24 ... customer display device, 24a ... display surface 25 ... Touch panel, 26 ... Printer 51 …Check-out counter 60... control unit, 61... CPU, 62... ROM, 63... RAM 601: item recognition unit; 602: item registration unit; 603: gift certificate acceptance unit 64...HDD, PR...program, F1...PLU file F11: Agricultural products dictionary, F12: Fruit and vegetable dictionary, F13: Fresh fish dictionary, F14: Meat dictionary, F15…Gift Certificate Dictionary 71 ... communication interface, 72 ... connection interface 101 ... reading device, 102 ... housing, 103 ... reading window 104 ... display and operation unit, 105 ... touch panel, 106 ... display device 107 ... keyboard, 108 ... card reading groove, 109 ... customer display device 110 ... Reading unit 151 ... counter table, 152 ... receiving surface, 153 (153a, 153b) ... shopping basket 160...control unit, 161...CPU, 162...ROM, 163...RAM 1601: image capture unit; 1602: object detection unit; 1603: image output unit 164 ... imaging unit, 165 ... audio output unit 171, 172…Connection interface SC...Store Computer 2. Self-service POS terminal 210…First loading platform 220…Second loading platform 221...base, 222...bag hook, 223...temporary stand, 224...support 230: first housing, 231: deposit / withdrawal section 232: coin slot, 233: coin outlet 234: bill insertion slot, 235: bill withdrawal slot 240: second housing, 242: printer, 243: reading window, 244: receipt issuing port 241…Scanner (imaging unit) 250: display unit, 251: touch panel 260…Handy scanner 270...Reader / writer 280…warning light 201...control unit, 2011...standby unit, 2012...release unit 202...Storage section, 204...Communication interface 205…System bus 300…Attendant terminal [Prior art documents] [Patent documents]

[0116] [Patent Document 1] JP 2015-43182 A

Claims

1. A self-checkout device that accepts an operation by a purchaser of a product and executes a checkout process using a gift certificate, a recognition unit that identifies the gift certificate by comparing a captured image output by an imaging unit that captures an image of an item with reference information that is information used as a reference for recognizing the gift certificate; A control unit that performs a settlement process to settle the price of the registered product; Equipped with The control unit is displaying an operator on a display device provided on the device during the settlement process to indicate that the gift certificate is to be used for payment; When the operator operates the operation button, a message is displayed on the display device prompting the user to take a photograph of the gift certificate in the imaging unit; determining whether the gift certificate recognized by the recognition unit is available at the store; When the gift certificate identified by the recognition unit is not available at the store, the display device notifies the user that the gift certificate identified by the recognition unit is not available at the store; If the identified gift certificate is available at the store, displaying candidate gift certificates as options on the display device; When the option is selected, the settlement process is paused and the attendant's response is awaited, and when the attendant's response is received, the pause of the settlement process is released and the process is resumed. Self-checkout machine.

2. The control unit recognizes a gift certificate indicated by the reference information that has a high similarity to the captured image, and displays all gift certificates of the same type as the recognized gift certificate but of different amounts on the display device as the options. The self-payment device according to claim 1.

3. a computer of a self-checkout device that accepts operations by a purchaser of a product and executes a checkout process using a gift certificate; a recognition unit that identifies the gift certificate by comparing a captured image output by an imaging unit that captures an image of an item with reference information that is information used as a reference for recognizing the gift certificate; A control unit that performs a settlement process to settle the price of the registered product; Functioning as a The control unit is displaying an operator on a display device provided on the device during the settlement process to indicate that the gift certificate is to be used for payment; When the operator operates the operation button, a message is displayed on the display device prompting the user to take a photograph of the gift certificate in the imaging unit; determining whether the gift certificate recognized by the recognition unit is available at the store; When the gift certificate identified by the recognition unit is not available at the store, the display device notifies the user that the gift certificate identified by the recognition unit is not available at the store; If the identified gift certificate is available at the store, displaying candidate gift certificates as options on the display device; When the option is selected, the settlement process is paused and the attendant's response is awaited, and when the attendant's response is received, the pause of the settlement process is released and the process is resumed. Program for.

Images