Accounting monitoring device and program

Abstract

To prevent registration omission of a commodity at a settlement device compatible with the full-self system.SOLUTION: An settlement monitoring device includes detection means, recognition means and notification means. The detection means detects a commodity to be settled and monitored at a settlement device. The recognition means recognizes an event assuming that the commodity under monitoring has been registered in the settlement device. The notification means gives notification when settlement has been declared at the settlement device without recognizing the event assuming that the commodity under monitoring has been registered in the settlement device.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an accounting monitoring device and a program. [Background technology]

[0002] Many large stores, such as supermarkets and home improvement centers, have introduced shopping carts, which are hand-pushed trolleys. Customers push their shopping carts around the sales floor and load the items they wish to purchase into the shopping cart. After finishing their shopping in the sales floor, customers go to the cash register and pay for the items loaded into the shopping cart. Payment is made using a payment device.

[0003] In recent years, self-service point-of-sale (POS) terminals have been gaining attention as payment devices. Self-service POS terminals are fully self-service payment devices that allow customers to perform all operations related to the payment of purchased items themselves. Recently, an increasing number of customers are requesting the use of self-service POS terminals, due to factors such as infection prevention measures.

[0004] When customers using shopping carts pay using a self-service payment device, they are concerned about forgetting to register items, as follows: Shopping carts generally have a placement area below the basket receiving area where the shopping basket is placed. The placement area is a space for placing a second or third shopping basket to accommodate purchased items that overflow from the shopping basket in the basket receiving area, or for placing large items packaged in packaging such as cardboard boxes or plastic bags. However, sometimes, when customers pay using a self-service payment device, they forget that there is a shopping basket or large items in the placement area, and end up completing the payment without registering the items in the shopping basket or large items. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] US Patent Application Publication No. 2009 / 0268941 Summary of the Invention [Problem to be solved by the invention]

[0006] The problem to be solved by the embodiments of the present invention is to provide a transaction monitoring device that prevents products from being overlooked when registering them at a fully self-service payment device. [Means for solving the problem]

[0007] In one embodiment, the transaction monitoring device includes a detection means, a recognition means, and a notification means. The detection means detects a product that is the subject of payment at the payment device and is also a monitored product. The recognition means recognizes an event that indicates that the monitored product has been registered at the payment device. The notification means notifies the payment device when a transaction is declared at the payment device without recognizing that the monitored product has been registered at the payment device. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a fully self-service checkout system. [Figure 2] FIG. 2 is a schematic diagram showing the main data structure that constitutes a product record. [Figure 3] FIG. 3 is a perspective view showing the external configuration of the self-service POS terminal. [Figure 4] FIG. 4 is a perspective view showing the appearance of a shopping cart. [Figure 5] FIG. 5 is a block diagram showing the main circuit configuration of the accounting monitoring device. [Figure 6] FIG. 6 is a flowchart showing the main information processing steps that the processor of the transaction monitoring device executes in accordance with the monitoring program. [Figure 7] FIG. 7 is a flowchart showing the main information processing steps that the processor of the transaction monitoring device executes in accordance with the monitoring program. [Figure 8] FIG. 8 is a flowchart showing a specific procedure of the first mode process. [Figure 9] FIG. 9 is a flowchart showing a specific procedure for the second mode process. [Figure 10] FIG. 10 is a flowchart showing a specific procedure for the third mode process. [Figure 11] FIG. 11 is a flowchart showing a specific procedure for the fourth mode process. [Figure 12] FIG. 12 is a schematic diagram showing an example of a display of the confirmation screen. [Figure 13] FIG. 13 is a schematic diagram showing an example of a display of the attention-calling screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the embodiments will be described with reference to the drawings. This embodiment illustrates an accounting monitoring device that prevents customers using shopping carts as carts from missing registrations when paying for purchased items using a fully self-service payment device.

[0010] [Checkout system explanation] 1 is a schematic diagram showing a configuration of a full self-service checkout system 100. The checkout system 100 includes a plurality of self-service POS terminals 10, an attendant terminal 20, and a store server 30. The checkout system 100 connects each of the self-service POS terminals 10, the attendant terminal 20, and the store server 30 via a communication network 40 such as a LAN (Local Area Network). The store server 30 provides various services related to the checkout system 100 to each of the self-service POS terminals 10 and the attendant terminals 20 connected via the communication network 40.

[0011] The multiple self-service POS terminals 10 are installed at the checkout area of ​​the store, and are operated by customers who have finished shopping. The self-service POS terminals 10 are well-known devices equipped with a registration means for registering products and a payment means for paying for the registered products. A customer who loads purchased products into a shopping cart in a sales area where products are displayed and moves to the checkout area operates the self-service POS terminal 10 to pay for the purchased products, that is, to settle the transaction from registration to payment, by themselves. The self-service POS terminal 10 is an example of a fully self-service payment device. The payment device can be referred to as a payment terminal, a checkout device, an accounting terminal, a product registration device, a product registration terminal, etc.

[0012] The attendant terminal 20 is installed in a monitoring station located near the exit of the checkout area. The attendant terminal 20 displays, on a display device, a list of purchased items registered for each self-service POS terminal 10. If an error occurs in the self-service POS terminal 10, the attendant terminal 20 notifies the customer of the error. The store clerk at the monitoring station, i.e., the attendant, monitors the checkout area based on the information displayed and notified on the attendant terminal 20. Although FIG. 1 shows one attendant terminal 20, multiple attendant terminals 20 may be connected to the communication network 40.

[0013] Each self-service POS terminal 10 is equipped with a transaction monitoring device 50. The transaction monitoring device 50 may be located either internally or externally to the self-service POS terminal 10. The transaction monitoring device 50 is a device for preventing the failure to register purchased items in the self-service POS terminal 10. Specifically, the transaction monitoring device 50 monitors the registration status of purchased items in a shopping cart based on images captured by a first camera 61 or a second camera 62 installed in the self-service POS terminal 10 as imaging means and operational input data for the self-service POS terminal 10. If a payer declares a transaction at the self-service POS terminal 10 despite there being unregistered items, the transaction monitoring device 50 issues an alert. The alert is sent to either or both the self-service POS terminal 10 and the attendant terminal 20. Each transaction monitoring device 50 is connected to the attendant terminal 20 via the communication network 40 and can output an alert signal to the attendant terminal 20. Each transaction monitoring device 50 may also be connected to the attendant terminal 20 without using the communication network 40.

[0014] The store server 30 manages a product database 31. The product database 31 is a collection of product records 310 (see Figure 2) created for each product sold in the store. Figure 2 is a schematic diagram showing the main data structure that makes up the product record 310. As shown in the figure, the product record 310 includes data such as a product code, product name, price, and oversized product flag. The product code is a unique code assigned to each product to identify it individually. Each product is affixed with a barcode that represents the product code of that product. The product name and price are the unique name of the product identified by the product code and the sales price per unit. The oversized product flag is one-bit data that identifies whether the product identified by the product code is classified as a oversized product.

[0015] A large item is, for example, an item packed in a packaging material such as cardboard or a plastic bag, and has a volume that is approximately equal to or greater than the internal volume of a shopping basket provided in a store. Examples of large items include items such as multiple bottled or canned drinks packed in cardboard, multiple toilet paper rolls or tissue boxes packed in a plastic bag, and items such as 10 kg or more of polished rice placed in a plastic or paper bag. In this embodiment, the large item flag included in the product record 310 of an item classified as a large item is set to "1," and the large item flag included in the product record 310 of an item not classified as a large item is set to "0." Note that the large item flag can be assigned not only to the product code, but also to a higher-level code such as a class code or department code, which are higher-level concepts.

[0016] [Self-POS terminal explanation] 3 is a perspective view showing the external configuration of the self-service POS terminal 10. The self-service POS terminal 10 includes a main body 101, and a first product placement table 102 and a second product placement table 103, which are arranged on the left and right sides of the main body 101. The first product placement table 102, which is arranged on the right side as viewed from the main body 101, is a table on which a customer who is making a payment places purchased products before registration. Purchased products before registration are usually placed in a shopping basket and placed on the first product placement table 102. Purchased products before registration may also be placed in a shopping cart and placed above the first product placement table 102.

[0017] The second product placement table 103, located on the left side of the main body 101, is a table on which the payment person places purchased items after registering them. After registration, the purchased items are placed in a container placed on the second product placement table 103, such as a shopping basket, a plastic bag, or a personal bag. After registration, the purchased items may also be placed directly on the second product placement table 103. In FIG. 2, the second product placement table 103 has a temporary placement table 104 attached to its upper part via a support pillar. The temporary placement table 104 is, for example, a table on which items are temporarily placed before being placed in a plastic bag or the like. The temporary placement table 104 has two holding arms 105 spaced apart on the left and right. Using these holding arms 105, the payment person can place an open plastic bag, personal bag, or the like on the second product placement table 103.

[0018] The main body 101 is equipped with a touch panel 11, a card reader 12, a printer 13, a scanner 14, a hand scanner 15, a cash processing machine 16, a speaker 17, and the like as input / output devices.

[0019] The touch panel 11 includes a display as a display device and a touch sensor as an input device. The display displays various screen information such as a payment start screen, a product registration screen, a payment method selection screen, and a payment completion screen. The payment start screen is a screen that accepts the start of a transaction payment. A start key is provided on the payment start screen to command the start of a transaction payment. A payer who starts registering purchased products touches the start key. When the touch sensor detects that the start key has been touched, the controller of the self-service POS terminal 10 switches the display screen from the payment start screen to the product registration screen.

[0020] The product registration screen displays detailed information such as the product name, price, and total amount of the registered purchased products. A checkout key is provided on the product registration screen to instruct the user to proceed to payment for the registered purchased products. After registering the purchased products, the user touches the payment key. When the touch sensor detects that the checkout key has been touched, the controller of the self-service POS terminal 10 switches the display screen from the product registration screen to a payment method selection screen.

[0021] The payment method selection screen is a screen that accepts the selection input of a payment method such as cash payment, credit card payment, or electronic money payment. The payment method selection screen has arranged thereon a cash key for issuing a cash payment command, a credit key for issuing a credit card payment command, an electronic money key for issuing an electronic money payment command, and the like. The settlor touches the key for the desired payment method. For example, when the touch sensor detects that the cash key has been touched, the controller of the self-service POS terminal 10 executes a cash payment process and switches the display screen from the payment method selection screen to a cash payment completion screen. When the touch sensor detects that the credit key has been touched, the controller of the self-service POS terminal 10 executes a credit card payment process and switches the display screen from the payment method selection screen to a credit card payment completion screen. When the touch sensor detects that the electronic money key has been touched, the controller of the self-service POS terminal 10 executes an electronic money card payment process and switches the display screen from the payment method selection screen to an electronic money card payment completion screen. For example, a cash payment completion screen is a screen that displays the total amount of the transaction, the amount of cash deposited, the amount of change, etc. For example, a cash payment process is a process that subtracts the total amount of the transaction from the amount deposited to calculate the change amount, issues a receipt, and completes the transaction. Such cash payment processes are well known, so a detailed description will be omitted. Furthermore, payment processes using credit cards or electronic money cards are also well known, so a description will be omitted here.

[0022] The card reader 12 is a device that reads data recorded on a card medium such as a credit card, electronic money card, or point card. If the card medium is a magnetic card, the card reader 12 is a magnetic card reader. If the card medium is an IC card, the card reader 12 is an IC card reader. The self-service POS terminal 10 may be equipped with either a magnetic card reader or an IC card reader as the card reader 12, or may be equipped with both. The card reader 12 may also be a card reader / writer that has a function for writing data to a card.

[0023] The printer 13 is a device that prints data related to purchase receipts, credit card slips, etc. onto receipt paper. The receipt paper on which various data has been printed by the printer 13 is cut by a cutter and issued from the receipt issuing slot. The printer 13 may be implemented as, for example, a thermal printer or a dot-matrix printer.

[0024] The scanner 14 and the hand scanner 15 are used to read information identifying a product. In this embodiment, the scanner 14 and the hand scanner 15 read barcodes attached to products as information identifying the products. The scanner 14 optically reads the barcode of a product held up against a reading window (glass window) so that the barcode on the product faces the scanner 14. The hand scanner 15 is handheld and operated by the person making the payment, and optically reads the barcode when brought close to the barcode on the product. The scanner 14 and the hand scanner 15 may be used to read information identifying a product, and may also be used to read information other than a barcode, such as a two-dimensional code.

[0025] The cash processing machine 16 processes cash. The cash processing machine 16 has a banknote input port 161, a banknote discharge port 162, a coin input port 163, and a coin discharge port 164. The cash processing machine 16 processes banknotes inserted into the banknote input port 161. The cash processing machine 16 discharges banknotes as change from the banknote discharge port 162. The cash processing machine 16 accepts and processes coins inserted into the coin input port 163. The cash processing machine 16 discharges coins as change from the coin discharge port 164.

[0026] The speaker 17 outputs a warning sound as an alert or a voice message.

[0027] A first camera 61 is attached to the lower part of the main body 101, and a second camera 62 is attached to the upper part thereof. The first camera 61 is for taking an image from the side of a shopping cart placed in the space SP on the near side of the first product placement stand 102 of the self-service POS terminal 10. The second camera 62 is for taking an image of the upper surface of the first product placement stand 102.

[0028] [Shopping Cart Description] 4 is an external perspective view showing a shopping cart 70 (hereinafter simply referred to as cart 70). Cart 70 is equipped with caster parts 71 for smooth movement on the floor, a handle frame part 72, and a basket receiving part 73.

[0029] The handle frame portion 72 is erected on the rear wheel side of the caster portion 71. The handle frame portion 72 includes vertical frames 721, 721 attached to the left and right rear wheel sides of the caster portion 71, respectively, and a horizontal handle bar 722 connecting the upper ends of these vertical frames 721, 721.

[0030] The basket receiving portion 73 is attached to the handle frame portion 72 facing forward at approximately the middle position in the height direction of the handle frame portion 72. The basket receiving portion 73 has a rectangular frame 731 and a receiving portion 732 provided on the underside of this frame 731. The receiving portion 732 is sized to fit the bottom of a shopping basket P provided by the store. The basket receiving portion 73 functions as a place to place the shopping basket P provided by the store.

[0031] The caster section 71 includes a rectangular frame 711 with an open rear edge, and casters 712 provided at each of the four corners of the frame 711. The frame 711 has a placing section 74. The placing section 74 is sized to fit the bottom of a shopping basket P. The placing section 74 functions as a place to place not only the shopping basket P, but also a specific product Q that is classified as a large item.

[0032] A payment person using cart 70 holds onto handlebar 722 and pushes cart 70 around the sales floor where each product is displayed. When the payment person finds a product they wish to purchase, they load the product into shopping basket P placed on basket receiving section 73. When the shopping basket P overflows with products, the payment person loads the products into a second shopping basket Pn placed on placing section 74. Alternatively, a payment person who is purchasing a specific product Q that is classified as a large item loads product Q onto placing section 74.

[0033] When the payment person has finished shopping at the sales floor, they push the cart 70 to the checkout area. They move to an empty self-service POS terminal 10 and park the cart 70 in the space SP. They then move the shopping basket P from the cart 70 to the first product placement table 102 and perform an operation to register the purchased items contained in the shopping basket P to the self-service POS terminal 10. They then bag the purchased items registered in the self-service POS terminal 10 into a plastic bag or their own bag prepared on the second product placement table 103. Therefore, once the registration of the purchased items contained in the shopping basket P is complete, the shopping basket P becomes empty.

[0034] If a second shopping basket Pn is present on the placement section 74, the settlement person replaces the empty shopping basket P with the shopping basket Pn. The settlement person then registers the purchased items contained in the shopping basket Pn in the same manner as described above. Note that if the settlement person has placed a specific item Q on the placement section 74 instead of the shopping basket Pn, they will perform an operation to register that item Q in the self-service POS terminal 10. This operation is performed using, for example, the hand scanner 15.

[0035] Once all the purchased items have been registered in this way, the person making the payment declares the transaction by touching the payment key on the product registration screen displayed on the touch panel 11. At this time, if the transaction monitoring device 50 has not detected any missing items, the payment process at the self-service POS terminal 10 is permitted. In this way, the person making the payment can complete the transaction for the purchased items.

[0036] On the other hand, if the transaction monitoring device 50 detects that a purchased item has not been registered, the payment process at the self-service POS terminal 10 will not be permitted. The person making the payment will not be able to complete the transaction until the registration error is resolved. The transaction monitoring device 50 will now be described in detail.

[0037] [Explanation of the accounting monitoring device configuration] Figure 5 is a block diagram showing the main circuit configuration of the accounting monitoring device 50. The accounting monitoring device 50 comprises a processor 51, main memory 52, auxiliary storage device 53, clock 54, first camera interface 55, second camera interface 56, terminal interface 57, network interface 58, and system transmission path 59. System transmission path 59 includes an address bus, a data bus, and control signal lines. System transmission path 59 connects processor 51 to each of the other components and transmits data signals exchanged between them.

[0038] The accounting monitoring device 50 constitutes a computer by connecting a processor 51, a main memory 52, an auxiliary memory device 53, a clock 54, a first camera interface 55, a second camera interface 56, a terminal interface 57, and a network interface 58 via a system transmission path 59.

[0039] The processor 51 corresponds to the central part of the computer. The processor 51 controls each part to realize the various functions of the accounting monitoring device 50 in accordance with an operating system or application program. The processor 51 is, for example, a CPU (Central Processing Unit).

[0040] The main memory 52 corresponds to the main storage portion of the computer. The main memory 52 includes a nonvolatile memory area and a volatile memory area. The main memory 52 stores an operating system or application programs in the nonvolatile memory area. The main memory 52 may store data required for the processor 51 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 52 uses the volatile memory area as a work area where data is rewritten by the processor 51 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0041] The auxiliary storage device 53 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 53. The auxiliary storage device 53 stores data used by the processor 51 when performing various processes, data created by the processes in the processor 51, etc. The auxiliary storage device 53 may also store the application programs described above.

[0042] The first camera interface 55 connects to the first camera 61. The first camera interface 55 outputs a control signal to the first camera 61 to control the driving of the first camera 61. The first camera 61 performs a photographing operation in accordance with this control signal. The first camera interface 55 imports image data photographed by the first camera 61.

[0043] The second camera interface 56 connects to the second camera 62. The second camera interface 56 outputs a control signal to the second camera 62 to control the driving of the second camera 62. The second camera 62 performs a photographing operation in accordance with this control signal. The second camera interface 56 imports image data photographed by the second camera 62.

[0044] The terminal interface 57 connects to the self-service POS terminal 10. The terminal interface 57 communicates data with the self-service POS terminal 10. The terminal interface 57 receives operation input data and the like input by the user into the self-service POS terminal 10. The operation input data includes operation input data related to starting use, operation input data related to product registration, and operation input data related to a payment declaration. The operation input data related to starting use is data output in response to the user pressing the start key on the payment start screen. The operation input data related to product registration is data output in response to the user holding the barcode of a product over the reading window of the scanner 14 or holding the reading unit of the hand scanner 15 over the barcode. The data includes data from the product record 310, which includes the product code represented by the barcode scanned by the scanner 14 or the hand scanner 15. The operation input data related to a payment declaration is data output in response to the user pressing the payment key on the product registration screen.

[0045] The network interface 58 connects to the attendant terminal 20 via the communication network 40. The network interface 58 performs data communication with the attendant terminal 20.

[0046] The accounting monitoring device 50 configured as described above uses part of the volatile memory area in the main memory 52 as a mode memory 521 and a counter memory 522. The uses of the mode memory 521 and the counter memory 522 will be made clear in the explanation of their operation below.

[0047] The processor 51 has at least the functions of a detection unit 511, a recognition unit 512, and an alarm unit 513. The detection unit 511 has a function of detecting products that are the subject of payment at the self-service POS terminal 10 and are also the subject of monitoring. The detection unit 511 detects products placed in a location other than the basket receiving unit 73 of the cart 70 as the subject of monitoring. Specifically, the detection unit 511 detects products in a shopping basket Pn placed in the placing unit 74 or a specific product Q classified as a large item as the subject of monitoring. The detection unit 511 can be rephrased as a detection means.

[0048] The recognition unit 512 has a function of recognizing an event that indicates that a product to be monitored has been registered in the self-checkout POS terminal 10. The recognition unit 512 can be referred to as a recognition means. The detailed function of the recognition unit 512 will be made clear in the operation explanation below.

[0049] The notification unit 513 has a function of issuing a notification when a transaction is declared at the self-service POS terminal 10 without recognizing an event that presumably indicates that a monitored product has been registered in the self-service POS terminal 10. The notification unit 513 can also be referred to as a notification means. The detailed function of the notification unit 513 will also be made clear in the operation explanation below.

[0050] The functions of the detection unit 511, the recognition unit 512, and the notification unit 513 are realized by information processing that the processor 51 executes in accordance with a monitoring program.

[0051] The monitoring program is a type of application program stored in the main memory 52 or the auxiliary storage device 53. There are no particular limitations on the method for installing the monitoring program in the main memory 52 or the auxiliary storage device 53. The settlor monitoring program can be recorded on a removable recording medium, or can be distributed by communication via a network and installed in the main memory 52 or the auxiliary storage device 53. The recording medium can be in any form, such as a CD-ROM or memory card, as long as it can store the program and is readable by the device.

[0052] [Explanation of the operation of the accounting monitoring device] Next, the functions of the processor 51 of the accounting monitoring device 50 as the detection unit 511, recognition unit 512, and notification unit 513 will be explained using the flowcharts in Figures 6 to 11 and the example screens in Figures 12 and 13. Note that the procedures and contents of the flowcharts explained below are examples. The procedures and contents can be changed as appropriate as long as a similar effect can be achieved. The example display screens are also examples. The layout, display items, etc. can be changed as appropriate as long as a similar effect can be achieved.

[0053] 6 and 7 are flowcharts showing the main information processing steps executed by processor 51 of transaction monitoring device 50 in accordance with the monitoring program. Processor 51 waits for operational input data to start use in ACT 1 of FIG. 6. When processor 51 receives operational input data to start use, the process proceeds to ACT 2. Processor 51 outputs a start signal to first camera 61 in ACT 2. First camera 61 begins capturing images upon receiving the start signal. Processor 51 captures images captured by first camera 61 in ACT 3. Processor 51 analyzes the captured images to determine whether cart 70 is parked in space SP in ACT 4. If cart 70 is not parked in space SP, pressing the start key is a declaration of commencement of use by a payer who is not using cart 70. Processor 51 proceeds to ACT 5. Processor 51 writes mode code "10" to mode memory 521 in ACT 5.

[0054] When the cart 70 is stopped in the space SP, the operation of the start key is a declaration of the start of use by the person making the payment using the cart 70. The processor 51 proceeds to ACT 6. In ACT 6, the processor 51 further analyzes the image captured by the first camera 61 to confirm whether or not an item has been placed on the placement section 74 of the cart 70. This confirmation can be made, for example, by comparing a reference image when no item has been placed on the placement section 74 with the image captured by the first camera. If no item has been placed, the processor 51 proceeds to ACT 7. In ACT 7, the processor 51 writes the mode code "10" into the mode memory 521.

[0055] If an item is placed on the placement section 74, the processor 51 proceeds to ACT8. In ACT8, the processor 51 further analyzes the image captured by the first camera 61 to confirm whether the item is a shopping basket Pn. The external shape of a shopping basket Pn is constant. Therefore, the processor 51 uses pattern recognition technology using the external shape data of the shopping basket Pn to confirm whether the item is a shopping basket Pn. If the item is determined to be a shopping basket Pn, the processor 51 proceeds to ACT9. In ACT9, the processor 51 sets the value N of the counter memory 522 to "2." In addition, the processor 51 writes the mode code "20" into the mode memory 521 in ACT10.

[0056] If the item placed on the placement section 74 is not a shopping basket Pn, the processor 51 proceeds to ACT 11. In ACT 11, the processor 51 further analyzes the image captured by the first camera 61 to confirm whether the item is a specific item Q classified as a large item. The external shapes of large items whose item record 310 has a large item flag set to "1" are nearly identical for each item. Therefore, the processor 51 uses pattern recognition technology using external shape data of various large items to confirm whether the item is a specific item Q. If the processor 51 determines that the item is a specific item Q, the processor 51 proceeds to ACT 12. In ACT 12, the processor 51 counts the number X of the specific item Q. In ACT 13, the processor 51 sets the value N in the counter memory 522 to the number "X." In ACT 14, the processor 51 writes the mode code "30" into the mode memory 521.

[0057] If the item placed on the placement section 74 is neither a shopping basket Pn nor a specific product Q, the processor 51 proceeds to ACT 15. The processor 51 writes the mode code "40" into the mode memory 521 in ACT 15.

[0058] In this way, the transaction monitoring device 50 stores mode code "10" in the mode memory 521 for transactions with a customer who is not using a cart 70 or who has not placed an item on the placement section 74 of the cart 70. The transaction monitoring device 50 stores mode code "20" in the mode memory 521 for transactions with a customer who has placed a shopping basket Pn on the placement section 74. The transaction monitoring device 50 stores mode code "30" in the mode memory 521 for transactions with a customer who has placed a specific item Q, which is classified as a large item, on the placement section 74. The transaction monitoring device 50 stores mode code "40" in the mode memory 521 for transactions with a customer who has placed other items, such as a personal bag, on the placement section 74.

[0059] Furthermore, the transaction monitoring device 50 sets the initial value of the counter memory 522 to "2" when the transaction is with a settlement person who has placed a shopping basket Pn on the placement section 74, and sets the initial value of the counter memory 522 to the number of items Q when the transaction is with a settlement person who has placed a specific item Q on the placement section 74.

[0060] When processor 51 completes the processing of ACT 5, ACT 7, ACT 10, ACT 14, or ACT 15, it proceeds to ACT 16. In ACT 16, processor 51 outputs a stop signal to first camera 61. First camera 61 receives the stop signal and stops capturing images.

[0061] Processor 51 also acquires a mode code to store in mode memory 521 as ACT21 in FIG. 7. Processor 51 checks whether the mode code is "10" as ACT22. If the mode code is "10", processor 51 proceeds to ACT23. Processor 51 executes first mode processing as ACT23. The details of the first mode processing will be described later.

[0062] If the mode code is not "10", the processor 51 proceeds to ACT24. In ACT24, the processor 51 checks whether the mode code is "20". If the mode code is "20", the processor 51 proceeds to ACT25. In ACT25, the processor 51 executes second mode processing. The details of the second mode processing will be described later.

[0063] If the mode code is not "20", processor 51 proceeds to ACT26. In ACT26, processor 51 checks whether the mode code is "30". If the mode code is "30", processor 51 proceeds to ACT27. In ACT27, processor 51 executes third mode processing. The details of the third mode processing will be described later.

[0064] If the mode code is not "30", that is, if the mode code is "40", processor 51 proceeds to ACT 28. Processor 51 executes fourth mode processing in ACT 28. The details of the fourth mode processing will be described later.

[0065] When the first mode process, the second mode process, the third mode process, or the fourth mode process is completed, the processor 51 ends the information processing of the procedure shown in the flowchart according to the monitoring program.

[0066] 7, processor 51 checks the mode code in the order of "10," "20," "30," and "40," but the order of checking is not limited to this. In short, if the mode code is "10," first mode processing is executed, if the mode code is "20," second mode processing is executed, if the mode code is "30," third mode processing is executed, and if the mode code is "40," fourth mode processing is executed.

[0067] 8 is a flowchart showing the specific steps of the first mode process. The first mode process is executed when the mode code is "10," that is, when no article is placed on the placement section 74 of the cart 70.

[0068] When the first mode processing is entered, the processor 51 outputs an activation signal to the second camera 62 in ACT 31. The second camera 62 starts capturing images upon receiving the activation signal. The processor 51 captures an image captured by the second camera 62 in ACT 32. The processor 51 analyzes the captured image in ACT 33 to confirm whether an item has been placed on the first product placement table 102 of the self-service POS terminal 10. This confirmation can be made, for example, by comparing the image captured by the second camera with a first reference image when no items are placed on the first product placement table 102 and a second reference image when an empty shopping basket is placed on the first product placement table 102. If no item has been placed on the first product placement table 102, the processor 51 returns to ACT 32. In ACT 32 and ACT 33, the processor 51 waits for an item to be placed on the first product placement table 102 based on the image captured by the second camera 62.

[0069] As described above, the settlement person places the pre-registered product on the first product placement table 102. For example, if the pre-registered product is contained in a shopping basket P, the settlement person places the shopping basket P on the first product placement table 102.

[0070] When processor 51 detects that a product has been placed on first product placement table 102, it proceeds to ACT34. In ACT34, processor 51 acquires operation input data from self-service POS terminal 10. In ACT35, processor 51 checks whether the operation input data acquired from self-service POS terminal 10 is operation input data related to a checkout declaration. If the operation input data is not operation input data related to a checkout declaration, processor 51 returns to ACT34. In ACT34 and ACT35, processor 51 waits for operation input data related to a checkout declaration to be input.

[0071] When processor 51 acquires the operation input data related to the accounting declaration, it proceeds to ACT 36. In ACT 36, processor 51 analyzes the image captured by second camera 62 to confirm whether any products remain on first product placement stand 102. This confirmation M is possible by comparing the image captured by the second camera with the first reference image and second reference image described above. If no products remain on first product placement stand 102, processor 51 proceeds to ACT 41. In ACT 41, processor 51 outputs a stop signal to second camera 62. In response to the stop signal, second camera 62 stops capturing images.

[0072] If there are any products remaining on the first product placement table 102, the processor 51 proceeds to ACT37. In ACT37, the processor 51 controls the terminal interface 57 to send a first confirmation request command to the self-service POS terminal 10. By this control, the first confirmation request command is sent from the terminal interface 57 to the self-service POS terminal 10. The first confirmation request command includes message data for notifying the settler that there are any unregistered products remaining on the first product placement table 102.

[0073] In the self-checkout POS terminal 10 that has received the first confirmation request command, a confirmation screen Sa (see FIG. 12) is displayed on the touch panel 11. At this time, the speaker 17 may emit a warning sound.

[0074] 12 is an example of a confirmation screen Sa. A message Ma included in the confirmation request command is displayed on the confirmation screen Sa. The message Ma may contain content such as "Please check that there are no products left in your shopping basket. If there are, touch 'Register' to register. If there are no products left, touch 'Do not register'." In addition, the soft keys "Register" key Ka and "Do not register" key Kb are also displayed on the confirmation screen Sa.

[0075] The self-service POS terminal 10 on which the confirmation screen Sa is displayed does not accept any operations other than the operation of the "Register" key Ka or the "Do not register" key Kb. The person making the payment checks whether or not there are any unregistered products remaining on the first product placement table 102. If there are, the person making the payment touches the "Register" key Ka. If there are no products remaining, the person making the payment touches the "Do not register" key Kb.

[0076] In ACT38, the processor 51 waits for the "Register" key Ka to be touched or the "Do not register" key Kb to be touched. When the processor 51 detects that the "Register" key Ka has been touched through operation input data from the self-service POS terminal 10, the processor 51 proceeds to ACT39. In ACT39, the processor 51 controls the terminal interface 57 to send an accounting declaration cancellation command to the self-service POS terminal 10. As a result of this control, the accounting declaration cancellation command is sent from the terminal interface 57 to the self-service POS terminal 10.

[0077] When the self-service POS terminal 10 receives the billing declaration cancellation command, the confirmation screen Sa disappears and the screen returns to the state before the billing key on the product registration screen was touched, i.e., before the billing declaration was made. Therefore, the settlement person can register any unregistered products remaining on the first product placement table 102.

[0078] After controlling the transmission of the accounting declaration cancellation command, processor 51 returns to ACT 34. That is, processor 51 waits again for operation input data related to the accounting declaration. Then, when the operation input data related to the accounting declaration is input, processor 51 executes the processing from ACT 36 onwards in the same manner as described above.

[0079] When the processor 51 detects that the "Do not register" key Kb has been touched through operation input data from the self-service POS terminal 10, the process proceeds to ACT40. The processor 51 controls the network interface 58 to transmit a first attention command to the attendant terminal 20 in ACT40. This control causes the first attention command to be transmitted from the network interface 58 to the attendant terminal 20. The first attention command includes message data for alerting the attendant that there may be an unregistered product remaining on the first product placement table 102 of the corresponding self-service POS terminal 10.

[0080] In the attendant terminal 20 that has received the first attention command, an attention screen Sb (see FIG. 13) is displayed on the display device.

[0081] FIG. 13 is an example of the attention screen Sb. The attention screen Sb displays a message Mb included in the attention command. The message Mb may contain, for example, "There may be unregistered products remaining at register 1. Please be careful." A soft key for the "Confirm" key Kc is also displayed on the attention screen Sb. After checking the message Mb, the attendant presses the "Confirm" key Kc. When the "Confirm" key Kc is pressed, the attention screen Sb is hidden.

[0082] After controlling the transmission of the attention-attracting command, the processor 51 proceeds to the above-mentioned ACT41. The processor 51 outputs a stop signal to the second camera 62. When the processing of ACT41 is completed, the processor 51 exits the first mode processing.

[0083] 9 is a flowchart showing the specific steps of the second mode process. The second mode process is executed when the mode code is "20," that is, when the shopping basket Pn is placed on the placement section 74 of the cart 70.

[0084] When the second mode processing is entered, the processor 51 outputs an activation signal to the second camera 62 in ACT51. The second camera 62 starts capturing images upon receiving the activation signal. The processor 51 captures an image captured by the second camera 62 in ACT52. The processor 51 analyzes the captured image in ACT53 to confirm whether or not an item has been placed on the first item placement table 102 of the self-service POS terminal 10. This confirmation may be performed in the same manner as in ACT33 of the first mode processing. If an item has not been placed on the first item placement table 102, the processor 51 returns to ACT52. In ACT52 and ACT53, the processor 51 waits for an item to be placed on the first item placement table 102 based on the image captured by the second camera 62.

[0085] As described above, the settlement person places the pre-registered product on the first product placement table 102. For example, if the pre-registered product is contained in a shopping basket P, the settlement person places the shopping basket P on the first product placement table 102.

[0086] When the processor 51 detects that a product has been placed on the first product placement table 102, the processor 51 proceeds to ACT 54. In ACT 54, the processor 51 subtracts "1" from the value N of the counter memory 522. In the second mode processing, the initial value of the counter memory 522 is "2". Therefore, as a result of the processing in ACT 54, the value N of the counter memory 522 becomes "1".

[0087] In ACT 55, the processor 51 acquires operation input data from the self-service POS terminal 10. In ACT 56, the processor 51 checks whether the operation input data acquired from the self-service POS terminal 10 is operation input data related to a billing declaration. If the operation input data is not operation input data related to a billing declaration, the processor 51 proceeds to ACT 57.

[0088] In ACT 57, the processor 51 checks, based on the image captured by the second camera 62, whether the shopping basket P placed on the first product placement table 102 has been swapped with the shopping basket Pn placed on the placement section 74 of the cart 70. This check can also be made by comparing the image captured by the second camera with the first and second reference images described above. For example, after acquiring an image that matches the second reference image, if the processor 51 acquires an image that can be recognized as indicating that a product has been placed on the first product placement table 102, the processor 51 recognizes that the shopping baskets have been swapped. If the shopping baskets have not been swapped, the processor 51 returns to ACT 55.

[0089] In this way, processor 51 monitors whether the shopping basket on first product placement table 102 is replaced during the period from when the product is placed on first product placement table 102 until the operation input data related to the payment declaration is input. When the shopping basket is replaced by the person making the payment, processor 51 proceeds to ACT 58. In ACT 58, processor 51 subtracts "1" from value N in counter memory 522. Therefore, when the person making the payment replaces the shopping basket, value N in counter memory 522 becomes "0". After that, processor 51 returns to ACT 55.

[0090] When processor 51 acquires the operation input data related to the accounting declaration, it proceeds to ACT 59. In ACT 59, processor 51 checks whether value N of counter memory 522 is greater than "0". If value N of counter memory 522 is "0", the settlement person has replaced the shopping basket. Therefore, it is presumed that the items in shopping basket Pn placed on placement section 74 have been registered. Processor 51 proceeds to ACT 60. In ACT 60, processor 51 outputs a stop signal to second camera 62. In response to the stop signal, second camera 62 stops capturing images.

[0091] If the value N of the counter memory 522 is greater than "0", the payer has not rearranged the shopping basket. Therefore, it is presumed that the items in the shopping basket Pn placed on the placement section 74 are unregistered. The processor 51 proceeds to ACT61. In ACT61, the processor 51 controls the terminal interface 57 to send a second confirmation request command to the self-service POS terminal 10. This control causes the second confirmation request command to be sent from the terminal interface 57 to the self-service POS terminal 10. The second confirmation request command includes message data for notifying the payer that a shopping basket Pn containing unregistered items remains on the placement section 74 of the cart 70.

[0092] In the self-service POS terminal 10 that has received the second confirmation request command, a confirmation screen Saa is displayed on the touch panel 11. At this time, a warning sound may be emitted from the speaker 17. The confirmation screen Saa is a screen in which the message Ma on the confirmation screen Sa in the first mode processing has been replaced with the message Maa in the message data included in the second confirmation request command, and its layout is the same as the screen example in FIG. 12. The message Maa may contain, for example, "There are still shopping baskets in the cart. Please touch 'Register' to continue registration."

[0093] The processor 51 also controls the network interface 58 to send a second attention command as ACT62 to the attendant terminal 20. This control causes the second attention command to be sent from the network interface 58 to the attendant terminal 20. The second attention command includes message data for alerting the attendant that the payment declaration has been made without registering the items in the shopping basket Pn placed on the placement section 74 of the cart 70 at the corresponding self-service POS terminal 10.

[0094] In the attendant terminal 20 that has received the second attention command, an attention screen Sba is displayed on the display device. The attention screen Sba is a screen in which the message Mb of the attention screen Sb in the first mode processing has been replaced with the message Mba of the message data included in the second attention command, and its layout is the same as the screen example in Fig. 13. The message Mba may contain content such as "There is a customer at register number 1 who forgot to register their shopping basket in the bottom row of the cart. Please be careful."

[0095] The self-service POS terminal 10, on which the confirmation screen Saa is displayed, does not accept any operations other than the operation of the "Register" key Ka. The settlement person touches the "Register" key Ka. The settlement person then replaces the shopping basket P on the first product placement table with the shopping basket Pn that was placed on the placement section 74.

[0096] The processor 51 waits for the "Register" key Ka to be touched in ACT63. When the processor 51 detects that the "Register" key Ka has been touched through operation input data from the self-service POS terminal 10, the processor 51 proceeds to ACT64. The processor 51 controls the terminal interface 57 to send an accounting declaration cancellation command to the self-service POS terminal 10 in ACT64. As a result of this control, the accounting declaration cancellation command is sent from the terminal interface 57 to the self-service POS terminal 10.

[0097] The processor 51 returns to ACT 55. Then, the processor 51 executes the processes from ACT 55 onwards in the same manner as described above.

[0098] When the self-service POS terminal 10 receives the billing declaration cancellation command, the confirmation screen Saa disappears and the state returns to the state before the billing declaration. The settlement person performs an operation to register the products in the shopping basket Pn to the self-service POS terminal 10.

[0099] In the transaction monitoring device 50, the shopping basket swap is recognized from the image captured by the second camera 62, and the value N in the counter memory 522 becomes "0." After that, when a transaction declaration is made at the self-service POS terminal 10, the processor 51 proceeds to ACT 60 described above. That is, the processor 51 outputs a stop signal to the second camera 62. After completing the processing of ACT 60, the processor 51 exits the second mode processing.

[0100] 10 is a flowchart showing the specific steps of the third mode process. The third mode process is executed when the mode code is "30," that is, when a specific product Q is placed on the placement section 74 of the cart 70.

[0101] When entering the third mode processing, the processor 51 acquires operation input data from the self-service POS terminal 10 in ACT71. The processor 51 checks whether the operation input data acquired from the self-service POS terminal 10 is operation input data related to product registration in ACT72. If the operation input data is not operation input data related to product registration, the processor 51 checks whether the operation input data acquired from the self-service POS terminal 10 is operation input data related to a billing declaration in ACT73. If the operation input data is not operation input data related to a billing declaration, the processor 51 returns to ACT71. In ACT71 to ACT73, the processor 51 waits to acquire operation input data related to product registration or operation input data related to a billing declaration from the self-service POS terminal 10.

[0102] In the standby state of ACT71 to ACT73, if operation input data related to product registration is acquired from the self-service POS terminal 10, the processor 51 proceeds to ACT74. In ACT74, the processor 51 checks whether the product registered in the self-service POS terminal 10 is a specific product classified as a large product. The operation input data related to product registration includes data from the product record 310. If the large product flag in the data of this product record 310 is "0", the processor 51 recognizes that the product registered in the self-service POS terminal 10 is not a specific product. On the other hand, if the large product flag is "1", the processor 51 recognizes that the product registered in the self-service POS terminal 10 is a specific product. If the product is not a specific product, the processor 51 returns to ACT71. That is, the processor 51 returns to the standby state of ACT51 to ACT73.

[0103] If it is a specific product, it is highly likely that the product is the specific product Q placed on the placement section 74. The processor 51 proceeds to ACT 75. In ACT 75, the processor 51 subtracts "1" from the value N in the counter memory 522. Then, the processor 51 returns to ACT 71. That is, the processor 51 returns to the standby state of ACT 71 to ACT 73.

[0104] In the third mode processing, the initial value of the counter memory 522 is "X", the number of specific products Q placed on the placement unit 74. Therefore, by the processing of ACT54, the value N of the counter memory 522 becomes "X-1". For example, if only one specific product Q is placed on the placement unit 74, the value N of the counter memory 522 becomes "0".

[0105] It is possible that the person placing a particular product Q on the placement unit 74 may also place another large product on, for example, the basket receiving unit 73 when coming to checkout. In this case, for example, if the large product in the basket receiving unit 73 is registered first, and then product Q on the placement unit 74 is registered, the process proceeds to ACT 75 with the value N set to "0." At this time, processor 51 maintains the value N of counter memory 522 at "0."

[0106] If operation input data related to the billing declaration is acquired from the self-service POS terminal 10 during the standby state of ACT71 to ACT73, the processor 51 proceeds to ACT76. In ACT76, the processor 51 checks whether the value N of the counter memory 522 is greater than "0." If the value N of the counter memory 522 is "0," it is presumed that the settlor has registered the specific product Q placed on the placement section 74 of the cart 70 in the self-service POS terminal 10. The processor 51 exits the third mode processing.

[0107] If the value N of the counter memory 522 is greater than "0", it is estimated that the specific product Q is not registered in the self-service POS terminal 10. The processor 51 proceeds to ACT77. In ACT77, the processor 51 controls the terminal interface 57 to send a third confirmation request command to the self-service POS terminal 10. By this control, the third confirmation request command is sent from the terminal interface 57 to the self-service POS terminal 10. The third confirmation request command includes message data for notifying the payer that the specific product Q, which belongs to the large item category, remains on the placement section 74 of the cart 70.

[0108] In the self-service POS terminal 10 that has received the third confirmation request command, a confirmation screen Sab is displayed on the touch panel 11. At this time, a warning sound may be emitted from the speaker 17. The confirmation screen Sab is a screen in which the message Ma of the confirmation screen Sa in the first mode processing has been replaced with a message Mab of the message data included in the third confirmation request command, and its layout is the same as the screen example in FIG. 12. For example, the message Mab may contain content such as "There is a large item in the bottom row of your cart. If it is not registered, please touch 'Register' to register it. If it is already registered, please touch 'Do not register'."

[0109] The self-service POS terminal 10, on which the confirmation screen Sab is displayed, does not accept any operations other than the operation of the "Register" key Ka or the "Do not register" key Kb. If there is an unregistered product Q on the placement section 74 of the cart 70, the payer touches the "Register" key Ka. If there is no product Q remaining, the payer touches the "Do not register" key Kb.

[0110] In ACT78, the processor 51 waits for the "Register" key Ka to be touched or the "Do not register" key Kb to be touched. When the processor 51 detects that the "Register" key Ka has been touched through the operation input data from the self-service POS terminal 10, the processor 51 proceeds to ACT79. In ACT79, the processor 51 controls the terminal interface 57 to send an accounting declaration cancellation command to the self-service POS terminal 10. As a result of this control, the accounting declaration cancellation command is sent from the terminal interface 57 to the self-service POS terminal 10.

[0111] When the self-service POS terminal 10 receives the accounting declaration cancellation command, the confirmation screen Sab is cleared and the state returns to the state before the accounting declaration. The settlement person performs an operation to register product Q in the self-service POS terminal 10. As a result, when the value N in the counter memory 522 becomes "0," the processor 51 exits the third mode processing in response to a subsequent accounting key operation.

[0112] When the processor 51 detects that the "Do not register" key Kb has been touched through operation input data from the self-service POS terminal 10, the processor 51 proceeds to ACT80. In ACT80, the processor 51 controls the network interface 58 to transmit a third attention command to the attendant terminal 20. By this control, the third attention command is transmitted from the network interface 58 to the attendant terminal 20. The third attention command includes message data for alerting the attendant that there may be an unregistered product remaining on the placement section 74 of the cart 70.

[0113] In the attendant terminal 20 that has received the third attention command, an attention screen Sbb is displayed on the display device. The attention screen Sbb is a screen in which the message Mb on the attention screen Sb in the first mode processing has been replaced with the message Mbb of the message data included in the third attention command, and its layout is the same as the screen example in Fig. 13. The message Mbb may contain content such as "The product placed in the bottom row of the cart at register 1 may not have been registered. Please be careful." After controlling the transmission of the attention-attracting command, processor 51 exits the first mode process.

[0114] 11 is a flowchart showing the specific steps of the fourth mode process. The fourth mode process is executed when the mode code is "40," that is, when an item other than the shopping basket Pn or the specific product Q is placed on the placement section 74 of the cart 70. For example, the fourth mode process is executed when the person making the payment places a personal bag or the like on the placement section 74.

[0115] When entering the fourth mode processing, processor 51 outputs a start-up signal to second camera 62 in ACT91. Second camera 62 starts capturing images upon receiving the start-up signal. Processor 51 also acquires operation input data from self-service POS terminal 10 in ACT92. Processor 51 checks whether the operation input data acquired from self-service POS terminal 10 is operation input data related to a billing declaration in ACT93. If the operation input data is not related to a billing declaration, processor 51 returns to ACT92. Here, processor 51 waits in ACT92 and ACT93 for operation input data related to a billing declaration to be input.

[0116] When the processor 51 acquires the operation input data related to the accounting declaration, the processor 51 proceeds to ACT94. In ACT94, the processor 51 captures an image captured by the second camera 62. Then, in ACT95, the processor 51 analyzes the captured image and checks whether any products remain on the first product placement table 102 of the self-service POS terminal 10. This check can be performed in the same way as in ACT36 of the first mode processing. If no products remain, the processor 51 proceeds to ACT100. The processing from ACT100 onwards will be described later.

[0117] If a product remains on the first product placement table 102, the processor 51 executes, in ACT96 to ACT99, the same processes as those in ACT37 to ACT39 in the first mode processing. That is, in ACT96, the processor 51 controls the terminal interface 57 to send a first confirmation request command to the self-checkout POS terminal 10. Then, in ACT97, the processor 51 waits for the "Register" key Ka or the "Do not register" key Kb to be touched.

[0118] When the "Register" key Ka is touched, the processor 51 controls the terminal interface 57 to send an accounting declaration cancellation command to the self-service POS terminal 10 in ACT98. The processor 51 then returns to ACT92 and waits again for operational input data related to the accounting declaration.

[0119] If it is detected that the "Do not register" key Kb has been touched, the processor 51 controls the network interface 58 to send a first attention command to the attendant terminal 20 in ACT99. Thereafter, the processor 51 proceeds to ACT100. That is, the processor 51 proceeds to ACT100 when the "Do not register" key Kb on the confirmation screen Sa is touched to check whether there are any products remaining on the first product placement table 102.

[0120] The processor 51 controls the terminal interface 57 to transmit a fourth confirmation request command to the self-service POS terminal 10 as ACT100. This control causes the fourth confirmation request command to be transmitted from the terminal interface 57 to the self-service POS terminal 10. The fourth confirmation request command includes message data requesting confirmation as to whether any unregistered products remain on the placement section 74 of the cart 70.

[0121] In the self-service POS terminal 10 that has received the fourth confirmation request command, a confirmation screen Sac is displayed on the touch panel 11. At this time, a warning sound may be emitted from the speaker 17. The confirmation screen Sac is a screen in which the message Ma on the confirmation screen Sa in the first mode processing has been replaced with the message Mac of the message data included in the fourth confirmation request command, and its layout is the same as the screen example in FIG. 12. For example, the message Mac may say something like, "Isn't the item at the bottom of your cart an unregistered item? If it is a product, touch 'Register' to register it. If it is not a product, touch 'Do not register'."

[0122] The processor 51 waits for the "Register" key Ka or the "Do not register" key Kb to be touched in ACT101. When the processor 51 detects that the "Register" key Ka has been touched through the operation input data from the self-service POS terminal 10, the process proceeds to ACT98 described above. That is, the processor 51 controls the terminal interface 57 to send an accounting declaration cancellation command to the self-service POS terminal 10.

[0123] When the processor 51 detects that the "Do not register" key Kb has been touched based on the operation input data from the self-service POS terminal 10, the processor 51 proceeds to ACT 102. In ACT 102, the processor 51 outputs a stop signal to the second camera 62. With this, the processor 51 exits the fourth mode processing.

[0124] Here, the processor 51 realizes the function of a detection unit 511 by processing ACT6 and ACT8 in Fig. 6. The processor 51 realizes the function of a recognition unit 512 by processing ACT57, ACT58, and ACT59 in Fig. 9, and further by processing ACT74, ACT75, and ACT76 in Fig. 10. The processor 51 realizes the function of a notification unit 513 by processing ACT61 in Fig. 9, and further by processing ACT77 in Fig. 10.

[0125] [Effects of accounting monitoring devices] As described above in detail, the transaction monitoring device 50, which has the functions of a detection unit 511, a recognition unit 512, and an alarm unit 513, can prevent products from being overlooked when registered at the self-service POS terminal 10, which is a fully self-service payment device.

[0126] For example, if a payment processor forgets that a second shopping basket Pn is on the placement section 74 of the cart 70 and declares payment, the transaction monitoring device 50 executes the second mode process. As a result, a confirmation screen Sa appears on the touch panel 11 of the self-service POS terminal 10. A message Ma, such as "There is another shopping basket in the cart. Please touch 'Register' to continue registration," is displayed. This alerts the payment processor to the presence of the shopping basket Pn on the placement section 74, preventing the payment processor from failing to register the basket. Furthermore, unless the payment processor places the shopping basket Pn on the first product placement table 102, the confirmation screen Sa will not disappear, preventing payment operations from being performed on the self-service POS terminal 10. Therefore, payment cannot be made without noticing the presence of the shopping basket Pn, ensuring that registration is not missed unless the payment processor intends to commit fraud. Furthermore, a message Mb, such as "There is a customer at register number 1 who forgot to register the shopping basket in the bottom row of the cart. Please be careful," is displayed on the attendant terminal 20. In this way, attendants are also warned, so the above-mentioned fraud can be reliably prevented.

[0127] For example, if a payment person forgets that a specific item Q, which is a large item, is on the loading section 74 of the cart 70 and declares a transaction, the transaction monitoring device 50 executes the third mode process. As a result, a confirmation screen Sa is displayed on the touch panel 11 of the self-service POS terminal 10. A message Ma is then displayed, such as, "There is a large item on the bottom shelf of the cart. If it is not registered, please touch 'Register' to register it." This alerts the payment person to the presence of item Q on the loading section 74, thereby preventing the item from being overlooked. Furthermore, unless the payment person registers the specific item Q, whose oversized item flag is set to "1," the payment cannot be performed on the self-service POS terminal 10. Therefore, since the specific item Q must be registered, overlooking registration is reliably prevented unless the payment person intends to commit fraud.

[0128] It is possible that a customer may make a second purchase by placing a large item that they have already purchased on the placement section 74 because they forgot to buy something else. In this case, the confirmation screen Sa is displayed on the touch panel 11, but the customer simply touches the "Do not register" key. By doing so, they can perform the payment operation without registering the specific item Q that they have already purchased and whose large item flag is set to "1." However, in this case, the attendant terminal 20 will display a message Mb such as, "The item placed in the bottom row of the cart at register number 1 may not have been registered. Please be careful." This makes it easy to prevent fraudulent transactions by a customer who attempts to make a payment despite having an unregistered large item.

[0129] Furthermore, a payer who places a product other than the specific product Q on the placement section 74 of the cart 70 may forget to register that product before making a payment declaration. In this case, the transaction monitoring device 50 executes the fourth mode process. As a result, the confirmation screen Sa is displayed on the touch panel 11 of the self-service POS terminal 10. A message Ma is then displayed, such as, "Is the product placed on the bottom shelf of the cart an unregistered product? If it is a product, please touch 'Register' to register it. If it is not a product, please touch 'Do not register'." This prompts a payer who realizes that they have placed a product other than the specific product Q to register it unless they intend to commit fraud, thereby preventing them from failing to register a product. On the other hand, if a personal bag or other item is placed on the placement section 74 of the cart 70, the payer may touch the 'Do not register' key Kb. By doing so, the confirmation screen Sa disappears, allowing the payer to perform payment operations.

[0130] Furthermore, some customers may declare a transaction even though there are still products in the shopping basket P placed on the first product placement platform 102. In such cases, the transaction monitoring device 50 executes the first mode process. As a result, a confirmation screen Sa is displayed on the touch panel 11 of the self-service POS terminal 10. A message Ma is then displayed, such as, "Please check whether there are any products remaining in your shopping basket. If there are, touch 'Register' to register them. If there are no products remaining, touch 'Do not register'." This alerts the customer to the fact that there are still products in the shopping basket P, preventing them from failing to register the products unless they intend to commit fraud. Furthermore, if the customer presses the 'Do not register' key Kb, a message Mb is displayed on the attendant terminal 20, such as, "There may be unregistered products remaining at register number 1. Please be careful." This makes it easy to prevent fraudulent transactions by customers who attempt to complete a transaction despite there being still products in the shopping basket P.

[0131] [Variations] In the embodiment, the first camera 61 and the second camera 62 are attached to the self-service POS terminal 10 as shown in Fig. 2. The attachment locations of the first camera 61 and the second camera 62 are not limited to the locations shown in Fig. 2. In addition, the first camera 61 and the second camera 62 do not need to be provided in the self-service POS terminal 10. For example, the first camera 61 is installed at the entrance to the checkout area. The system further includes a detection device that detects, based on images captured by the first camera 61, that an item has been placed on the placement section 74 of a cart 70 that has entered the checkout area from the entrance, a tracking device that tracks the movement of the cart 70 with an item placed on the placement section 74, and a control device that, when the cart 70 stops in the space SP of a self-service POS terminal 10, provides a mode code "20," "30," or "40" to the transaction monitoring device 50 for that self-service POS terminal 10. By constructing such a system, it is possible to prevent items from being overlooked when registered at the self-service POS terminal 10, just as in the above embodiment. For example, the second camera 62 is hung from the ceiling of the checkout area and installed in a position that allows a bird's-eye view of the self-service POS terminal 10. Even in this position, it is possible to obtain an image from the image captured by the second camera 62 that can be used to process information on whether or not an item is placed on the first item placement table 102.

[0132] A distance measuring sensor such as a ToF (Time of Flight) sensor using a laser or ultrasonic waves may be used instead of the first camera 61 or the second camera 62. Also, instead of the second camera 62, a weight sensor may be used that measures the weight of an item placed on the first item placement stand 102, and if the weight is greater than the weight of an empty shopping basket, it may be determined that an unregistered item is present.

[0133] The above embodiment illustrates a case where each self-service POS terminal 10 is equipped with a transaction monitoring device 50. One transaction monitoring device 50 may be connected to two or more self-service POS terminals 10, and the processor 51 of the transaction monitoring device 50 may function as a detection unit 511, recognition unit 512, and notification unit 513 for each of the two or more self-service POS terminals 10. In the above embodiment, it was explained that the transaction monitoring device 50 may be located either external to or internal to the self-service POS terminal 10. In another embodiment, a self-service POS terminal 10 equipped with a registration means for registering products and a payment means for paying for registered products may incorporate the functions of the transaction monitoring device 50. That is, the transaction device (self-service POS terminal 10) may be equipped with a detection means for detecting products to be paid for by the payment means and to be registered by the registration means, a recognition means for recognizing an event that indicates that the product to be registered has been registered, and a notification means for notifying that a transaction for payment by the payment means has been declared without recognizing an event that indicates that the product to be registered has been registered. Alternatively, the transaction monitoring device 50 may incorporate the functionality of a payment device (self-service POS terminal 10). That is, the transaction monitoring device 50 may be equipped with an acquisition means for acquiring products to be monitored from images captured by an imaging means, a registration means for registering the products, a detection means for detecting that the products registered by the registration means are the products to be monitored acquired by the acquisition means, and a notification means for issuing a notification when a transaction is declared without the detection means detecting the products to be monitored.

[0134] In the above embodiment, the processor 51 recognizes the start of use in response to touching the start key on the payment start screen. For example, a human presence sensor that can detect a person standing in front of the self-service POS terminal 10 may be provided, and the processor 51 may recognize the start of use in response to the human presence sensor detecting a person.

[0135] The specific product Q that is the product to be monitored is not limited to a large product. For example, products that are too long to fit in a shopping basket, such as umbrellas, poles, and rolls of paper, may also be monitored. In this case, it is considered that the long product is not placed on the placement unit 74 but is carried by the person making the purchase and is carried in their hand. Therefore, for example, if it is identified from the image captured by the first camera 61 that the person making the purchase is holding a long item in their hand, the detection unit 511 may detect the item as a product to be monitored.

[0136] In the above embodiment, in ACT 59 of the second mode processing, if the value N of the counter memory 522 is "0", the second camera 62 is stopped. In this regard, the processing of ACT 36 to ACT 40 of the first mode processing may be executed before stopping the second camera 62. By doing so, it is possible to eliminate the problem of the payment processing being executed while unregistered products remain in the shopping basket Pn.

[0137] In the explanation of ACT57 of the second mode processing, an example was given in which the payer replaces shopping basket P with shopping basket Pn. In this regard, the payer may first register the items in shopping basket Pn, and then replace the shopping baskets and register the items in shopping basket P. Even in this case, if the payer declares payment without replacing the shopping baskets, the value N of counter memory 522 is not "0," so the same effect as in the above embodiment can be achieved.

[0138] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. The inventions described in the original claims of this application are set forth below. [1] A transaction monitoring device comprising: a detection means for detecting a product that is the subject of payment at a payment device and is also the subject of monitoring; a recognition means for recognizing an event that indicates that the monitored product has been registered at the payment device; and a notification means for notifying that a transaction has been declared at the payment device without recognizing an event that indicates that the monitored product has been registered at the payment device. [2] The accounting monitoring device described in appendix [1], wherein the detection means detects items placed in a location other than the basket receiving portion of the cart as the monitored item. [3] The accounting monitoring device described in appendix [2], wherein the detection means detects products that are contained in a basket and placed in a location other than the basket receiving section as the products to be monitored. [4] The accounting monitoring device described in Appendix [3], wherein the recognition means recognizes an event in which a basket containing products placed in a location other than the basket receiving portion of the cart is moved to a predetermined location relative to the payment device as an event in which the monitored product is presumed to have been registered in the payment device. [5] The accounting monitoring device described in Appendix [2], wherein the recognition means recognizes an event in which a product belonging to a group of products that can be placed in a location other than the basket receiving section is registered in the payment device as an event in which the monitored product is presumed to have been registered in the payment device. [6] A program for causing a computer communicating with a payment device to function as a detection means for detecting products that are subject to payment on the payment device and are subject to monitoring, a recognition means for recognizing an event that indicates that the monitored products have been registered on the payment device, and a notification means for notifying that a transaction has been declared on the payment device without recognizing an event that indicates that the monitored products have been registered on the payment device. [7] A transaction monitoring device comprising: an acquisition means for acquiring a product to be monitored from an image captured by an imaging means; a registration means for registering the product; a detection means for detecting that the product registered by the registration means is a product to be monitored acquired by the acquisition means; and an alarm means for issuing an alarm when a transaction is declared without the detection means detecting the product to be monitored. [Explanation of symbols]

[0139] 10...self-service POS terminal, 11...touch panel, 14...scanner, 20...attendant terminal, 30...store server, 40...communication network, 50...accounting monitoring device, 51...processor, 52...main memory, 53...auxiliary storage device, 54...clock, 55...first camera interface, 56...second camera interface, 57...terminal interface, 58...network interface, 61...first camera, 62...second camera, 70...shopping cart, 73...basket receiving section, 74...placing section, 100...checkout system, 102...first product placing table, 103...second product placing table, 511...detection section, 512...recognition section, 513...alarm section, 521...mode memory, 522...counter memory.

Claims

1. a detection means for detecting a shopping basket placed on a placement portion below the basket receiving portion of the cart as a commodity to be paid for by the payment device and to be monitored; a recognition means for counting the number of times a shopping basket placed in a place where products are placed before being registered in the settlement device is replaced, and recognizing an event that indicates that the product to be monitored has been registered in the settlement device based on the number of times; a notification means for notifying when a transaction is declared at the settlement device without recognizing an event that indicates that the monitored product has been registered at the settlement device; An accounting monitoring device comprising:

2. The detection means further includes means for detecting a specific commodity that is not contained in a shopping basket and that is placed on a placement section below the basket receiving section of the cart as a commodity to be paid for by the payment device and monitored; 2. The accounting monitoring device according to claim 1, wherein the recognition means counts the number of specific products when the monitored product is the specific product, subtracts the number each time a product classified as the specific product is registered in the payment device, and recognizes an event in which the monitored product is presumed to have been registered in the payment device when the number reaches zero.

3. The accounting monitoring device of claim 2, wherein the detection means detects a shopping basket or a specific item not contained in a shopping basket that is placed on a loading section below the basket receiving section of the cart from the image captured by the imaging means.

4. A computer that communicates with the payment device, a detection means for detecting a shopping basket placed on a placing portion of the cart below the basket receiving portion as a commodity to be paid for and monitored by the payment device; a recognition means for counting the number of times a shopping basket placed in a place where products are placed before being registered in the settlement device is replaced, and recognizing an event that indicates that the monitored product has been registered in the settlement device based on the number of times; and a notification means for notifying when a transaction is declared at the settlement device without recognizing an event that indicates that the monitored product has been registered at the settlement device; A program to function as a

5. The detection means further includes means for detecting a specific commodity that is not contained in a shopping basket and that is placed on a placement section below the basket receiving section of the cart as a commodity to be paid for by the payment device and monitored; The program according to claim 4, wherein the recognition means counts the number of specific products when the monitored product is the specific product, subtracts the number each time a product classified as the specific product is registered in the payment device, and recognizes an event in which it is assumed that the monitored product has been registered in the payment device when the number becomes zero.

6. The program according to claim 5, wherein the detection means detects a shopping basket or a specific product not contained in a shopping basket that is placed on a placement section below the basket receiving section of the cart from an image captured by the imaging means.

Images