Product registration device and its control program, checkout system

Abstract

To achieve a function of preventing a fraudulence of replacing a commodity and a function of preventing double reading of bar codes and the like even with a simple type not requiring a weight master.SOLUTION: A commodity registration device includes an input unit, processing means, and control means. The input unit inputs information about a commodity. The processing means performs processing of registering sales data on the commodity based on the information input from the input unit. The control means controls the input unit in accordance with an image obtained by photographing a region on which the commodity is placed with a camera.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] An embodiment of the present invention relates to a product registration device and a control program therefor. [Background technology]

[0002] One example of a product registration device is a self-service POS (Point Of Sales) terminal that allows customers to register and pay for purchased products themselves. Conventional self-service POS terminals are mainly of the type that are integrated with a scale. This type of self-service POS terminal uses a data file that stores unit weight data for each product, a so-called weight master. The customer operates a scanner or touch panel to input the data of the purchased product, and places the product on the scale after inputting it. The self-service POS terminal compares the actual weight data of the product measured on the scale with the unit weight data of the product that has been input, and allows the next data input if there is no problem. This mechanism prevents fraud such as replacing a product with which data has been input and placing it on the scale, and also prevents the scanner from reading the barcode of the same product twice.

[0003] On the other hand, self-service POS terminals with built-in weighing devices have the problem that they require a weight master, which requires time and effort to create.In recent years, therefore, simplified self-service POS terminals that do not require a weight master have been developed and are being used in relatively small stores such as convenience stores and kiosks.However, these simplified self-service POS terminals do not have a function to prevent fraudulent product swapping, and they also do not have a function to prevent barcodes from being read twice. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-074082 A Summary of the Invention [Problem to be solved by the invention]

[0005] The problem that the embodiments of the present invention aim to solve is to provide a product registration device that has a function to prevent fraudulent product switching and a function to prevent barcodes, etc. from being read twice, even if it is a simplified type that does not require a weight master. [Means for solving the problem]

[0006] In one embodiment, the product registration device includes an input unit, a processing means, and a control means. The input unit inputs product information. The processing means registers sales data of the product based on the information input from the input unit. The control means controls the input unit in response to an image captured by a camera of an area where the product is placed. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a configuration diagram showing an example of a checkout system configured in a store that has a self-service POS terminal. [Diagram 2] FIG. 1 is an explanatory diagram for explaining an example of the arrangement of a self-service POS terminal. [Diagram 3] FIG. 2 is a block diagram showing the main circuit configuration of a self-service POS terminal. [Figure 4] 4 is a flowchart showing main information processing procedures executed by a processor according to a control program. [Diagram 5] 4 is a flowchart showing main information processing procedures executed by a processor according to a control program. [Figure 6] FIG. 11 is a block diagram showing the main circuit configuration of a self-service POS terminal according to a second embodiment. [Figure 7] 10 is a flowchart showing the main steps of a main information processing operation executed by a processor according to a control program in a second embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of a product registration device will be described with reference to the drawings. In this embodiment, a simplified self-service POS terminal 30 (see FIG. 1) that does not have a weight master is exemplified as one aspect of the merchandise registration device.

[0009] [First embodiment] FIG. 1 is a configuration diagram showing an example of a checkout system 100 configured in a store that has introduced a self-service POS terminal 30. The checkout system 100 includes a store server 10, a face-to-face POS terminal 20, a self-service POS terminal 30, and a network 40. The network 40 is installed in the store. The network 40 is, for example, a LAN (Local Area Network). The checkout system 100 is configured by connecting the store server 10, two face-to-face POS terminals 20, and the self-service POS terminal 30 to the network 40.

[0010] The store server 10 is equipped with a product master 11. The product master 11 is a collection of product records created for each product sold in the store. The product record is composed of data items required for product sales registration, such as product code, product name, unit price, etc. The face-to-face POS terminal 20 or the self-service POS terminal 30 accepts a product code unique to the product purchased by the customer as data for the product. When the product code is input, the face-to-face POS terminal 20 or the self-service POS terminal 30 registers sales data, such as the number of items sold, unit price, and sales amount, of the product, based on the data in the product record including the product code.

[0011] The face-to-face POS terminal 20 is a product registration device that allows a store clerk to carry out operations from registering products purchased by customers to making payments. The face-to-face POS terminal 20 is well known, so a detailed description will be omitted here. The self-service POS terminal 30 is a product registration device that allows customers to carry out operations from registering purchased products to making payments themselves. The self-service POS terminal 30 is a simplified self-service POS terminal that does not require a weight master. Although FIG. 1 shows two face-to-face POS terminals 20 and one self-service POS terminal 30, the number of each is arbitrary. The number is determined appropriately depending on the size of the store, the customer base, etc.

[0012] 2 is an explanatory diagram for explaining an example of the arrangement of the self-service POS terminal 30. The self-service POS terminal 30 is installed in the approximate center of a counter 50, with an appropriate combination of input / output devices such as a touch panel 31, a scanner 32, a printer 33, and a card reader 34. When the self-service POS terminal 30 is viewed from the front, the top surface of the counter 50 on the left side is a placement area 51 for unregistered products, and the top surface of the counter 50 on the right side is a placement area 52 for registered products. Incidentally, the front of the self-service POS terminal 30 in this embodiment refers to the front side toward which the screen of the touch panel 31, the reading window of the scanner 32, the receipt issuing port of the printer 33, and the card insertion port of the card reader 34 face.

[0013] The placement areas 51 and 52 may be switched left and right. The placement areas 51 and 52 may not be located directly to the side of the self-checkout POS terminal 30, but may be shifted forward or backward.

[0014] The touch panel 31 is a device that combines an input device that accepts touch operations and an output device that displays a screen. The touch panel 31 displays a list image of products, such as vegetables and fruits, that do not have barcodes. A customer who wants to purchase a product that does not have a barcode selects the product to be purchased from the list image and performs a touch operation.

[0015] The scanner 32 is an input device for scanning barcodes or two-dimensional codes to read the code data. Many products are provided with barcodes that indicate the product code unique to each product, and the scanner 32 can read these barcodes. The scanner 32 can also read barcodes or two-dimensional codes for code payments.

[0016] The printer 33 is an output device for printing out receipt data showing details of a commercial transaction on a specified receipt paper. The receipt paper on which the receipt data is printed is cut by a cutter and issued as a paper receipt.

[0017] The card reader 34 is an input device for reading data recorded on a card medium such as a credit card, an electronic money card, a point card, etc. The card reader 34 is typically an IC card reader. The card reader 34 may be, for example, a magnetic card reader.

[0018] The combination of input / output devices is not limited to the touch panel 31, scanner 32, printer 33, and card reader 34. For example, a compact keyboard including a numeric keypad may be added. Alternatively, the printer 33 can be omitted by adopting an electronic receipt system.

[0019] A surveillance camera 60 is installed above the counter 50. The surveillance camera 60 captures substantially the entire area of ​​the counter 50 from the placement area 51 for unregistered products to the placement area 52 for registered products. Therefore, from the image from the surveillance camera 60, it is possible to recognize actions such as a customer placing a product in the placement area 51, a customer moving a product he or she picked up from the placement area 51 to the placement area 52, and a customer placing a product in the placement area 52. The surveillance camera 60 is a two-dimensional camera. The surveillance camera 60 may be a three-dimensional camera such as a stereo camera or a ToF (Time-of-Flight) camera.

[0020] 3 is a block diagram showing the main circuit configuration of the self-service POS terminal 30. The self-service POS terminal 30 includes a processor 301, a main memory 302, an auxiliary storage device 303, a clock 304, a communication interface 305, a touch panel 31, a scanner 32, a printer 33, a card reader 34, and a camera interface 306. The self-service POS terminal 30 connects the processor 301 to the main memory 302, the auxiliary storage device 303, the clock 304, the communication interface 305, the touch panel 31, the scanner 32, the printer 33, the card reader 34, and the camera interface 306 via a system bus 307. The system bus 307 includes an address bus, a data bus, and the like.

[0021] The self-service POS terminal 30 constitutes a computer by connecting a processor 301, a main memory 302, an auxiliary storage device 303, a clock 304, a communication interface 305, and a camera interface 306 via a system bus 307. The computer is integrally constituted with a touch panel 31.

[0022] The computer does not necessarily have to be configured integrally with the touch panel 31. The computer may be a standalone desktop PC, and the self-service POS terminal 30 may be configured by connecting various input / output devices to the desktop PC via wired or wireless connections.

[0023] The processor 301 corresponds to the central part of the computer. The processor 301 controls each part to realize various functions of the self-service POS terminal 30 according to an operating system or an application program. The processor 301 is, for example, a CPU (Central Processing Unit).

[0024] The main memory 302 corresponds to the main storage portion of the computer. The main memory 302 includes a nonvolatile memory area and a volatile memory area. The main memory 302 stores an operating system or an application program in the nonvolatile memory area. The main memory 302 stores data required for the processor 301 to execute processes for controlling each part in the volatile memory area. The main memory 302 also uses the volatile memory area as a work area where data is appropriately rewritten by the processor 301. The nonvolatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory).

[0025] The auxiliary storage device 303 corresponds to the auxiliary storage portion of the computer. As the auxiliary storage device 303, for example, a well-known storage device such as an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive) is used alone or in combination. The auxiliary storage device 303 stores data used by the processor 301 in performing various processes, data generated by the processes in the processor 301, etc. The auxiliary storage device 303 may also store an application program.

[0026] The application programs stored in the main memory 302 or the auxiliary storage device 303 include a control program, which will be described later. There is no particular limitation on the method for installing the control program in the main memory 302 or the auxiliary storage device 303. The control program can be installed in the main memory 302 or the auxiliary storage device 303 by recording it on a removable recording medium, or by distributing the control program by communication via a network. The recording medium may be in any form, such as a CD-ROM or memory card, as long as it can store the program and is readable by the device.

[0027] The clock 304 functions as a time information source for the self-service POS terminal 30. The processor 301 keeps track of the current date and time based on the time information kept by the clock 304.

[0028] The communication interface 305 is a circuit for performing data communication with the store server 10 connected via the network 40 in accordance with a predetermined communication protocol.

[0029] The camera interface 306 is an interface having a function of activating the surveillance camera 60 and capturing an actual image captured by the surveillance camera 60 .

[0030] 4 and 5 are flow charts showing the main information processing procedures executed by the processor 301 according to the control program. Below, the main operations of the self-service POS terminal 30 will be explained using each of the figures. Note that the operations explained below are only examples. The procedures can be changed as appropriate as long as the same operational effects can be obtained.

[0031] First, the processor 301 sets the operating state of the self-service POS terminal 30 to an input refusal state as ACT1. The input refusal state is a state in which input from the input devices, the touch panel 31, the scanner 32, and the card reader 34, is not accepted. Also, even if there is input, the input may be invalidated, or the input data may be read and discarded.

[0032] In this input refusal state, the processor 301 analyzes the image of the surveillance camera 60 in ACT2 to check whether any items have been placed in the unregistered product placement area 51 and the registered product placement area 52. If any items have been placed in at least one of the areas 51, 52, the processor 301 judges NO in ACT2 and proceeds to ACT3. The processor 301 issues a warning in ACT3. After that, the processor 301 returns to ACT2. That is, the processor 301 analyzes the image of the surveillance camera 60 and continues to issue a warning until the items placed in the placement area 51 and the placement area 52 are removed.

[0033] There may be cases where items such as a shopping basket provided in the store or products that a customer left behind are placed in the placement area 51 or the placement area 52. In the self-service POS terminal 30, the placement area 51 and the placement area 52 must be empty at the default stage. Therefore, in ACT3, the processor 301 warns the store clerk that there are items in the placement area 51 or the placement area 52. The warning is issued, for example, to either the face-to-face POS terminal 20 or the store server 10, or to both. In response to this warning, the store clerk who is the operator of the face-to-face POS terminal 20 or the store server 10 monitoring the status of the store server 10 removes the items placed in the placement area 51 or the placement area 52.

[0034] When the processor 301 confirms that both the placement area 51 and the placement area 52 are empty, it judges YES in ACT2 and proceeds to ACT4. In ACT4, the processor 301 analyzes the image of the surveillance camera 60 and waits for an article to be placed in the placement area 51.

[0035] A customer who pays for purchased goods by himself places the unregistered goods on an empty placement area 51 of the self-service POS terminal 30. At this time, the customer may place the unregistered goods in a shopping basket or may place the goods without placing them in a shopping basket.

[0036] When the action of the customer placing the purchased item in the placement area 51 is captured by the surveillance camera 60, the processor 301 recognizes that an item has been placed in the placement area 51. The processor 301 judges YES in ACT4 and proceeds to ACT5. The processor 301 confirms that no item has been placed in the placement area 52 in ACT5.

[0037] Even if both the placement areas 51 and 52 are empty at the default stage, an item may be placed in the placement area 52 while waiting for an item to be placed in the placement area 51. If an item has been placed in the placement area 52, the processor 301 determines NO in ACT5 and issues a warning in ACT6. It is desirable to issue this warning not only to the store clerk as in the processing step of ACT3, but also to the customer who has placed the purchased item in the placement area 51. For example, the processor 301 displays guidance on the touch panel 31 saying, "Please remove the item placed on the counter on the right side before starting to register the item." It goes without saying that the content of the guidance is not limited to this.

[0038] After issuing the warning in ACT 6, the processor 301 returns to ACT 5. That is, the processor 301 analyzes the image from the surveillance camera 60 and continues issuing the warning until the article placed in the placement area 52 is removed.

[0039] When the processor 301 confirms that the placement area 52 is empty, it judges YES in ACT5 and proceeds to ACT7. In ACT7, the processor 301 sets the operating state of the self-service POS terminal 30 to a product registration state. The product registration state is a state in which input from the touch panel 31 or the scanner 32, which are input devices for product codes, is accepted. At this time, it is desirable for the processor 301 to notify the customer that the purchased product can be registered by displaying guidance such as "Please register the product" on the touch panel 31 or by causing an LED lamp (not shown) to emit light in a predetermined color.

[0040] When the customer confirms that the operating state of the self-service POS terminal 30 has become the product registration state, the customer picks up one of the purchased products from the placement area 51. Hereinafter, the product picked up from the placement area 51 is referred to as the registration target product.

[0041] If the product to be registered has a barcode attached, the customer holds the barcode over the reading window of the scanner 32. If the product to be registered does not have a barcode attached, the customer operates the touch panel 31 to select the product to be registered from a list image of products without barcodes.

[0042] Processor 301, which has entered the product registration state, waits for product registration in ACT8. Processor 301 determines that a product has been registered when the barcode attached to the product is scanned by scanner 32 or a product is selected from the list image of products without barcodes displayed on touch panel 31. Processor 301 determines YES in ACT8 and proceeds to ACT9. Processor 301 sets the operating state of self-service POS terminal 30 to an input refusal state in ACT9. Then, processor 301 analyzes the image of surveillance camera 60 in ACT10 and waits for an item to be placed in placement area 52. The customer places the product to be registered, whose barcode has been scanned, or the product to be registered, whose selection has been made from the list image of products without barcodes, in placement area 52.

[0043] When the act of a customer placing a registration target product in the placement area 52 is captured by the surveillance camera 60, the processor 301 recognizes that an item has been placed in the placement area 52. The processor 301 judges YES in ACT10 and proceeds to ACT11. In ACT11, the processor 301 analyzes the image of the surveillance camera 60 and judges whether the same product has been moved from the placement area 51 to the placement area 52.

[0044] Specifically, the processor 301 compares an image of the placement area 51 before the product is registered with an image of the placement area 51 after the product is registered, and recognizes the shape of the item picked up from the placement area 51. Similarly, the processor 301 compares an image of the placement area 52 before the item is placed in the placement area 52 with an image of the placement area 52 after the item is placed, and recognizes the shape of the item placed in the placement area 52. If the processor 301 confirms that the two shapes match, it determines that the same item has moved from the placement area 51 to the placement area 52. If the processor 301 cannot confirm that the two shapes match, it determines that the same item has not moved from the placement area 51 to the placement area 52.

[0045] If it is determined that the same product has been moved from placement area 51 to placement area 52, processor 301 determines YES in ACT11 and proceeds to ACT12. Processor 301 executes a registration process in ACT12. That is, processor 301 acquires a product code from the scanned barcode. Alternatively, processor 301 acquires a product code of a product selected from a list image of products without barcodes. Then, processor 301 registers sales data of the product based on data of the product record including the product code.

[0046] On the other hand, if it is determined that the same product has not been moved from the placement area 51 to the placement area 52, the processor 301 determines NO in ACT11 and proceeds to ACT13. The processor 301 issues a warning in ACT13. For example, if the customer places a product in the placement area 52 that is different from the product picked up from the placement area 51, it is determined that the same product has not been moved from the placement area 51 to the placement area 52. Then, the processor 301 issues a warning to the store clerk as in ACT3. The store clerk who confirmed the warning goes to the location where the self-service POS terminal 30 is installed and checks whether or not there has been any fraud. If there is no fraud, the store clerk cancels the warning, for example, by operating the touch panel 31. If there is any fraud, the store clerk does not cancel the warning because it is necessary to deal with the fraud.

[0047] The processor 301 that issued the warning waits for the warning to be released in ACT 14. If the warning is released, the processor 301 judges YES in ACT 14 and proceeds to ACT 12. That is, the processor 301 executes a registration process in ACT 12.

[0048] After completing the registration process, the processor 301 analyzes the image captured by the surveillance camera 60 in ACT 21 of Fig. 5 to check whether the items placed in the placement area 51 have been removed. If the items have not been removed, the processor 301 determines NO in ACT 21 and proceeds to ACT 22. The processor 301 further analyzes the image in ACT 22 to check whether the item placed in the placement area 51 is an empty shopping basket. This check is possible by matching image data of an empty shopping basket captured from various angles with image data captured by the surveillance camera 60.

[0049] If the item placed in the placement area 51 is not an empty shopping basket, the processor 301 determines NO in ACT22 and returns to ACT7 in Fig. 4. That is, the processor 301 sets the operating state of the self-service POS terminal 30 to a product registration state, and executes the processes from ACT8 onwards in the same manner as described above.

[0050] If the registration process of the purchased product is not completed, unregistered purchased products remain in the placement area 51. In this case, the processor 301 waits for the process of ACT12, i.e., the registration process of the product to be registered placed in the placement area 52, to be completed, and then changes the operating state of the self-service POS terminal 30 from the input refusal state to the product registration state. In other words, the operating state of the self-service POS terminal 30 is the input refusal state until the registration process of the product to be registered is completed. Therefore, the scanner 32 does not read the barcode of the product to be registered twice.

[0051] When all the registration processes for purchased items are completed, the placement area 51 will be in a state where no items are placed thereon or only an empty shopping basket is placed thereon. In this case, the processor 301 judges YES in ACT21 or ACT22 and proceeds to ACT23. In ACT23, the processor 301 sets the operation state of the self-service POS terminal 30 to a payment standby state. The payment standby state is a state in which the selection of a payment method is accepted. In the case of the self-service POS terminal 30, the payment methods are mainly non-cash payment methods such as electronic money payment, code payment, credit card payment, etc. The processor 301 displays a payment method selection screen on the touch panel 31 to allow the customer to select one of the payment methods, and prompts the customer to select a payment method. After checking the payment method selection screen, the customer touches the screen to select the desired payment method. At this time, if the image from the surveillance camera 60 detects that an empty shopping basket remains in the placement area 51, it is desirable for the processor 301 to display guidance on the touch panel 31, for example, "Please return the shopping basket to the basket placement area," to inform the customer not to leave the shopping basket there.

[0052] In ACT23, the processor 301 sets the operating state of the self-service POS terminal 30 to a payment standby state, and proceeds to ACT24. The processor 301 waits for a payment method to be selected in ACT24. When the processor 301 detects that a payment method has been selected by a signal from the touch panel 31, the processor 301 judges YES in ACT24 and proceeds to ACT25. The processor 301 activates a device corresponding to the payment method selected in ACT25. That is, if electronic money payment or credit card payment is selected, the processor 301 activates the card reader 34. If code payment is selected, the processor 301 activates the scanner 32.

[0053] The processor 301 that has activated the device waits as ACT 26 for payment data to be input via this device. That is, when electronic money payment is selected, the processor 301 waits for balance data of an electronic money card to be input via the card reader 34. When credit card payment is selected, the processor 301 waits for credit card data to be input via the card reader 34. When code payment is selected, the processor 301 waits for the scanner 32 to scan barcode or two-dimensional code data for code payment.

[0054] When the payment data is input, the processor 301 judges YES in ACT26 and proceeds to ACT27. The processor 301 executes the payment process in ACT27. That is, if the payment data is balance data of an electronic money card, the processor 301 executes a process to subtract the transaction amount of the purchased item from the balance data. If the payment data is credit card data, the processor 301 executes a process to authenticate the credit card. If the payment data is barcode or two-dimensional code data for code payment, the processor 301 executes a process to subtract the transaction amount from the amount based on the data. Such payment processes are well known, so a detailed description will be omitted here.

[0055] In the above embodiment, three payment methods, electronic money payment, credit card payment, and code payment, are shown, but the payment methods are not limited to these. Any two payment methods may be used, or other payment methods, such as point payment, may be added. Also, the payment methods may be limited to one of the payment methods. If there is only one payment method, the processor 301 does not execute the process of ACT24.

[0056] After completing the payment process, the processor 301 proceeds to ACT28. In ACT28, the processor 301 operates the printer 33 to control the issuance of a receipt. In ACT29, the processor 301 also sets the operating state of the self-service POS terminal 30 to an input refusal state. Then, in ACT30, the processor 301 issues a warning. This warning is issued to the customer who has used the self-service POS terminal 30. For example, the processor 301 displays guidance on the touch panel 31 such as "Please take your purchased items home with you. Be careful not to forget to take your receipt," to notify the customer not to forget to take the items and receipt.

[0057] The processor 301 checks whether a predetermined time, for example, 10 seconds, has elapsed since the start of the warning in ACT 31. If the predetermined time has not elapsed, the processor 301 continues the warning.

[0058] When a predetermined time has elapsed since the start of the warning, processor 301 determines YES in ACT 31 and returns to ACT 2 in Fig. 4. That is, processor 301 analyzes the image from surveillance camera 60 to check whether any items have been placed in unregistered product placement area 51 and registered product placement area 52. If, for example, a product has been left behind in placement area 52, processor 301 proceeds to ACT 3 and issues a warning. Incidentally, printer 33 is provided with a sensor for detecting whether a receipt has been left behind. Even if this sensor detects that a receipt has been left behind, it is desirable for processor 301 to proceed to ACT 3 and issue a warning.

[0059] As described above, the self-service POS terminal 30 includes the touch panel 31 and the scanner 32 as input units for inputting product information. The self-service POS terminal 30 is also configured such that the processor 301 executes the process of ACT12 as processing means for registering product sales data based on information input from the input unit. The self-service POS terminal 30 is also configured such that the processor 301 executes the processes of ACT1, ACT7, ACT9, and ACT23 as control means for controlling the input unit in accordance with an image captured by the surveillance camera 60 of the area where the product is placed.

[0060] Specifically, the area includes placement area 52 as a first area where a product is placed after information is input in the input unit. When information is input in the input unit, processor 301 sets the input unit to an input refusal state in ACT9. When processor 301 detects from the image that a product has been placed in placement area 52, processor 301 cancels the input refusal state in ACT7 or ACT23. That is, processor 301 sets the operating state of self-service POS terminal 30 to a product registration state or a payment standby state.

[0061] In this way, after the self-service POS terminal 30 reads the barcode of a product with the scanner 32, the scanner 32 will refuse to read the barcode again until the product is placed in the placement area 52. Therefore, the self-service POS terminal 30 can achieve the function of preventing the barcode from being read twice.

[0062] The area further includes a placement area 51 as a second area where a product is placed before information is input in the input unit. The processor 301 sets the input unit to an input refusal state (ACT1) until a product is placed in the placement area 51. When the processor 301 detects from the image that a product has been placed in the placement area 51, it cancels the input refusal state (ACT7). That is, the processor 301 sets the operating state of the self-service POS terminal 30 to a product registration state.

[0063] In this way, the self-service POS terminal 30 does not accept input from input devices such as the touch panel 31 and the scanner 32 until the customer places the purchased item in the placement area 51. This makes it possible to prevent the self-service POS terminal 30 from malfunctioning due to unauthorized operation of the input device.

[0064] Furthermore, when the processor 301 detects from the image that the product placed in the placement area 51 has been removed, the processor 301 sets the input unit to a standby state for input of payment information in ACT23 and ACT25.

[0065] In this way, payment is possible only when there are no more products placed in the placement area 51, so the customer can move quickly to payment. Also, the customer must register each purchased product placed in the placement area 51 one by one, and payment cannot be made until all registered purchased products are moved to the placement area 52. This makes it possible to strongly remind the customer that the products picked up from the placement area 51 must be registered with the scanner 32 or touch panel 31 before being moved to the placement area 52. Such awareness has the advantage of suppressing fraudulent operations by customers.

[0066] Furthermore, the self-service POS terminal 30 is configured such that the processor 301 executes the process of ACT11 as a determination means for determining whether or not the same product has moved from the placement area 51 to the placement area 52. That is, the processor 301 determines whether or not a product having the same shape has moved from the placement area 51 to the placement area 52 based on the amount of change in the image photographed of the placement area 51 and the amount of change in the image photographed of the placement area 52. Then, on condition that it is determined that a product having the same shape has moved from the placement area 51 to the placement area 52, the processor 301 executes a registration process as ACT12.

[0067] In this way, unless the customer places the product picked up from placement area 51 in placement area 52, product registration processing is not executed in self-service POS terminal 30. Therefore, if any fraudulent attempt to switch products is made, a warning is issued, so this type of fraud can be easily discovered.

[0068] In addition, a surveillance camera 60 is installed above the self-service POS terminal 30. Therefore, customers are aware that their operation of the self-service POS terminal 30 is being monitored, which also serves to suppress unauthorized operations by customers.

[0069] Furthermore, after completing the payment process by inputting the payment information, if processor 301 detects from the image that a product has been placed in placement area 52, it issues a warning as ACT3. This warning quickly notifies the store clerk if a customer has left a product in placement area 52. Therefore, the store clerk can easily take action such as immediately finding the customer who has left the product in the image from surveillance camera 60 and chasing after him.

[0070] Furthermore, when the image shows that a product is placed in placement area 51, processor 301 also issues a warning as ACT3 if it detects that a product is placed in placement area 52. Therefore, the next customer may notice that the previous customer left a product behind and inform the store clerk. Then, the next customer can remove the left-behind product from placement area 52 to self-register the purchased product, so the operating efficiency of self-service POS terminal 30 is not affected.

[0071] [Second embodiment] Next, a second embodiment will be described. In this embodiment, as in the first embodiment, a self-service POS terminal 30 is an example of a product registration device. Therefore, Figs. 1 and 2 are also used in the second embodiment. Fig. 6 is a block diagram showing the main circuit configuration of the self-service POS terminal 30, and Fig. 7 shows the main information processing executed by the processor 301. The same reference numerals are used to denote parts common to the first embodiment, and detailed description thereof will be omitted.

[0072] 6, the self-service POS terminal 30 in the second embodiment differs from the first embodiment in that two scale interfaces 308, 309 are connected to a system bus 307. One scale interface 308 imports weight data measured by a first scale, scale 71. The other scale interface 308 imports weight data measured by a second scale, scale 72.

[0073] The weighing device 71 measures the total weight of the items placed on the placement area 51 of the counter 50. The weighing device 72 measures the total weight of the items placed on the placement area 52 of the counter 50.

[0074] 7, the processor 301 performs the same information processing as in the first embodiment from ACT1 to ACT10. When the processor 301 recognizes from the image of the surveillance camera 60 that an item has been placed on the placement area 52 in ACT10, the processor 301 acquires the amount of change Da of the scale 71 when the registration target product is picked up from the placement area 51 in ACT41. The processor 301 also acquires the amount of change Db of the scale 72 when the registration target product is placed on the placement area 52 in ACT42.

[0075] The processor 301 checks whether the amount of change Da and the amount of change Db match in ACT43. When the product picked up from the placement area 51 is placed in the placement area 52, the amount of change Da and the amount of change Db match. When the amounts of change match, the processor 301 judges YES in ACT43 and proceeds to ACT12. The processor 301 executes a registration process in ACT12. The processes after ACT12 are the same as those in the first embodiment.

[0076] If the amount of change Da and the amount of change Db do not match, the processor 301 proceeds to ACT 13. The processor 301 issues a warning in ACT 13. The processing from ACT 13 onwards is the same as in the first embodiment.

[0077] In this way, in the second embodiment, it is confirmed whether or not a commodity picked up from the placement area 51 has been correctly placed in the placement area 52, that is, whether or not a tampering such as switching commodities has occurred, based on the amounts of change Da, Db in the scales 71 and 72. Therefore, compared to the first embodiment in which a similar confirmation process is performed by image analysis, there is an advantage in that the processing load on the processor 301 can be reduced.

[0078] In the second embodiment, although weighing devices 71 and 72 are required, unit weight data of the products is not required, and therefore weight master is not required.

[0079] Although the embodiment of the product registration device has been described above, the embodiment is not limited to this.

[0080] For example, in the first embodiment, in ACT11, an image of the surveillance camera 60 is analyzed to determine whether or not the same product has moved from the placement area 51 to the placement area 52. In another embodiment, the determination process in ACT11 and the associated processes in ACT13 and ACT14 may be omitted. That is, if the processor 301 recognizes in ACT10 that an item has been placed in the placement area 52, the processor 301 may execute a registration process in ACT12. Alternatively, in yet another embodiment, the registration process may be executed before it is recognized that an item has been placed in the placement area 52.

[0081] Even if such a configuration is adopted, the function of preventing the barcode from being read twice can be reliably achieved. In addition, since the security camera 60 is installed above the self-service POS terminal 30, it is possible to suppress unauthorized operations by customers. For example, in the second embodiment, in ACT43 of Fig. 7, it is confirmed whether the amount of change Da and the amount of change Db match. The amount of change Da and the amount of change Db do not have to match completely. A predetermined allowable range may be set in advance, and if the difference between the amount of change Da and the amount of change Db is within the range of the allowable range, it may be determined that the amount of change Da and the amount of change Db satisfy the condition of match.

[0082] Although several other embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the invention and its equivalents described in the claims. The invention as originally claimed in the present application is set forth below. [1] A product registration device comprising: an input unit for inputting product information; a processing means for registering sales data for the product based on the information input from the input unit; and a control means for controlling the input unit in accordance with an image taken by a camera of the area in which the product is placed. [2] The product registration device described in Appendix [1], wherein the area includes a first area in which a product is placed after information is input into the input unit, and the control means places the input unit in an input refusal state when the information is input into the input unit, and cancels the input refusal state when it detects from the image that a product has been placed in the first area. [3] The product registration device described in appendix [2], wherein the area further includes a second area in which a product is placed before information is input into the input unit, and the control means sets the input unit to an input refusal state until a product is placed in the second area, and cancels the input refusal state when it detects from the image that a product has been placed in the second area. [4] The product registration device described in Appendix [3], wherein when the control means detects from the image that the product placed in the second area has been removed, the control means puts the input unit into a standby state for input of payment information. [5] A product registration device as described in appendix [4], further comprising a first warning means for warning when it detects from the image that a product has been placed in the first area after completing the payment process by inputting the payment information. [6] A product registration device as described in appendix [5], further comprising a second warning means for issuing a warning when it detects that a product has been placed in the first area when a product has been placed in the second area from the image. [7] A product registration device as described in any one of appendices [3] to [6], further comprising a judgment means for judging whether or not an identical product has moved from the second area to the first area based on an image taken of the second area and an image taken of the first area, wherein the processing means registers sales data of the product on condition that the judgment means judges that the identical product has been moved. [8] A product registration device as described in any one of appendices [3] to [6], further comprising a first weighing device for weighing a total weight of the products placed in the second area, and a second weighing device for weighing the total weight of the products placed in the first area, wherein the processing means registers and processes the sales data of the products when the change in the total weight measured by the first weighing device and the change in the total weight measured by the second weighing device satisfy a condition of agreement. [9] A control program for causing a computer of a product registration device having an input unit for inputting product information to function as a processing means for registering sales data of the product based on information input from the input unit, and as a control means for controlling the input unit in accordance with an image captured by a camera of the area where the product is placed. [Explanation of symbols]

[0083] 10...store server, 11...product master, 20...face-to-face POS terminal, 30...self-service POS terminal, 31...touch panel, 32...scanner, 33...printer, 34...card reader, 40...network, 50...counter, 51, 52...loading area, 60...surveillance camera, 71, 72...weighing scale, 301...processor, 302...main memory, 303...auxiliary storage device, 304...clock, 305...communication interface, 306...camera interface, 307...system bus, 308, 309...weighing scale interface.

Claims

1. an input section for inputting product information; a processing means for registering sales data of the product based on the information inputted from the input unit; a warning means for putting the input unit into an input refusal state when the information is inputted into the input unit, and for issuing a warning when the product about which information has been inputted into the input unit is placed in the first area based on an image taken by a camera of a first area in which a product is placed after information has been inputted into the input unit and a second area in which a product is placed before information has been inputted into the input unit, when the product about which information has been inputted into the input unit is placed in the first area and the product has not been placed in the second area before information about the product is inputted into the input unit; A product registration device comprising:

2. A touch panel that accepts touch operations by an operator; Further equipped with The product registration device according to claim 1 , wherein the warning means cancels the warning when the touch panel is touched after the warning.

3. A product registration device as described in claim 1, wherein the processing means registers sales data for a product when, from an image taken by the camera, a product for which information has been input via the input unit is placed in the first area and the product was placed in the second area before information about the product was input via the input unit.

4. a control means for causing the input unit to enter a standby state for input of payment information when it is detected from the image captured by the camera that the product placed in the second area has been removed; a first warning means for warning when it is detected that a product is placed in the first area from an image captured by the camera after the payment process is completed by inputting the payment information; 2. The product registration device according to claim 1, further comprising:

5. A second warning means for warning when it is detected from the image captured by the camera that a product has been placed in the second area, the second warning means being configured to warn when it is detected from the image captured by the camera that a product has been placed in the first area; 5. The product registration device according to claim 4, further comprising:

6. A release means for releasing the input refusal state when it is detected that a product has been placed in the first area from an image captured by the camera.

6. The product registration device according to claim 1, further comprising:

7. A product registration device as described in claim 6, wherein the release means places the input unit in an input refusal state until a product is placed in the second area, and releases the input refusal state when it detects from an image captured by the camera that a product has been placed in the second area.

8. an input section for inputting product information; a processing means for registering sales data of the product based on the information inputted from the input unit; A product registration device comprising: a camera for photographing a first area in which a commodity is placed after information is inputted in the input unit and a second area in which a commodity is placed before information is inputted in the input unit; Equipped with The product registration device includes: a warning means for putting the input unit into an input refusal state when the information is input via the input unit, and for issuing a warning when a product about which information has been input via the input unit is placed in the first area based on an image captured by the camera and the product has not been placed in the second area before the information about the product is input via the input unit; A check-out system comprising:

9. A computer of a product registration device having an input unit for inputting product information, A processing means for registering sales data of the product based on the information input from the input unit; and a warning means for putting the input unit into an input refusal state when the information is inputted into the input unit, and for issuing a warning when the product about which information has been inputted into the input unit is placed in the first area based on an image taken by a camera of a first area in which a product is placed after information has been inputted into the input unit and a second area in which a product is placed before information has been inputted into the input unit, when the product about which information has been inputted into the input unit is placed in the first area, if the product has not been placed in the second area before information about the product is inputted into the input unit; A control program that functions as a

Images