Commodity sales data processing apparatus and method

Abstract

To realize smooth merchandise registration by suppressing the occurrence of an error in registration as much as possible even when a purchaser correctly registers merchandise.SOLUTION: The reception means receives a registration operation of a purchased commodity by a purchaser himself / herself. The weight acquisition module acquires a load weight on a placement section on which the purchased commodity for which the registration operation is received is placed. The image acquisition module acquires an image obtained by photographing a purchased commodity placed on a placement section. The confirmation means confirms whether the purchased commodity received by the reception means is projected on the image. The determination means determines whether to permit registration processing of the purchased commodity on the basis of the load weight. When it is determined by the determination means that the registration processing of the purchased commodity is not permitted but it is confirmed by the confirmation means that the purchased commodity is shown in the image, the processing means performs registration processing of sales data of the purchased commodity.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a product sales data processing device and a program therefor. [Background technology]

[0002] In recent years, self-service product sales data processing devices, which allow shoppers to complete everything from registering purchased items to paying for the transaction, have become common in supermarkets and other retail stores. By introducing self-service product sales data processing devices, retail stores can achieve benefits such as resolving labor shortages and reducing labor costs. However, there are also concerns about fraudulent activities, such as bagging purchased items without registering them or switching registered items with more expensive items. To address this issue, a technology is known that provides a scale unit on the platform used to bag purchased items and detects fraudulent activities based on the product registration results and the weight of the load on the platform.

[0003] In conventional fraud detection technology using a scale unit, even if the purchaser correctly registered and bagged the product, there were cases where the registration failed because the load weight on the platform showed an abnormal value. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-032404 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a product sales data processing device that enables smooth product registration by minimizing errors in registration even when a purchaser has correctly registered a product. [Means for solving the problem]

[0006] In one embodiment, the product sales data processing device includes a receiving means, a weight acquisition means, an image acquisition means, a confirmation means, a determination means, and a processing means. The receiving means accepts a registration operation for a purchased product by the purchaser. The weight acquisition means acquires the load weight of the purchased product on the placement section on which the purchased product for which the registration operation has been accepted is placed. The image acquisition means acquires a photograph of the purchased product placed on the placement section. The confirmation means confirms whether the purchased product accepted by the receiving means is shown in the image. The determination means determines whether to allow the registration process for the purchased product based on the load weight. When the determination means determines not to allow the registration process for the purchased product but the confirmation means confirms that the purchased product is shown in the image, the processing means registers the sales data of the purchased product. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic configuration diagram of a self-checkout system according to one embodiment. [Figure 2] FIG. 2 is a schematic diagram showing the main data structure of a product record stored in a product master file. [Figure 3] FIG. 3 is a perspective view showing the external configuration of the product sales data processing device. [Figure 4] FIG. 4 is a block diagram showing the main circuit configuration of the product sales data processing device. [Figure 5] FIG. 5 is a block diagram showing the main functional configuration of the processor of the product sales data processing device. [Figure 6] FIG. 6 is a flowchart showing the main steps of information processing executed by the processor of the merchandise sales data processing device according to the merchandise sales data processing program in the first embodiment. [Figure 7] FIG. 7 is a flowchart showing the main steps of information processing executed by the processor of the merchandise sales data processing device according to the merchandise sales data processing program in the first embodiment. [Figure 8] FIG. 8 is an explanatory diagram of a first pattern of events that result in the weight being outside the set weight range. [Figure 9] FIG. 9 is an explanatory diagram of a second pattern of events that result in the weight being outside the set weight range. [Figure 10] FIG. 10 is a flowchart showing the main steps of information processing executed by the processor of the merchandise sales data processing device according to the merchandise sales data processing program in the second embodiment. [Figure 11] FIG. 11 is a flowchart showing the main steps of information processing executed by the processor of the merchandise sales data processing device according to a merchandise sales data processing program in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Below, we will use drawings to explain several embodiments of a product sales data processing device that is fully self-contained, allowing the purchaser to perform everything from registering the purchased product to paying the transaction price themselves, and that minimizes registration errors even when the purchaser has registered the product correctly, thereby enabling smooth product registration.

[0009] First Embodiment [Checkout system explanation] First, a self-checkout system including a merchandise sales data processing device according to an embodiment will be described with reference to FIGS.

[0010] FIG. 1 is a schematic diagram of a self-checkout system 100. The self-checkout system 100 is applied to a retail store such as a supermarket. The self-checkout system 100 includes multiple product sales data processing devices 10, an attendant terminal 20, and a store server 30. The self-checkout system 100 connects each product sales data processing device 10, the attendant terminal 20, and the store server 30 via a communication network NW. The communication network NW is, for example, a LAN (Local Area Network). The LAN may be a wired LAN or a wireless LAN. Alternatively, the communication network NW may include the Internet, and the store server 30 may be placed in a cloud environment.

[0011] The product sales data processing device 10 is installed in a checkout area that is separated from the sales floor where products are displayed. The product sales data processing device 10 comprises a device main body 101, a first product placement table 102 and a second product placement table 103 disposed on the left and right sides of the device main body 101, a scale unit 40 provided on the second product placement table 103, and a camera 50.

[0012] The product sales data processing device 10 is a fully self-service model that allows a customer to perform all steps from registering the purchased products to paying for the transaction themselves. After completing their shopping at the sales floor and moving to the checkout area, the customer first places the purchased products on the first product placement table 102. The customer also prepares a reusable bag, a shopping bag, or the like on the second product placement table 103. The customer then picks up each purchased product, registers the information about the purchased product in the device main body 101, and then bags the products on the second product placement table 103. Once the customer has completed the registration and bagging of all purchased products, they operate the device main body 101 to check out the purchased products themselves. This type of product sales data processing device 10 is generally referred to as a self-service POS (Point Of Sales) terminal, self-service cash register, or the like.

[0013] The attendant terminal 20 is an information device that allows a store clerk, referred to as an attendant, to monitor the status of multiple merchandise sales data processing devices 10 connected via a communication network NW. Generally, the attendant terminal 20 has a display. The attendant terminal 20 displays information necessary for monitoring each merchandise sales data processing device 10 on the display. The displayed information also includes information on errors detected by the device main body 101. Although only one attendant terminal 20 is shown in FIG. 1, two or more attendant terminals 20 may be incorporated into the self-checkout system 100 depending on the number of merchandise sales data processing devices 10 to be monitored.

[0014] The store server 30 is a server computer that centrally manages data on each product sold in a retail store, controls the registration process of purchased products performed by each product sales data processing device 10, collects the registered data, and tallys up sales, inventory, etc. for the entire store. The store server 30 has a product master file 60. The product master file 60 is a memory area for saving a product record 61 (see FIG. 2) created for each product.

[0015] FIG. 2 is a schematic diagram showing the main data structure of a product record 61. As shown in the figure, the product record 61 includes item data such as a product code, product name, price, attributes, set weight (W), a first allowable range (-α), a second allowable range (+α), and an appearance image. The product code is unique identification information assigned to each product to identify it individually. Incidentally, most products are affixed with a barcode symbol that represents their own product code in barcode form. However, some products, such as vegetables, fruits, and prepared foods, may not be affixed with a barcode symbol.

[0016] The product name and price are the item name and unit price of the product identified by the product code. The attribute is information that indicates the nature of the product. For example, attributes include information that identifies whether the product is taxable or non-taxable, and information that identifies whether the product has a barcode symbol or not.

[0017] The set weight (W), the first allowable range (-α), and the second allowable range (+α) are information about the weight of a product identified by a product code. Many products, such as foodstuffs and daily necessities, sold in supermarkets and the like, have approximately uniform weights. The set weight (W) is the weight at which this uniformity occurs. However, some products, such as vegetables, fruits, meat, and fresh fish, have variations in weight. For such products, a first allowable range (-α) is set as the lower limit of the variation, and a second allowable range (+α) is set as the upper limit of the variation.

[0018] The appearance images are data of images of the appearance of a product identified by a product code taken from various angles. The appearance images may be parameterized information of standard appearance characteristics of the product, such as shape, surface color, pattern, unevenness, etc.

[0019] For products with varying weights, a first allowable range (-α) and a second allowable range (+α) are set around the set weight (W), but there may be cases where non-standard products that fall outside the allowable ranges are sold. Therefore, in this embodiment, the attribute includes information that identifies whether non-standard products are products that can be sold.

[0020] [Configuration of product sales data processing device] 3 is a perspective view showing the external configuration of the product sales data processing device 10. The product sales data processing device 10 comprises a device main body 101, and a first product placement table 102 and a second product placement table 103 arranged on the left and right sides of the device main body 101. The first product placement table 102, arranged on the right side as viewed from the device main body 101, is a table on which a customer places purchased products before registration. Purchased products before registration are usually placed in a shopping basket and placed on the first product placement table 102. Purchased products before registration may also be placed above the first product placement table 102 in a shopping cart.

[0021] The second product placement table 103, located on the left side as viewed from the front of the device main body 101, is a table on which a customer places purchased products after registration. After registration, the purchased products are placed in a container placed on the second product placement table 103, such as a shopping basket, a plastic bag, or a personal bag. After registration, the purchased products may be placed directly on the second product placement table 103. The second product placement table 103 has a temporary placement table 104 attached to its upper portion via a support pillar. The temporary placement table 104 is, for example, a table on which products are temporarily placed before being placed in a plastic bag or the like. The temporary placement table 104 has two holding arms 105 spaced apart on the left and right. Using these holding arms 105, a customer can place an open plastic bag, personal bag, or the like on the second product placement table 103.

[0022] The product sales data processing device 10 is provided with a scale unit 40 on the second product placement table 103. The scale unit 40 measures the total weight of the products placed on the second product placement table 103 and the temporary placement table 104, respectively.

[0023] The product sales data processing device 10 has a camera 50 attached above the second product placement stand 103. The camera 50 has an imaging area that covers the upper surface of the second product placement stand 103. The camera 50 is suitable for photographing products being bagged on the second product placement stand 103.

[0024] It is also possible to attach the first product placement stand 102 to the left side of the device main body 101 and the second product placement stand 103 to the right side. In that case, it goes without saying that the camera 50 will also be attached to the right side of the device main body 101.

[0025] The device main body 101 is equipped with a touch panel 11, a card reader 12, a printer 13, a scanner 14, a hand scanner 15, a cash processing machine 16, a lamp 17, a speaker 18, and the like as input / output devices.

[0026] The touch panel 11 includes a display as a display device and a touch sensor as an input device. The display displays various screen information such as a payment start screen, a product registration screen, a barcode-less product list screen, a payment method selection screen, and a payment completion screen. The payment start screen is a screen that accepts the start of a transaction payment. A start key is provided on the payment start screen to command the start of a transaction payment. A purchaser who begins registering a purchased product touches the start key. When the touch sensor detects that the start key has been touched, the product sales data processing device 10 switches the display screen from the payment start screen to the product registration screen.

[0027] The product registration screen displays detailed information such as the product name, price, and total amount of registered purchased products. A checkout key is provided on the product registration screen to instruct the user to proceed to payment for the purchased products that have been registered. After registering the purchased products, the purchaser touches the checkout key. When the touch sensor detects that the checkout key has been touched, the product sales data processing device 10 switches the display screen from the product registration screen to the payment method selection screen.

[0028] The barcode-less product list screen is a screen that displays a list of products that do not have a barcode symbol attached. The product registration screen has a no barcode key for instructing the registration of a purchased product that does not have a barcode symbol attached. If a purchased product picked up from the first product placement table 102 does not have a barcode symbol attached, the purchaser touches the no barcode key. When the touch sensor detects that the no barcode key has been touched, the product sales data processing device 10 switches the display screen from the product registration screen to the barcode-less product list screen. The purchaser performs a touch operation to select the purchased product from the list on the barcode-less product list screen. In response to this touch operation, the product sales data processing device 10 accepts the registration of the purchased product.

[0029] The payment method selection screen is a screen that accepts the selection input of a payment method, such as cash payment, credit card payment, electronic money payment, or code payment. The payment method selection screen has a cash key for issuing a cash payment command, a credit key for issuing a credit card payment command, an electronic money key for issuing an electronic money payment command, and a code payment key for issuing a code payment command. The purchaser touches the key for the desired payment method. For example, when the touch sensor detects that the cash key has been touched, the product sales data processing device 10 executes a cash payment process and switches the display screen from the payment method selection screen to a cash payment completion screen. When the touch sensor detects that the credit key has been touched, the product sales data processing device 10 executes a credit card payment process and switches the display screen from the payment method selection screen to a credit card payment completion screen. When the touch sensor detects that the electronic money key has been touched, the product sales data processing device 10 executes an electronic money card payment process and switches the display screen from the payment method selection screen to an electronic money card payment completion screen. When the touch sensor detects that the code payment key has been touched, the product sales data processing device 10 executes the payment process using the code for code payment and switches the display screen from the payment method selection screen to the transaction completion screen using code payment.

[0030] For example, a cash payment process involves subtracting the total transaction amount from the deposited amount to calculate the change amount, issuing a receipt, and completing the transaction. A cash payment completion screen is a screen that displays the total transaction amount, the deposited cash amount, the change amount, etc. Such payment processes and payment completion screens are well known, so a detailed description will be omitted. Similarly, payment processes and payment completion screens for credit cards, electronic money cards, or code payments are also well known, so a description will be omitted here.

[0031] The card reader 12 is a device that reads data recorded on a card medium such as a credit card, electronic money card, or point card. If the card medium is a magnetic card, the card reader 12 is a magnetic card reader. If the card medium is an IC card, the card reader 12 is an IC card reader. The product sales data processing device 10 may be equipped with either a magnetic card reader or an IC card reader as the card reader 12, or may be equipped with both. The card reader 12 may also be a card reader / writer that has a function for writing data to a card.

[0032] The printer 13 is a device that prints data related to purchase receipts, credit card slips, etc. onto receipt paper. The receipt paper on which various data has been printed by the printer 13 is cut by a cutter and issued from the receipt issuing slot. The printer 13 may be implemented as, for example, a thermal printer or a dot-matrix printer.

[0033] Scanner 14 and hand scanner 15 are used to read barcode symbols attached to products. Scanner 14 reads barcode symbols held up opposite reading window 140. Hand scanner 15 is handheld and operated by the purchaser, and reads the barcode when brought close to the barcode symbol.

[0034] The cash processing machine 16 processes cash. The cash processing machine 16 has a banknote input port 161, a banknote discharge port 162, a coin input port 163, and a coin discharge port 164. The cash processing machine 16 processes banknotes inserted into the banknote input port 161. The cash processing machine 16 discharges banknotes as change from the banknote discharge port 162. The cash processing machine 16 accepts and processes coins inserted into the coin input port 163. The cash processing machine 16 discharges coins as change from the coin discharge port 164.

[0035] The lamp 17 selectively emits light, for example, in blue or red, and the color of the light emitted by the lamp 17 informs a store attendant or other staff member of the current state of the merchandise sales data processing device 10, such as whether it is in an idle state, an operating state, or whether an error has occurred.

[0036] The speaker 18 outputs a notification sound to notify completion of barcode reading, a warning sound as an alert, or a synthesized voice as a message.

[0037] 4 is a block diagram showing the main circuit configuration of the product sales data processing device 10. The product sales data processing device 10 includes a processor 71, a main memory 72, an auxiliary storage device 73, a clock 74, a communication interface 75, a scale interface 76, a camera interface 77, an I / O (Input / Output) interface 78, and a system transmission path 79. The system transmission path 79 includes an address bus, a data bus, a control signal line, and the like. The product sales data processing device 10 constitutes a computer by connecting the processor 71, the main memory 72, the auxiliary storage device 73, the clock 74, the communication interface 75, the scale interface 76, the camera interface 77, and the I / O interface 78 to the system transmission path 79.

[0038] The processor 71 corresponds to the central part of the computer. The processor 71 controls each part to realize various functions of the product sales data processing device 10 in accordance with an operating system or an application program (application software). The processor 71 is, for example, a CPU (Central Processing Unit).

[0039] The main memory 72 corresponds to the main storage portion of the computer. The main memory 72 includes a nonvolatile memory area and a volatile memory area. The main memory 72 stores an operating system or application programs in the nonvolatile memory area. The main memory 72 may store data required for the processor 71 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 72 uses the volatile memory area as a work area where data is rewritten by the processor 71 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0040] The auxiliary storage device 73 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 73. The auxiliary storage device 73 stores data used by the processor 71 when performing various processes, or data created by the processes of the processor 71. The auxiliary storage device 73 may also store the application programs described above.

[0041] The clock 74 keeps track of the date and time. The product sales data processing device 10 acquires the date and time kept by the clock 74 as the current date and time.

[0042] The communication interface 75 is a circuit for transmitting and receiving data signals to and from the attendant terminal 20, store server 30, etc., which are connected via the communication network NW. The scale interface 76 is a circuit for transmitting and receiving data signals to and from the scale unit 40. The camera interface 77 is a circuit for transmitting and receiving data signals to and from the camera 50. The I / O interface 78 is a circuit for transmitting and receiving data signals to and from the touch panel 11, card reader 12, printer 13, scanner 14, hand scanner 15, cash processing machine 16, lamp 17, and speaker 18.

[0043] 5 is a block diagram showing the main functional configuration of the processor 71. In order to minimize errors in product registration even when a purchaser has correctly registered a product and to enable smooth product registration, the product sales data processing device 10 provides the processor 71 with the functions of a reception means 81, a weight acquisition means 82, a determination means 83, a first processing means 84, an image acquisition means 85, a confirmation means 86, a second processing means 87, and an error output means 88.

[0044] The receiving means 81 has a function for receiving a purchase product registration operation performed by the purchaser. The receiving means 81 receives a signal input to the I / O interface 78 in response to the scanner 14 or hand scanner 15 reading the barcode of the barcode symbol attached to the purchased product as a signal generated by the purchase product registration operation. This signal includes the barcoded product code. The receiving means 81 also receives a signal input to the I / O interface 78 in response to the selection of a purchased product from the list on the barcode-less product list screen displayed on the touch panel 11 as a signal generated by the purchase product registration operation. This signal includes the product code of the selected purchased product.

[0045] The weight acquisition means 82 has a function of acquiring the load weight of the placement section on which the purchased product for which a registration operation has been accepted is placed. The placement section is the second product placement table 103. The weight acquisition means 82 acquires the weight data measured by the scale unit 40 as the load weight of the placement section.

[0046] The determination means 83 has a function for determining whether or not to allow the registration process of the purchased item based on the load weight. When a purchased item for which a registration operation has been accepted by the acceptance means 81 is placed on the second item placement table 103, the load weight acquired by the weight acquisition means 82 increases by the weight of the purchased item. The determination means 83 checks whether the increased weight is within the allowable range of the set weight for the purchased item. If the increased weight is within the allowable range of the set weight for the purchased item, the determination means 83 allows the registration process of the purchased item. If the increased weight is outside the allowable range of the set weight for the purchased item, the determination means 83 does not allow the registration process of the purchased item.

[0047] The first processing means 84 has a function of registering sales data of the purchased product when the determination means 83 determines that the registration process of the purchased product is permitted. When the first processing means 84 determines that the registration process of the purchased product is permitted, it generates product sales data including the product code, product name, price, sales quantity, sales amount, etc. of the purchased product, and registers this product sales data in the transaction memory. The transaction memory is allocated as part of the volatile memory area in the main memory 72.

[0048] Image acquisition means 85 has a function of acquiring an image of a purchased item placed on the placement section. The purchased item placed on the placement section, i.e., second item placement table 103, is photographed by camera 50. Image acquisition means 85 acquires the image photographed by camera 50 via camera interface 77.

[0049] The confirmation means 86 has a function of confirming whether the purchased product accepted by the reception means 81 is shown in the image acquired by the image acquisition means 85. The confirmation means 86 acquires an external image of the purchased product accepted by the reception means 81 from the product master file 60, and confirms whether an image similar to the external image is included in the image captured by the camera 50.

[0050] The second processing means 87 has a function of registering sales data of the purchased item when the determination means 83 determines that the registration process of the purchased item is not permitted but the confirmation means 86 confirms that the purchased item is shown in the image. When the determination means 83 determines that the registration process of the purchased item is not permitted, the confirmation means 86 confirms whether the purchased item is shown in the image. When it is confirmed that the purchased item is shown in the image, the second processing means 87 generates product sales data including the product code, product name, price, sales quantity, sales amount, etc. of the purchased item, and registers this product sales data in the transaction memory. The second processing means 87 can be referred to as a processing means. Alternatively, the first processing means 84 and the second processing means 87 may be collectively referred to as a processing means.

[0051] The error output means 88 has a function of outputting an error when the determination means 83 determines that the registration process of the purchased item is not permitted and the confirmation means 86 does not confirm that the purchased item is shown in the image. When the determination means 83 determines that the registration process of the purchased item is not permitted, the confirmation means 86 confirms whether the purchased item is shown in the image. When it is confirmed that the purchased item is not shown in the image, the error output means 88 outputs an error signal to the attendant terminal 20. The error output means 88 also lights or flashes the lamp 17 in a predetermined color to notify the attendant that an error has occurred.

[0052] The attendant terminal 20 that received the error signal displays on its display an image notifying that the registration has resulted in an error because the load weight on the second product placement table 103 indicated an abnormal value in the product sales data processing device 10 that sent the error signal. The attendant who confirmed this image will move to the location where the product sales data processing device 10 where the error occurred is installed and operate the product sales data processing device 10 to deal with the error. The functions of the above-mentioned reception means 81, weight acquisition means 82, determination means 83, first processing means 84, image acquisition means 85, confirmation means 86, second processing means 87 and error output means 88 are realized by information processing executed by the processor 71 in accordance with a product sales data processing program.

[0053] The merchandise sales data processing program is a type of application program stored in the main memory 72 or the auxiliary storage device 73. There are no particular limitations on the method for installing the merchandise sales data processing program into the main memory 72 or the auxiliary storage device 73. The merchandise sales data processing program can be recorded on a removable recording medium, or can be distributed via communication over the communications network NW and installed into the main memory 72 or the auxiliary storage device 73. The recording medium can be in any form, such as a CD-ROM or memory card, as long as it can store the program and is readable by the device.

[0054] [Explanation of product sales data processing program] 6 and 7 are flowcharts showing the main steps of information processing executed by the processor 71 in accordance with the product sales data processing program. When the start key on the payment start screen is touched, the product sales data processing program starts. The processor 71 performs initialization as ACT1. This initialization clears the transaction memory. In addition, the registered product memory Ma, set weight memory Mb, current weight memory Mc, and previous weight memory Md are also cleared. Like the transaction memory, the registered product memory Ma, set weight memory Mb, current weight memory Mc, and previous weight memory Md are all secured in part of the volatile memory area in the main memory 72.

[0055] Once initialization is complete, the processor 71 proceeds to ACT2. In ACT2, the processor 71 checks whether product registration has been performed. If product registration has not been performed, the processor 71 proceeds to ACT3. In ACT3, the processor 71 checks whether the load on the second product placement table 103 being weighed by the scale unit 40 has increased. If the load has not increased, the processor 71 returns to ACT2. In this way, after completing initialization, the processor 71 waits in ACT2 and ACT3 for product registration to be performed or for the load on the second product placement table 103 to increase. Note that if another input is detected in this standby state, the processor 71 executes information processing according to that input.

[0056] If the load on the second product placement table 103 increases during the standby state of ACT2 and ACT3, the processor 71 transitions to fraud notification processing. If the load on the second product placement table 103 increases without product registration, it is presumed that the purchaser has committed fraud by bagging the purchased products without registering them. As fraud notification processing, the processor 71 may, for example, sound an alarm from the speaker 18 and simultaneously light or flash the lamp 17 in a predetermined color to notify the attendant that fraud has been detected.

[0057] In the standby state of ACT2 and ACT3, when the barcode of the purchased product is scanned by the scanner 14 or hand scanner 15, or when the purchased product is selected from the list on the barcode-less product list screen, the processor 71 determines that the product has been registered. The processor 71 proceeds to ACT4. In ACT4, the processor 71 writes the registered product information into the registered product memory Ma. In ACT5, the processor 71 writes the set weight information into the set weight memory Mb. The registered product information is information on the product code, product name, price, and attributes of each item described in the product record 61 of the purchased product stored in the product master file 60. The set weight information is information on the set weight (W), first allowable range (-α), and second allowable range (+α) of each item described in the product record 61.

[0058] After writing the registered product information and set weight information into the registered product memory Ma and set weight memory Mb, processor 71 proceeds to ACT 6. Processor 71 checks whether the load on second product placement table 103 has increased within a predetermined time. The predetermined time is a sufficient time required for the purchaser to pack the purchased products registered in device main body 101 into a plastic bag, personal bag, or the like prepared on second product placement table 103, for example, 5 seconds.

[0059] If the load on the second product placement table 103 does not increase within a predetermined time after product registration, it is assumed that fraud has occurred by not bagging the purchased product. Processor 71 executes the same fraud notification process as described above.

[0060] If the load on the second product placement platform 103 increases within a predetermined time after product registration, the processor 71 proceeds to ACT 7. In ACT 7, the processor 71 acquires the load weight measured by the scale unit 40 and writes it in the current weight memory Mc. Next, in ACT 8, the processor 71 calculates the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md. This difference ΔM is estimated to be the weight of the purchased product placed on the second product placement platform 103. In ACT 9, the processor 71 checks whether the difference ΔM is within the allowable range of the set weight stored in the set weight memory Mb. That is, the processor 71 checks whether the inequality [W-α]≦ΔM≦[W+α] holds.

[0061] If the inequality is satisfied, i.e., if it is confirmed that the weight newly added to the second product placement table 103 is within the set weight tolerance range of the registered purchased product, the processor 71 proceeds to ACT 10. The processor 71 executes product registration processing in ACT 10. That is, the processor 71 generates product sales data including the product code, product name and price, sales quantity, sales amount, etc. stored in the registered product memory Ma, and registers this product sales data in the transaction memory.

[0062] After completing the product registration process, processor 71 proceeds to ACT11. In ACT11, processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. Then, processor 71 proceeds to ACT12. In ACT12, processor 71 checks whether product registration has been performed. If product registration has not been performed, processor 71 proceeds to ACT13. In ACT13, processor 71 checks whether the checkout key on the product registration screen has been touched. If the checkout key has not been touched, processor 71 proceeds to ACT14. In ACT14, processor 71 checks whether the load on the second product placement platform 103 being weighed by the scale unit 40 has increased. If the load has not increased, processor 71 returns to ACT12. After copying the value of the current weight memory Mc to the previous weight memory Md in this way, processor 71 waits in ACT12, ACT13, and ACT14 for product registration to be performed, for the checkout key to be touched, or for the load on the second product placement platform 103 to increase. If another input is detected in this standby state, processor 71 executes information processing according to that input.

[0063] In the standby state of ACT12 to ACT14, if the load on the second product placement table 103 increases, the processor 71 transitions to fraud notification processing.

[0064] If a purchased product is registered during the standby state of ACT 12 to ACT 14, the processor 71 returns to ACT 4. The processor 71 executes the processes from ACT 4 onwards in the same manner as described above.

[0065] If the accounting key is touched while in the standby state of ACT12 to ACT14, the processor 71 proceeds to ACT15. The processor 71 executes the payment process in ACT15. That is, the processor 71 displays the screen of the touch panel 11 as a payment method selection screen. Then, for example, if cash is selected as the payment method, the processor 71 cooperates with the cash processing machine 16 to execute the cash payment process. For example, if credit is selected as the payment method, the processor 71 cooperates with the card reader 12 to execute the credit card payment process. If another payment method is selected, the processor 71 also executes the payment process according to that payment method. When the payment process is completed, the processor 71 terminates the information processing in accordance with the product sales data processing program.

[0066] On the other hand, if the inequality does not hold in ACT9, that is, if the weight newly added to the second product placement table 103 is outside the set weight tolerance range of the registered purchased product, the processor 71 proceeds to ACT21 in Fig. 7. In ACT21, the processor 71 acquires an image captured by the camera 50. In ACT22, the processor 71 acquires an external image of the purchased product. That is, the processor 71 acquires external image data from the product record 61, which includes the product code and the like, stored in the registered product memory Ma.

[0067] After acquiring the image captured by camera 50 and the exterior image of the purchased product, processor 71 proceeds to ACT 23. In ACT 23, processor 71 compares the image captured by camera 50 with the exterior image of the purchased product. In ACT 24, processor 71 checks whether the image captured by camera 50 contains an image similar to the exterior image of the purchased product. For example, when processor 71 confirms that the image captured by camera 50 contains an image similar to the exterior image of the purchased product in terms of the shape, surface color, pattern, unevenness, etc. of the purchased product, it determines that the image captured by camera 50 contains an image similar to the exterior image of the purchased product.

[0068] If the image captured by camera 50 contains an image similar to the appearance image of the purchased product, processor 71 proceeds to ACT10 in Figure 6. That is, processor 71 executes product registration processing. Then, upon completion of the product registration processing, processor 71 copies the value of current weight memory Mc to previous weight memory Md. Processor 71 returns to the standby state of ACT12 to ACT14.

[0069] On the other hand, if the image captured by camera 50 does not include an image similar to the appearance image of the purchased product, processor 71 proceeds to ACT 25. Processor 71 outputs a registration error for the purchased product in ACT 25. That is, processor 71 outputs an error signal to attendant terminal 20. Processor 71 also lights or flashes lamp 17 in a predetermined color to notify the attendant that an error has occurred.

[0070] The processor 71 that has output the registration error proceeds to ACT26. In ACT26, the processor 71 waits for the error to be resolved. After confirming that a registration error has occurred, the attendant goes to the location where the product sales data processing device 10 is installed and performs an operation to resolve the error on the device main body 101. At this time, the attendant issues a command as to whether or not to permit the registration of the product for which an error has occurred.

[0071] Once the error is cleared, the processor 71 proceeds to ACT 27. In ACT 27, the processor 71 checks whether or not to permit the product registration for which the error occurred. If a command to permit the product registration is given when the error is cleared, the processor 71 proceeds to ACT 10 in FIG. 6. That is, the processor 71 executes the product registration process. Then, upon completion of the product registration process, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state of ACT 12 to ACT 14.

[0072] On the other hand, if there is a command not to permit registration, the processor 71 proceeds to ACT11 in Fig. 6. That is, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md, and returns to the standby state of ACT12 to ACT14.

[0073] In this way, the processor 71 realizes the function of the reception means 81 by processing ACT2 or ACT12 and the processes of ACT4 and ACT5. The processor 71 realizes the function of the weight acquisition means 82 by processing ACT6 and ACT7. The processor 71 realizes the function of the determination means 83 by processing ACT8 and ACT9. The processor 71 realizes the function of the first processing means 84 by processing ACT10 after ACT9. The processor 71 realizes the function of the image acquisition means 85 by processing ACT21. The processor 71 realizes the function of the confirmation means 86 by processing ACT22 to ACT24. The processor 71 realizes the function of the second processing means 87 by processing ACT10 after ACT24. The processor 71 realizes the function of the error output means 88 by processing ACT25.

[0074] [Explanation of the operation of the product sales data processing device] In ACT9 of Figure 6, the difference ΔM between the value of the current weight memory Mc and the value of the previous weight memory Md can occur outside the set weight range of the purchased product whose registration has been accepted, in the following two possible cases: [First Pattern] and [Second Pattern].

[0075] FIG. 8 is an explanatory diagram of the [first pattern]. When initialization is performed in ACT 1 of FIG. 6, or when the value Wx of the current weight memory Mc is copied to the previous weight memory Md in ACT 11, the value Wx of the current weight memory Mc and the previous weight memory Md become equal (ACT 31). In this state, the purchaser operates the device main body 101 by himself to register purchased product A (ACT 32), and when the purchased product A is placed on the second product placement table 103 within a predetermined time (ACT 33), the value of the current weight memory Mc increases by the weight Wa of the purchased product A (ACT 34). As a result, the value Wa obtained by subtracting the value Wx of the previous weight memory Md from the value [Wx + Wa] of the current weight memory Mc is calculated as the difference ΔM (ACT 35).

[0076] Here, if the weight Wa of product A is within the allowable range of the set weight W of product A, that is, if [W-α]≦ΔM(Wa)≦[W+α] holds (YES in ACT36), the product registration process for purchased product A is executed (ACT37).

[0077] On the other hand, when purchased product A is a product with non-standard attributes, i.e., vegetables, fruits, etc., where the weight of each item varies, the weight Wa of purchased product A may be outside the allowable range of the set weight W of that product A, that is, [W-α]≦ΔM(Wa)≦[W+α] may not hold. If the above inequality does not hold (NO in ACT36), the registration of purchased product A will result in an error (ACT38).

[0078] FIG. 9 is an explanatory diagram of the [second pattern]. When initialization is performed in ACT 1 of FIG. 6, or when the value Wx of the current weight memory Mc is copied to the previous weight memory Md in ACT 11, the value Wx of the current weight memory Mc and the previous weight memory Md become equal (ACT 41). In this state, the purchaser operates the device main body 101 by himself to register purchased product B (ACT 42), and places purchased product B on the second product placement table 103 within a predetermined time (ACT 44). However, before placing purchased product B on the second product placement table 103, the registered product C, which has already been bagged, is picked up from the second product placement table 103 (ACT 43).

[0079] For example, when the shopping bag is full and registered product C is removed from the bag and purchased product B is placed in the bag, the events in ACT42 to ACT44 occur. In this case, the value in the current weight memory Mc is calculated by subtracting the weight Wc of registered product C from the value Wx in the previous weight memory Md and adding the weight Wb of purchased product B to the result (ACT45). As a result, the difference ΔM is calculated as [Wb-Wc] obtained by subtracting the value Wx in the previous weight memory Md from the value [Wx-Wc+Wb] in the current weight memory Mc (ACT46). If the difference ΔM is within the set weight range for purchased product B (YES in ACT47), the product registration process for purchased product B is executed (ACT48). However, in reality, the difference ΔM is outside the set weight range for purchased product B (NO in ACT47). Therefore, the registration of purchased product B results in an error (ACT48).

[0080] Conventional product sales data processing devices of this type output a weight-related registration error when the difference ΔM falls outside the set weight range of the purchased product, that is, at the time of ACT 38 in Figure 8 or the time of ACT 49 in Figure 9. This required an attendant to clear the error.

[0081] In contrast, the product sales data processing device 10 of this embodiment does not output a registration error when the difference ΔM falls outside the set weight range of the purchased product. As shown in Figures 6 and 7, when the difference ΔM falls outside the set weight range of the purchased product (NO in ACT 9 in Figure 6), the product sales data processing device 10 acquires an image captured by the camera 50 (ACT 21 in Figure 7). The product sales data processing device 10 then checks whether an image of the purchased product is captured in the captured image (ACT 22 to ACT 24 in Figure 7). If an image of the purchased product is captured in the image captured by the camera 50 (YES in ACT 24 in Figure 7), the product sales data processing device 10 executes a registration process for the purchased product (ACT 10 in Figure 6).

[0082] The fact that the image of the purchased product is captured by camera 50 guarantees that the purchaser has correctly bagged the registered purchased product. In other words, the difference ΔM falling outside the set weight range for the purchased product is likely due to the fact that the purchased product is an out-of-standard product, or that the registered product was removed from second product placement platform 103 before being bagged. In this embodiment, no error is output for such an event. Therefore, the frequency of registration errors despite the purchaser correctly registering the purchased product can be reduced as much as possible compared to the conventional system, thereby achieving smooth product registration.

[0083] On the other hand, if the image captured by camera 50 does not show the image of the purchased product, it is assumed that the purchaser did not correctly bag the purchased product that he or she registered. This type of incident can occur, for example, if the purchaser fraudulently bags a different product than the purchased product that he or she registered. In response to such fraudulent activity, an error message is output, making it possible to prevent such fraudulent activity.

[0084] <Second embodiment> Next, a second embodiment of the product sales data processing device 10 will be described. The second embodiment differs from the first embodiment in the function of the confirmation means 86. Other points are the same as those of the first embodiment, so Figures 1 to 6, 8, and 9 are also applied to the second embodiment as they are, and their description will be omitted.

[0085] In the first embodiment, the confirmation means 86 had a function of acquiring a preset external appearance image of the purchased item received by the reception means 81 and confirming whether an image similar to the external appearance image is captured in the image captured by the camera 50 acquired by the image acquisition means 85. In the second embodiment, the confirmation means 86 has a function of confirming whether the purchaser's action of placing the purchased item received by the reception means 81 on the placement section, i.e., the second item placement table 103, is captured in the image captured by the camera 50 acquired by the image acquisition means 85. Furthermore, the confirmation means 86 also has a function of confirming whether the purchaser's action of placing the purchased item received by the reception means 81 on the second item placement table 103 and the action of removing the purchased item from the second item placement table 103 are captured in the image captured by the camera 50.

[0086] Therefore, the camera 50 is suitable not only for photographing the products being bagged on the second product placing stand 103, using the area that captures the top surface of the second product placing stand 103 as its imaging area, but also for photographing the actions of the purchaser, using the area that captures at least the arms of the purchaser who is bagging the products as its imaging area.

[0087] 10 is a flowchart showing the main steps of information processing executed by the processor 71 of the merchandise sales data processing device 10 according to the merchandise sales data processing program in the second embodiment. Specifically, this is the processing procedure after the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md falls outside the set weight range of the purchased merchandise whose registration has been accepted, in ACT 9 of the same procedure shown in FIG. 6, that is, after the inequality [W-α]≦ΔM≦[W+α] is not satisfied.

[0088] If the above inequality is not satisfied in ACT 9 of Fig. 6, the processor 71 proceeds to ACT 51 of Fig. 10. In ACT 51, the processor 71 acquires an image captured by the camera 50. Then, in ACT 52, the processor 71 analyzes the image captured by the camera 50 to recognize the purchaser's actions.

[0089] The actions of a purchaser can be recognized, for example, using the functions of AI (Artificial Intelligence). That is, an AI is prepared that inputs a video of the purchaser's actions and outputs classification data indicating whether the action is placing the purchased item on a display stand or removing the purchased item from the display stand. Then, as training data, the video of the purchaser's actions and classification data, which is correct answer data indicating whether the action is placing or removing, are input to the AI, and the AI ​​is trained in advance. If the purchaser correctly registers an item and then the weight falls outside the set weight range, the video of the purchaser's actions is input to the AI, and the AI ​​outputs classification data indicating whether the action is placing or removing.

[0090] As ACT53, processor 71 checks whether a placing action by a purchaser has been recognized from the image captured by camera 50. The placing action is an action of placing purchased products that have been registered in device main body 101 on second product placing table 103. For example, the act of packing purchased products into a shopping bag, a personal bag, or the like prepared on second product placing table 103 corresponds to the placing action.

[0091] If the processor 51 is able to recognize a placing action by the purchaser from the image captured by the camera 50, the processor 51 proceeds to ACT 54. In ACT 54, the processor 51 checks whether the processor 51 is able to recognize a pick-up action by the purchaser from the image captured by the camera 50. A pick-up action is an action of picking up a registered purchased item from the second item placement stand 103. For example, an action of taking a purchased item out of a plastic bag or a personal bag because the plastic bag or personal bag is full corresponds to a pick-up action.

[0092] If the processor 71 can recognize the purchaser's pick-up action from the image captured by the camera 50, the processor 71 proceeds to ACT 10 in Figure 6. That is, the processor 71 executes the product registration process. Then, upon completing the product registration process, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state of ACT 12 to ACT 14. In this way, for example, if the AI ​​can recognize both the purchaser's pick-up action and the placing action, the processor 71 validates the product registration without outputting an error.

[0093] In ACT 54, if the processor 71 is unable to recognize the purchaser's act of picking up the product from the image captured by the camera 50, the processor 71 proceeds to ACT 55. In ACT 55, the processor 71 determines whether the purchased product registered in the device main body 101 is a product that can be sold even if it is out of standard and exceeds the set weight tolerance range. That is, the processor 71 determines whether the product can be sold even if it is out of standard, based on the attributes of the registered product information written in the registered product memory Ma.

[0094] If the purchased product is a product that may be sold as a non-standard product that exceeds the set weight tolerance range, the processor 71 proceeds to ACT 10 in Figure 6. That is, the processor 71 executes the product registration process. Then, after completing the product registration process, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state of ACT 12 to ACT 14.

[0095] On the other hand, if the purchaser's placing action cannot be recognized from the image captured by camera 50 in ACT 53, or if the purchased product is a non-standard product that exceeds the set weight tolerance range and is not a product that can be sold in ACT 55, processor 71 proceeds to ACT 56. Processor 71 outputs a registration error for the purchased product in ACT 56. That is, processor 71 outputs an error signal to attendant terminal 20. Processor 71 also lights or flashes lamp 17 in a predetermined color to notify the attendant that an error has occurred.

[0096] After outputting the registration error, the processor 71 proceeds to ACT57. In ACT57, the processor 71 waits for the error to be cleared. Once the error is cleared, the processor 71 proceeds to ACT58. In ACT58, the processor 71 checks whether or not to permit the product registration for which the error occurred. If a command to permit the product registration is given when the error is cleared, the processor 71 proceeds to ACT10 in Figure 6. That is, the processor 71 executes the product registration process. Then, upon completion of the product registration process, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state in ACT12 to ACT14.

[0097] On the other hand, if there is a command not to permit registration, the processor 71 proceeds to ACT11 in Fig. 6. That is, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md, and returns to the standby state of ACT12 to ACT14.

[0098] In this way, when the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md is outside the set weight range of the purchased product whose registration has been accepted, the product sales data processing device 10 of the second embodiment analyzes the image captured by the camera 50 and checks whether or not it has recognized a placing action by the purchaser. If it has recognized a placing action, the product sales data processing device 10 checks whether or not it has recognized a removal action by the purchaser. If it recognizes not only a placing action but also a removal action, the product sales data processing device 10 executes a registration process for the purchased product.

[0099] Recognizing the placing and removing actions of the purchaser means that the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md is outside the set weight range of the purchased product whose registration has been accepted, which corresponds to the [second pattern] described in Figure 9. In other words, even in the second embodiment, if the weight falls outside the set weight range due to the [second pattern], no error occurs, and the registration of the purchased product is valid.

[0100] If the purchaser's removal action is not recognized, the product sales data processing device 10 checks the attributes of the purchased product. If a non-standard product that exceeds the set weight tolerance range is a product that can be sold, the product sales data processing device 10 executes a registration process for the purchased product.

[0101] The fact that the purchased product is a non-standard product means that the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md is outside the set weight range of the purchased product whose registration has been accepted, which corresponds to the [first pattern] described in Figure 8. In other words, in the second embodiment, if the weight falls outside the set weight range due to the [first pattern], no error occurs, and the registration of the purchased product is valid.

[0102] As described above in detail, the product sales data processing device 10 of the second embodiment can also reduce the frequency of errors in registration even when the purchaser has correctly registered the purchased product as much as possible compared to the conventional system, thereby achieving the effect of realizing smooth product registration.

[0103] Furthermore, in the first embodiment, it is necessary to prepare data for an external image for each product, but in the second embodiment, it is not necessary to prepare data for an external image, and the amount of data in the product master file 60 can be reduced.

[0104] <Third embodiment> Next, a third embodiment of the product sales data processing device 10 will be described. In the third embodiment, the procedure of the function as the confirmation means 86 in the second embodiment is changed. Other than that, it is the same as the second embodiment, so Figures 1 to 6, 8, and 9 also apply to the third embodiment as they are, and their description will be omitted.

[0105] 11 is a flowchart showing the main steps of information processing executed by the processor 71 of the merchandise sales data processing device 10 according to the merchandise sales data processing program in the third embodiment. Specifically, this is the processing procedure after the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md falls outside the set weight range of the purchased merchandise whose registration has been accepted, in ACT 9 of the same procedure shown in FIG. 6, that is, after the inequality [W-α]≦ΔM≦[W+α] is not satisfied.

[0106] If the above inequality is not satisfied in ACT9 of Fig. 6, the processor 71 proceeds to ACT61 of Fig. 11. The processor 71 acquires an image captured by the camera 50 in ACT61.

[0107] When an image captured by camera 50 is acquired, processor 71 proceeds to ACT 62. In ACT 62, processor 71 determines whether the purchased product registered in device main body 101 is a non-standard product that exceeds the set weight tolerance range and is a product that can be sold. That is, processor 71 determines whether a non-standard product is a product that can be sold based on the attributes of the registered product information written in registered product memory Ma.

[0108] If the purchased product is not a non-standard product that exceeds the set weight tolerance range and is not a product that can be sold, the processor 51 proceeds to ACT 63. In ACT 63, the processor 71 analyzes the image captured by the camera 50 and recognizes the purchaser's actions.

[0109] In ACT 64, the processor 71 checks whether or not a placing action by the purchaser has been recognized from the image captured by the camera 50. If a placing action has been recognized, the processor 51 proceeds to ACT 65. In ACT 65, the processor 51 checks whether or not a picking up action by the purchaser has been recognized from the image captured by the camera 50.

[0110] If not only a placing action but also a picking action is recognized, the processor 71 proceeds to ACT 10 in Figure 6. That is, the processor 71 executes the product registration process. Then, when the product registration process is completed, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state of ACT 12 to ACT 14.

[0111] On the other hand, if the placing action cannot be recognized in ACT 64, or if the taking-out action cannot be recognized in ACT 65, the processor 71 proceeds to ACT 66. The processor 71 outputs a registration error for the purchased item in ACT 66. That is, the processor 71 outputs an error signal to the attendant terminal 20. The processor 71 also lights or flashes the lamp 17 in a predetermined color to notify the attendant that an error has occurred.

[0112] After outputting the registration error, the processor 71 proceeds to ACT 67. In ACT 67, the processor 71 waits for the error to be cleared. Once the error is cleared, the processor 71 proceeds to ACT 68. In ACT 68, the processor 71 checks whether or not to permit the product registration for which the error occurred. If a command to permit the product registration is given when the error is cleared, the processor 71 proceeds to ACT 10 in Figure 6. That is, the processor 71 executes the product registration process. Then, upon completion of the product registration process, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md. The processor 71 returns to the standby state of ACT 12 to ACT 14.

[0113] On the other hand, if there is a command not to permit registration, the processor 71 proceeds to ACT11 in Fig. 6. That is, the processor 71 copies the value of the current weight memory Mc to the previous weight memory Md, and returns to the standby state of ACT12 to ACT14.

[0114] On the other hand, in ACT 62, if the purchased product is a product that may be sold as a non-standard product that exceeds the set weight tolerance range, the processor 51 proceeds to ACT 69. In ACT 69, the processor 71 analyzes the image captured by the camera 50 and recognizes the purchaser's actions.

[0115] In ACT 70, processor 71 checks whether a placing action by the purchaser has been recognized from the image captured by camera 50. If a placing action has been recognized, processor 71 proceeds to ACT 10 in FIG. 6. That is, processor 71 executes product registration processing. Then, upon completion of the product registration processing, processor 71 copies the value of current weight memory Mc to previous weight memory Md. Processor 71 returns to a standby state for ACT 12 to ACT 14.

[0116] On the other hand, if the placing action cannot be recognized, the processor 51 proceeds to the above-mentioned ACT 66. The processor 71 executes the processes from ACT 66 onwards in the same manner as described above.

[0117] In this way, even in the product sales data processing device 10 of the third embodiment, if the weight falls outside the set weight range according to the [first pattern] described using Fig. 8, or if the weight falls outside the set weight range according to the [second pattern] described using Fig. 9, no error occurs and the registration of the purchased product is valid. Therefore, the frequency with which registration errors occur even when the purchaser correctly registers the purchased product can be reduced as much as possible compared to the conventional case, and the advantageous effect of realizing smooth product registration can be achieved.

[0118] [Variations] In the above embodiment, a current weight memory Mc and a previous weight memory Md are provided, and in ACT9 of Fig. 6, it is determined whether the difference ΔM between the value in the current weight memory Mc and the value in the previous weight memory Md is within the set weight range of the purchased item. In this regard, instead of the previous weight memory, a memory that totals the set weights of the purchased items registered as one transaction, a so-called set weight total memory, may be provided. Then, it may be determined whether the difference between the value in the current weight memory Mc and the value in the set weight total memory is within the set weight range of the purchased item.

[0119] In the above embodiment, a camera 50 is provided for each second product display stand 103 of the product sales data processing device 10. In this regard, one camera 50 can capture images of purchased products placed on each second product display stand 103 of multiple product sales data processing devices 10. The processor 71 of each product sales data processing device 10 may extract an image of its own second product display stand 103 from the images captured by the camera 50 and check whether purchased products are captured or the actions of the purchaser. This allows the number of cameras 50 to be reduced compared to the number of product sales data processing devices 10, thereby reducing costs.

[0120] The confirmation means 86 may be implemented using AI functions. That is, an AI is prepared that inputs an external image of a product and outputs product identification information. Then, the external image of the product and the product identification information, which is the correct data for that product, are input to the AI ​​as training data, and the AI ​​is trained in advance. If the weight falls outside the set weight range after a purchaser correctly registers a purchased product, the external image of the product shown in the acquired image is input to the AI, and the AI ​​outputs the product identification information for that product. Then, by comparing the product identification information of the purchased product output from the AI ​​with the product identification information of the received purchased product, it is confirmed whether the registered purchased product is shown in the acquired image.

[0121] Although several embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0122] 10...Product sales data processing device, 11...Touch panel, 12...Card reader, 13...Printer, 14...Scanner, 15...Hand scanner, 16...Cash processing machine, 17...Lamp, 18...Speaker, 20...Attendant terminal, 30...Store server, 40...Scale unit, 50...Camera, 51...Processor, 60...Product master file, 71...Processor, 72...Main memory, 73...Auxiliary storage device, 74...Clock, 75...Communication interface, 76... Scale interface, 77...camera interface, 78...I / O interface, 79...system transmission path, 81...reception means, 82...weight acquisition means, 83...determination means, 84...first processing means, 85...image acquisition means, 86...confirmation means, 87...second processing means, 88...error output means, 100...self-checkout system, 101...device main body, 102...first product placement table, 103...second product placement table, 104...temporary placement table, 105...holding arm.

Claims

1. a receiving means for receiving a purchase product registration operation by a purchaser; a weight acquisition means for acquiring a load weight of a placement section on which the purchased product for which the registration operation has been accepted is placed; an image acquisition means for acquiring an image of the purchased product placed on the placement section; a confirmation means for confirming whether the purchased product received by the reception means is shown in the image; a determining means for determining whether or not to allow the registration process of the purchased product based on the load weight; a processing means for registering sales data of the purchased product when the determination means determines that the registration process of the purchased product is not permitted but the confirmation means confirms that the purchased product is shown in the image; A product sales data processing device comprising:

2. The processing means further 2. The merchandise sales data processing device according to claim 1, wherein when said determining means determines that the registration process of the purchased merchandise is permitted, the sales data of the purchased merchandise is registered.

3. an error output means for outputting an error when the determination means determines that the registration process of the purchased product is not permitted and the confirmation means does not confirm that the purchased product is shown in the image; 3. The product sales data processing device according to claim 1, further comprising:

4. 3. A product sales data processing device as described in claim 1 or 2, wherein the confirmation means acquires a pre-set appearance image of the purchased product accepted by the acceptance means and confirms whether an image similar to the appearance image is displayed in the image acquired by the image acquisition means.

5. 3. A product sales data processing device according to claim 1, wherein the confirmation means confirms whether the action of the purchaser placing the purchased product received by the reception means on the placement section is captured in the image acquired by the image acquisition means.

6. A product sales data processing device as described in claim 5, wherein the confirmation means confirms whether the purchaser's action of placing the purchased product received by the reception means on the placement section and the action of removing the purchased product from the placement section are captured in the image acquired by the image acquisition means.

7. The computer of the product sales data processing device, A receiving means for receiving a purchase product registration operation by the purchaser himself / herself; a weight acquisition means for acquiring a load weight of the placement unit on which the purchased product for which the registration operation has been accepted is placed; an image acquisition means for acquiring an image of the purchased product placed on the placement section; a confirmation means for confirming whether the purchased product accepted by the acceptance means is shown in the image; a determination means for determining whether or not to permit registration of the purchased product based on the load weight; a processing means for registering sales data of the purchased product when the determination means determines that the registration process of the purchased product is not permitted but the confirmation means confirms that the purchased product is shown in the image; A program to function as a

Images