Commodity sales data processing device and program

Abstract

To provide a commodity sales data processing device using an RFID tag and a program, capable of easily recognizing the occurrence of incomplete reading or excessive detection of the RFID tag.SOLUTION: A commodity sales data processing device includes: a reading unit that transmits electric waves to a commodity given an RFID tag to read information capable of identifying the commodity from the RFID tag as response waves to the electric waves; a first counting unit that counts the number of points for the commodity read by the reading unit; a second counting unit that, on the basis of an image obtained by capturing an operator operating his / her device, counts the number of points for the commodity moved to a transmission range of the electric waves from action of the operator represented in the image; and a comparison unit that compares the number of points for the commodity counted by the first counting unit with the number of points counted by the second counting unit.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] An embodiment of the present invention relates to a product sales data processing device and a program. [Background technology]

[0002] In recent years, for example, in stores such as apparel (clothing) mass retailers and supermarkets, wireless tag readers are being adopted that attach wireless tags to products sold in the store and read information related to the products purchased by customers from the wireless tags. Wireless tag readers read tag information using RFID (Radio Frequency IDentification) technology (hereinafter, wireless tags are also referred to as RFID tags). Products purchased by customers are placed in, for example, a basket and brought to a checkout booth. The RFID tag reader installed at the checkout booth communicates with the wireless tags of the products contained in the basket via an antenna to read tag information from the RFID tags.

[0003] The tag information read by the RFID tag reader, for example, product-related information such as a product code that identifies the product, is sent to a POS (Point Of Sales) terminal. The POS terminal performs accounting based on the received product-related information. Accounting refers to the process of making payment for the product purchased by a customer. The POS terminal may be a POS terminal operated by a store clerk or a self-service POS terminal operated by the customer themselves.

[0004] However, RFID tag readers may fail to read the tag information of an RFID tag (hereinafter referred to as "missed reading") or may read irrelevant tag information (hereinafter referred to as "overdetection") due to the position or orientation of the RFID tag, overlap with other products, etc. In view of this, a configuration has been proposed in the past in which antennas capable of communicating with wireless tags are embedded in the area where baskets are placed and the area where products are packed into bags, and when products are taken out of the baskets and moved to the area where the products are packed, the wireless tags of the products are read one by one (for example, Patent Document 1).

[0005] However, even with the conventional methods described above, there is a possibility of missed readings or overdetection depending on the position or orientation of the RFID tag. In addition, because RFID tags are read automatically, there is also the issue that customers may not easily notice when a tag is not read or misread. Summary of the Invention [Problem to be solved by the invention]

[0006] The problem that the present invention aims to solve is to provide a product sales data processing device and program that can easily recognize when an RFID tag has been misread or overdetected in a product sales data processing device that uses RFID tags. [Means for solving the problem]

[0007] The product sales data processing device and program of the embodiment include a reading unit that transmits radio waves to a product equipped with an RFID tag and reads information capable of identifying the product from the RFID tag as a response wave to the radio waves, a counting unit that counts the number of products read by the reading unit from the movements of an operator shown in an image of an operator operating the device, and a comparison unit that compares the number of products read by the reading unit with the number of products counted by the counting unit. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an external perspective view illustrating an example of the configuration of a self-service POS terminal according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing a hardware configuration of the self-checkout POS terminal according to the embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of the self-checkout POS terminal according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of an image analyzed by the functional unit of the self-checkout POS terminal according to the embodiment. [Diagram 5]FIG. 5 is a diagram illustrating an example of an image analyzed by the functional unit of the self-checkout POS terminal according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of an image analyzed by the functional unit of the self-checkout POS terminal according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of an image analyzed by the functional unit of the self-checkout POS terminal according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of an image analyzed by the functional unit of the self-checkout POS terminal according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating an example of product sales data processing performed by the self-checkout POS terminal according to the embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of a counting process related to product movement performed by the control unit according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of a product sales data processing device and a program will be described with reference to the drawings. In this embodiment, as an example of a product data processing device, an example will be described in which the device is applied to a self-service POS (Point of Sales) terminal (hereinafter also referred to as a self-service POS) where a customer performs registration and accounting operations. Note that the present invention is not limited to the embodiment described below.

[0010] FIG. 1 is an external perspective view showing an example of the configuration of a self-service POS terminal 1 according to an embodiment. The self-service POS terminal 1 is an example of a product sales data processing device, and is used in stores such as supermarkets. As shown in FIG. 1, the self-service POS terminal 1 includes a reading unit that reads an RFID tag that identifies a product to be purchased, and an accounting unit that performs accounting operations based on product information corresponding to the read RFID tag. The accounting operations in the accounting unit are performed by the customer himself. The self-service POS terminal 1 executes a sales registration process based on the product information corresponding to the RFID tag read by the reading unit. The self-service POS terminal 1 also executes accounting operations based on the accounting operations performed by the customer.

[0011] Here, sales registration processing refers to the processing of displaying and storing product information such as the product name and price of the product based on the input product code. Additionally, accounting processing refers to the processing of displaying the total amount related to the transaction based on the product information obtained through sales registration processing, and of accounting and issuing a receipt based on the deposit received from the customer. Additionally, transaction processing includes sales registration processing and accounting processing. Additionally, transaction information includes product information and accounting information.

[0012] The self-service POS terminal 1 comprises a first housing 2 and a second housing 3. The first housing 2 houses therein a change machine 27 that functions as a coin change machine or a bill change machine, and a control device (not shown). The change machine 27 stores currency received from customers by denomination. The change machine 27 also dispenses change to customers. The control device executes control processing (see FIG. 4) for the self-service POS terminal 1. The control device includes the control unit 100, memory unit 14, communication unit 30, power supply unit (not shown), etc. in FIG. 2.

[0013] The first housing 2 includes a deposit port 271 for depositing coins into the change machine 27 and a dispensing port 272 for dispensing coins from the change machine 27. The first housing 2 also includes a deposit port 273 for depositing banknotes into the change machine 27 and a dispensing port 274 for dispensing banknotes from the change machine 27. A customer deposits coins of the price for purchasing a product into the deposit port 271 and banknotes of the price into the deposit port 273 as a payment operation. The self-service POS terminal 1 takes the deposited money into the change machine 27 and stores it in a storage section by denomination. The self-service POS terminal 1 also dispenses the coin portion of the change paid to the customer from the change machine 27 to the dispensing port 272. The self-service POS terminal 1 also dispenses the banknote portion of the change paid to the customer from the change machine 27 to the dispensing port 274.

[0014] The first housing 2 also has a basket placement stand 38 and a plastic bag stand 39 on its left and right side surfaces. The basket placement stand 38 provided on the right side surface of the first housing 2 is a stand for placing a basket K into which products to be purchased have been placed. The plastic bag stand 39 provided on the left side surface of the first housing 2 is a stand for setting a plastic bag F for packing products removed from the basket placement stand 38 into the plastic bag F. The products packed in the plastic bag F are placed on the plastic bag stand 39.

[0015] The plastic bag stand 39 comprises two support posts 35 extending upward from the top surface of the plastic bag stand 39, a temporary placement stand 36 formed flat on the top of the support posts 35, and two extension rods 37 extending approximately horizontally from the temporary placement stand 36. The extension rods 37 are rods for hanging the plastic shopping bags F in which products are to be packed. The plastic bags F are set on the plastic bag stand 39 in an open state with their handles hooked onto the extension rods 37, making it easy to insert products. The temporary placement stand 36 is also a stand for temporarily placing fragile products (tofu and eggs). The products placed on the temporary placement stand 36 are finally packed into the plastic bags F.

[0016] The upper surface of the plastic bag stand 39 is a plastic bag placement area 40, on which products stored in a plastic bag F are placed. An RFID antenna 32 (not shown) is installed below the plastic bag placement area 40. As will be described in detail later, the RFID antenna 32 is connected to an RFID reader 31, which radiates radio waves via the RFID antenna 32. The RFID reader 31 also reads a response signal received by the RFID antenna 32 from an RFID tag.

[0017] The second housing 3 is provided on top of the first housing 2. The second housing 3 houses a printing unit 24 inside. The printing unit 24 includes, for example, a thermal head, and prints transaction information for the product purchased by the customer to issue a receipt. The self-service POS terminal 1 also includes a card unit 28 on the top surface of the first housing 2, next to the second housing 3. The card unit 28 reads customer identification information, for example, from an inserted credit card. The self-service POS terminal 1 executes the transaction process based on the customer identification information read by the card unit 28.

[0018] The second housing 3 also has a display unit 22 on the top. The display unit 22 is an example of a commercial control unit, which will be described later. The display unit 22 displays product information of products that have been registered as sold following a registration operation by a customer. The display unit 22 also displays accounting information following a accounting operation by a customer. The display unit 22 is positioned with its display surface 51 facing the customer who operates the self-service POS terminal 1. The display unit 22 also has a touch panel 21 on the display surface 51. By operating the touch panel 21 at a position corresponding to a key displayed on the display unit 22, the displayed key functions.

[0019] The self-service POS terminal 1 also includes a cylindrical pole 33 extending upward from the top surface of the first housing 2 behind the second housing 3. The pole 33 has a light-emitting unit 29 at its upper end, which emits light when a customer performs an operation to call an attendant or the like. The self-service POS terminal 1 also includes a camera 25 (imaging unit) immediately below the light-emitting unit 29 of the pole 33. The camera 25 captures an image of a wide range from the arrow Y3 to the arrow Y4, that is, the range from the basket placement table 38 to the shopping bag table 39. The camera 25 can capture an image of a customer removing products from the basket K and an operation of bagging the removed products into a shopping bag F. The term "imaging" used here refers to the camera 25 capturing moving images or continuous still images.

[0020] The movement point counting unit 104 (see FIG. 3), which will be described later, distinguishes and recognizes each of the products placed in the basket K. This technology is called "contour extraction" or "edge extraction" and is a well-known technology that recognizes as a contour (edge) any sudden change in color or density between an object and another object, or between an object and the background (the basket K in this embodiment) based on a captured image. The control unit 100 continuously labels this contour, thereby recognizing the object surrounded by the contour as one product and distinguishing it from other products. In this way, the control unit 100 distinguishes each of the products placed in the basket K. Hereinafter, the above technology will be referred to as "labeling".

[0021] In addition, the movement item counting unit 104 recognizes the movements of the operator operating the device from the images captured by the camera 25, and when the operator moves a labeled and differentiated product from the basket placement stand 38 (basket K) to the shopping bag stand 39 (shopping bag F), it recognizes that a registration operation has been performed to register the product as a sale.

[0022] From here, the hardware configuration of the self-service POS terminal 1 will be described. FIG. 2 is a block diagram showing the hardware configuration of the self-service POS terminal 1. As shown in FIG. 2, the self-service POS terminal 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a memory unit 14, and the like. The CPU 11 is the main controller. The ROM 12 stores various programs. The RAM 13 expands various data. The memory unit 14 stores various programs. The CPU 11, the ROM 12, the RAM 13, and the memory unit 14 are connected to one another via a data bus 15. The CPU 11, the ROM 12, and the RAM 13 constitute a control unit 100. That is, the control unit 100 executes a control process described later by the CPU 11 operating in accordance with a control program stored in the ROM 12 or the memory unit 14 and expanded in the RAM 13.

[0023] The memory unit 14 is configured with a non-volatile memory such as a hard disk drive (HDD) or a flash memory that retains stored information even when the power is turned off, and includes a control program unit 141 that stores a control program. The memory unit 14 also includes an image storage unit 142. The image storage unit 142 stores images captured by the camera 25.

[0024] In addition, the control unit 100 is connected to the touch panel 21, the display unit 22, the printing unit 24, the camera 25, the change machine 27, the card unit 28, the light-emitting unit 29, the communication unit 30, the RFID reader 31, and the RFID antenna 32 via the data bus 15 and the controller 16.

[0025] Touch panel 21 includes a start key 211 corresponding to the display of a "start key" on display unit 22, and an end key 212 corresponding to the display of an "end key." In the following description, "keys provided on touch panel 21 corresponding to the display of keys on display unit 22" will be simplified to, for example, "keys displayed on display unit 22."

[0026] The start key 211 is a key that a customer operates when starting a registration operation by the customer at the self-service POS terminal 1. The end key 212 is a key that a customer operates when ending a registration operation by the customer at the self-service POS terminal 1.

[0027] The display unit 22 is configured with, for example, a liquid crystal panel. The cameras 25 each include a CCD image sensor (not shown), and the cameras 25 capture images using the CCD image sensor.

[0028] The RFID reader 31 operates the RFID antenna 32 to emit radio waves from the RFID antenna 32. The RFID reader 31 also acquires tag information from the RFID tag received by the RFID antenna 32, and outputs the tag information to the self-checkout POS terminal 1.

[0029] From here, the functional configuration of the self-service POS terminal 1 will be described. FIG. 3 is a block diagram showing an example of the functional configuration of the self-service POS terminal 1. As shown in FIG. 3, the self-service POS terminal 1 includes a reading unit 101, a captured image acquisition unit 102, a read point counting unit 103, a moved point counting unit 104, a comparison unit 105, a product registration unit 106, an accounting processing unit 107, and an alarm unit 108. Some or all of these functional units may be software configurations realized by cooperation between the processor (CPU 11) and various programs (e.g., control program unit 141) stored in the memory (ROM 12, memory unit 14). Also, some or all of these functional units may be hardware configurations realized by a dedicated circuit or the like.

[0030] The reading unit 101 is an example of a reading unit. The reading unit 101 controls the RFID reader 31 to control reading of tag information using the RFID antenna 32. Specifically, the reading unit 101 controls the RFID reader 31 to cause the RFID antenna 32 to transmit radio waves for communicating with an RFID tag. The reading unit 101 also acquires tag information received by the RFID antenna 32 via the RFID reader 31.

[0031] The captured image acquisition unit 102 acquires a moving image or a series of still images (hereinafter, also simply referred to as images) of an operator operating the device itself captured by the camera 25. Specifically, the captured image acquisition unit 102 starts to capture the moving image or the series of still images captured by the camera 25 via the controller 16. In addition, the captured image acquisition unit 102 stores the images captured by the camera 25 in the image storage unit 142 of the memory unit 14.

[0032] The read point counting unit 103 is an example of a first counting unit. The read point counting unit 103 counts the number of items purchased by a customer, that is, the number of RFID tags received by the RFID antenna 32. Specifically, the read point counting unit 103 counts the number of items read by the reading unit 101 (hereinafter, also referred to as the number of read items).

[0033] In addition, the read point counting unit 103 performs an exclusive process based on the tag identifier to prevent duplicate counting of tag information with the same tag identifier. For example, the read point counting unit 103 temporarily stores the tag identifier of the counted tag information, thereby controlling not to duplicately count tag information related to the same tag identifier.

[0034] The read point counting unit 103 may be configured to count the number of items registered in the product registration unit 106 described later. In this case, the read point counting unit 103 may utilize an exclusive function of the product registration unit 106 for preventing duplicate registration.

[0035] The moved number counting unit 104 is an example of a second counting unit. The moved number counting unit 104 counts the number of items moved into the transmission range of the radio waves from the operator's actions shown in a video or continuous still image captured by the camera 25 of the operator operating the device. Specifically, the moved number counting unit 104 analyzes the image stored in the image storage unit 142, and when it recognizes that a registration operation has been performed to move an item from the basket placement stand 38 (basket K) to the shopping bag stand 39 (shopping bag F), it counts the number of items moved (hereinafter also referred to as the moved number of items). The operation of the moved number counting unit 104 will be described later.

[0036] The comparison unit 105 is an example of a comparison unit. The comparison unit 105 compares the number of items read by the RFID antenna 32 installed under the plastic bag stand 39 with the number of items moved from the basket K to the plastic bag F, and outputs the comparison result. Specifically, the comparison unit 105 compares the number of items read by the read number counting unit 103 with the number of items moved by the moved number counting unit 104.

[0037] The product registration unit 106 performs sales registration of products purchased by customers based on the tag information read by the RFID antenna 32 and acquired by the reading unit 101. Specifically, the product registration unit 106 acquires product information of the product corresponding to the product code included in the tag information by comparing the product code included in the tag information with the product code of each product stored in the memory unit 14. Then, the product registration unit 106 performs sales registration of the product by temporarily storing the acquired product information in the RAM 13 or the like.

[0038] The product registration unit 106 performs an exclusive process based on the tag identifier to prevent duplicate sales registration of product codes included in tag information with the same tag identifier. For example, the product registration unit 106 performs sales registration of the tag identifier of the tag information used to acquire the product information together with the product information, thereby controlling to prevent duplicate registration of product information related to the same tag identifier.

[0039] The accounting processor 107 performs accounting for products purchased by a customer based on the product information registered as sales by the product registration unit 106. For example, the accounting processor 107 calculates the total price of the products based on the price included in the product information of each product registered as sales by the product registration unit 106. The accounting processor 107 also subtracts the total price from the deposited payment amount, and dispenses the subtracted value (change amount) as change.

[0040] The notification unit 108 is an example of a notification unit. The notification unit 108 notifies a customer or a store clerk based on the comparison result of the comparison unit 105. Specifically, when the comparison result between the number of products read by the comparison unit 105 and the number of products moved does not match, the notification unit 108 notifies the customer or the store clerk by displaying a message on the display unit 22 to the effect that the number of products does not match.

[0041] As another method of notifying the store clerk, the notifying unit 108 may notify the store clerk by causing the light emitting unit 29 to emit light.

[0042] Also, a threshold value may be set in advance for the difference in score between the product read score and the product moved score, and the method of notification or the content of the message to be notified may be changed depending on whether the difference in score is equal to or greater than the threshold. For example, if the difference in score is less than the threshold, a message may be displayed on the display unit 22 to prompt the user to check whether the products packed in the shopping bag F are overlapping, assuming that the tag reading may be poor due to overlapping products. If the difference in score is equal to or greater than the threshold, a guidance on how to move the products may be displayed on the display unit 22, assuming that the product movement may not be correctly recognized. Alternatively, the store clerk may be notified by illuminating the light-emitting unit 29.

[0043] The timing for making the notification may be when the end key 212 is operated, as described later with reference to Fig. 9. Alternatively, the notification may be made when a difference occurs between the number of read products and the number of moved products that is equal to or exceeds a preset threshold value during the registration operation.

[0044] Also, as a case where the number of products does not match, a case where the number of products moved is greater than the number of products read is assumed. This is, for example, a case where the RFID tag of a product cannot be read because the product is placed on the temporary placement table 36 when being moved. Therefore, if the comparison by the comparison unit 105 results in the number of products moved being greater than the number of products read, the notification unit 108 may display a message urging the user to check whether any products are placed on the temporary placement table 36, in addition to a message indicating that the number of products does not match.

[0045] An example of the operation of read point counting unit 103 and moved point counting unit 104 will be described below with reference to Figs. 4 to 8. Figs. 4 to 8 are schematic diagrams showing images captured by camera 25. Such images include area G1, which is the upper surface of basket placement stand 38, and area G2, which is the upper surface of plastic bag stand 39. Note that first housing 2 and second housing 3 are not shown in the drawings.

[0046] Fig. 4 is a diagram showing the state before the registration operation is started. As shown in Fig. 4, an image of a basket K containing products A, B, C, and D to be purchased by a customer is captured in area G1. Meanwhile, an image of a temporary placement table 36, an extension rod 37, and a plastic bag F set in the extension rod 37 is captured in area G2. Immediately before the registration operation is started, the products have not been packed into the plastic bag F.

[0047] 5 is a diagram showing the state immediately after the start of the registration operation. Immediately after the start of the registration operation, the customer takes out one of the products stored in basket K. The camera 25 captures an image of this customer's action. That is, the camera 25 captures an image of the customer's hand grabbing one of the products and taking it out of basket K. Hereinafter, the case of taking out product C will be considered as an example.

[0048] 6 and 7 are diagrams showing a state in which a product removed from basket K is being moved toward area G2. As shown in Fig. 6, a customer removes product C from basket K with his / her hand T, and then moves the removed product C from area G1 toward area G2. The customer also packs the product C moved to area G2 into a shopping bag F. That is, camera 25 captures an image of the action of the customer's hand T grabbing product C and moving it to area G2.

[0049] When product C is put into the shopping bag F, the RFID antenna 32 provided below the basket placement table 38 communicates with the RFID tag attached to product C, and the reading unit 101 reads the tag information of product C. In response, the read point counting unit 103 adds 1 to the read point number. In other words, in this embodiment, the sales registration process for products based on the reading of the RFID tag is performed one by one.

[0050] Meanwhile, when the movement point counting unit 104 recognizes a customer's registration operation captured by the camera 25, specifically, the operation of moving the product C from area G1 to area G2, it adds 1 to the movement point. That is, in this embodiment, each time an item stored in the basket K is moved to the shopping bag F, the read point and movement point are added by 1. Note that there is no particular restriction on the method of recognizing the registration operation by the movement point counting unit 104, and any known technology, such as a motion recognition technology using AI, can be used.

[0051] Fig. 8 is a diagram showing a state in which, after placing a product in area G2, the customer moves hand T toward area G1. As shown in Fig. 8, the customer removes hand T from product C packed in a shopping bag F, so that hand T is no longer holding anything. Then, the customer moves hand T from area G2 toward area G1 to take the next product from basket K.

[0052] At this time, the camera 25 captures the movement of the customer's hand T from the area G2 to the area G1. However, the movement point counting unit 104 excludes such a movement from the recognition target or from the movement point counting target, thereby retaining the counted movement point.

[0053] When the hand T holding the commodity moves from the area G2 to the area G1, the movement point counting unit 104 may be configured to recognize the movement as a minus operation. In this case, when the movement point counting unit 104 recognizes the minus operation, it subtracts 1 from the movement point.

[0054] An example of product sales data processing performed by the self-service POS terminal 1 will be described below. Fig. 9 is a flowchart showing an example of product sales data processing performed by the self-service POS terminal 1. First, a customer using the self-service POS terminal 1 places a basket K containing products on the basket placement stand 38. Then, the customer operates the start key 211 displayed on the display unit 22.

[0055] The control unit 100 waits for the start key 211 to be operated (step S11: No), and when it determines that the start key 211 has been operated (step S11: Yes), it starts capturing images with the camera 25 (step S12). That is, the camera 25 starts capturing images of an area G2 including the products in the basket K placed on the basket placement table 38 and the plastic bag F placed on the plastic bag table 39. At this point, the products are not yet packed in the plastic bag F (see FIG. 4). The captured image acquisition unit 102 sequentially stores the images captured by the camera 25 in the image storage unit 142.

[0056] Next, the transfer point counting unit 104 starts a process of counting the product transfer points (step S13). The counting process in step S13 is executed in parallel in the background of this process. The counting process in step S13 will be described later.

[0057] Next, when the reading unit 101 determines that the tag information of the product has been read (step S14: Yes), it acquires the tag information (step S15). That is, it acquires the tag information received by the RFID antenna 32 via the RFID reader 31. Furthermore, while the tag information of the product has not been read, it waits until the end key 212 is operated (step S14: No → step S19: No).

[0058] When the tag information is acquired in step S15, the read point counting unit 103 updates the read product point count by adding 1 to the read product point count (step S16). Next, the product registration unit 106 performs a sales registration process based on the tag information acquired in step S15 (step S17). Then, the product information is displayed on the display unit 22 (step S18).

[0059] Next, the control unit 100 judges whether the end key 212 has been operated, and if not (step S19: No), returns the process to step S14. If the control unit 100 judges that the end key 212 has been operated (step S19: Yes), it compares the read commodity points with the moved commodity points counted in the counting process of step S13 (step S20). That is, it compares the read commodity points counted by the read point counting unit 103 with the moved commodity points counted by the moved point counting unit 104.

[0060] Next, the comparison unit 105 determines whether the quantity of the read product points matches the quantity of the moved product points based on the processing result of step S20 (step S21). If the read product points matches the quantity of the moved product points (step S21: Yes), the process proceeds to the checkout process (step S23). If the read product points does not match the quantity of the moved product points (step S21: No), the process notifies the user that the quantities do not match (step S22). The method of notification and the contents of the message to be notified are not limited to the above-mentioned examples. After the quantity mismatch in step S22 is resolved, the control unit 100 returns the process to step S14. The control unit 100 then stops capturing images by the camera 25 (step S24) and stops displaying the screen on the display unit 22 (step S25).

[0061] Next, an example of the counting process of the number of transferred goods performed by the self-service POS terminal 1 will be described with reference to Fig. 10. Fig. 10 is a flow chart showing an example of the counting process of the number of transferred goods performed by the self-service POS terminal 1. This process corresponds to the process of step S13 described in Fig. 9.

[0062] First, the control unit 100 labels the products included in the displayed image to distinguish each product from other products (step S31). Next, the control unit 100 determines whether the product has been moved from the basket K to a shopping bag F (step S32).

[0063] Specifically, of the registration operations described above with reference to Figures 5 to 7, (1) one of the products stored in basket K is removed, and (2) the removed product is moved from area G1 toward area G2. Upon completion of these two steps, the control unit 100 determines that the product has been moved from basket K to shopping bag F.

[0064] When the control unit 100 recognizes that the product has been moved from the basket K to the shopping bag F, that is, when the product registration operation is performed (step S32: Yes), the control unit 100 updates the product movement points by adding 1 to the product movement points (step S33). However, when the control unit 100 does not recognize the movement of the product (step S32: No), the control unit 100 skips step S33 and proceeds to step S34.

[0065] Next, the control unit 100 determines whether or not the image capture by the camera 25 has ended in step S24 of Fig. 9, and if the image capture is continuing (step S34: No), the process returns to step S32. In other words, the process of counting the number of movement points continues until the transaction process starts (ends).

[0066] Moreover, if it is determined that the imaging has ended (step S34: Yes), the control unit 100 ends this process.

[0067] As described above, the product sales data processing device of this embodiment transmits radio waves to a product with an RFID tag attached, and compares the number of products read by a reading unit that reads information capable of identifying the product from the RFID tag as a response wave to the radio waves with the number of products moved into the transmission range of the radio waves based on an image of an operator operating the product sales data processing device as a result of the operator's action shown in the image. As a result, the product sales data processing device of this embodiment can issue a notification based on the comparison result when the number of products read from the RFID tag does not match the number of products moved by the registration operation, so that the operator or store clerk can easily recognize that an RFID tag has been misread or overdetected.

[0068] The above-described embodiment can be modified as appropriate by changing a part of the configuration or function of the above-described device. Therefore, some modified examples of the above-described embodiment will be described below as other embodiments. Note that the following mainly describes the differences from the above-described embodiment, and a detailed description of the common points with the contents already described will be omitted. The modified examples described below may be implemented individually or in appropriate combination.

[0069] (Variation 1) In the above embodiment, the RFID antenna 32 is installed only below the shopping bag stand 39, but the RFID antenna 32 may also be installed below the basket stand 38. In this case, the read number counting unit 103 merges the tag information read by the RFID antenna 32 of the basket stand 38 and the tag information read by the RFID antenna 32 of the shopping bag stand 39, and counts the number of read products while eliminating identical tag information with duplicate tag identifiers.

[0070] In this case, since the configuration of this modified example is such that an unspecified number of RFID tags are read at once, it is preferable that the comparison unit 105 compares the number of read products with the number of moved products at the timing when the end key 212 is operated. This makes it possible to achieve the same effect as the above-mentioned embodiment.

[0071] (Variation 2) In the above embodiment, when the comparison result between the read product count and the moved product count by the comparison unit 105 does not match, the notification unit 108 notifies the customer or the store clerk by displaying a message to that effect on the display unit 22. However, the contents of the notification by the notification unit 108 and the conditions for the notification are not limited to this.

[0072] For example, the notification unit 108 may notify the status of the number of items by causing the display unit 22 to display a state in which the number of items counted by the read number counting unit 103 and the number of items counted by the moved number counting unit 104 can be compared, regardless of the comparison result of the comparison unit 105. Note that the timing of display on the display unit 22 is not limited to the timing when the end key 212 is operated, and may be constantly displayed while the registration operation is being performed.

[0073] With the above-described configuration, customers can check the number of items found by reading the RFID tag and the number of items moved through the registration operation, making it easier for them to recognize if an RFID tag has been misread or an overdetection has occurred.

[0074] (Variation 3) In the above embodiment, the number of moving items is counted by focusing on the movement of the customer's own hand T, but the method of counting the number of moving items is not necessarily limited to this. For example, the bone structure and posture of the customer may be estimated from an image captured by the camera 25, and the position of the customer's own hand T may be grasped and used to count the number of moving items.

[0075] The above configuration improves the accuracy of recognizing actions related to product movement, and enables accurate counting of the number of product movements, thereby achieving the effect of obtaining more accurate comparison results.

[0076] (Variation 4) In the above embodiment, the comparison unit 105 compares the read product count with the moved product count when the end key 212 is operated, but the comparison timing is not limited to this. For example, the comparison may be performed when the tag information of the product is read and the read product count is updated.

[0077] With the above configuration, it is possible to report the occurrence of a problem early on if a discrepancy occurs between the number of products read and the number of products moved, thereby making it easier to recognize when an RFID tag has been misread or over-detected.

[0078] (Variation 5) In the above embodiment, the self-service POS terminal 1 operated by the customer himself has been described as the checkout device, but the present invention is not limited to this and can also be applied to a checkout device operated by a dedicated operator that captures and displays the operator's operation. In this case, the image captured by the camera 25 is displayed on the display unit 22 for the operator.

[0079] (Variation 6) In the above-described embodiment, (1) one of the products stored in basket K is removed. (2) The removed product is moved from area G1 toward area G2. Completion of these two steps constitutes the action of moving the products from basket K to plastic bag F. The action of moving the products from basket K to plastic bag F may also be defined as an additional step in which hand T holding a product enters plastic bag F and hand T holding nothing exits plastic bag F.

[0080] The above configuration improves the accuracy of recognizing actions related to product movement, and enables accurate counting of the number of product movements, thereby achieving the effect of obtaining more accurate comparison results.

[0081] In addition, the program executed by the self-service POS terminal 1 of the embodiment is provided as a file in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disc).

[0082] The program executed by the self-service POS terminal 1 of the embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program executed by the self-service POS terminal 1 of the embodiment may be provided or distributed via a network such as the Internet.

[0083] Furthermore, the program executed by the self-service POS terminal 1 of the embodiment may be configured to be provided by being pre-installed in a ROM or the like.

[0084] Although the embodiment of the present invention has been described above, this embodiment is presented as an example and is not intended to limit the scope of the invention. These new embodiments and their modifications can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0085] 1 Self-service POS terminal 22 Display section 25 Camera 38 Basket placement stand 39 Plastic Bag Stand 100 Control section 101 Reading unit 103 Reading point counting unit 104 Moving Point Counting Unit 105 Comparison section 108 Notification Department F Plastic bag K Basket [Prior art documents] [Patent documents]

[0086] [Patent Document 1] Patent Publication No. 2021-47631

Claims

1. a reader that transmits radio waves to a product having an RFID tag attached thereto and reads information capable of identifying the product from the RFID tag as a response wave to the radio waves; a first counting unit that counts the number of products read by the reading unit; a second counting unit that counts the number of products that have been moved into the transmission range of the radio waves based on an image of an operator operating the device, the number being calculated based on the operator's movement shown in the image; a comparison unit that compares the number of items counted by the first counting unit with the number of items counted by the second counting unit; A product sales data processing device comprising:

2. a notification unit that issues a notification when the number of items counted by the first counting unit does not match the number of items counted by the second counting unit; The product sales data processing device according to claim 1 , further comprising:

3. a notification unit that displays on a display device the number of items counted by the first counting unit and the number of items counted by the second counting unit in a comparable state; The product sales data processing device according to claim 1 , further comprising:

4. The notification unit switches the notification method or the notification content depending on whether a difference between the number of items counted by the first counting unit and the number of items counted by the second counting unit is equal to or greater than a threshold. The product sales data processing device according to claim 2 .

5. The comparison unit compares the number of items counted by the first counting unit with the number of items counted by the second counting unit on condition that a payment instruction has been given. The product sales data processing device according to claim 1 .

6. a reader that transmits radio waves to a product having an RFID tag attached thereto and reads information capable of identifying the product from the RFID tag as a response wave to the radio waves; a first counting unit that counts the number of products read by the reading unit; a second counting unit that counts the number of products that have been moved into the transmission range of the radio waves based on an image of an operator operating the device, the number being calculated based on the operator's movement shown in the image; a comparison unit that compares the number of items counted by the first counting unit with the number of items counted by the second counting unit; A program that makes a computer function as a

Images