Article registration support device, article registration support system, and program

Abstract

To provide an article registration support device, an article registration support system, and a program that can prevent an illegal act when a customer registers an article by himself or herself.SOLUTION: An edge gateway (article registration support device) supports the operation of a cart terminal (article registration device) which registers an article, and comprises: a video acquisition part which acquires video that a camera (photographing device) photographs of a basket containing articles having information read and the identification number of the basket, the video showing that the articles are thrown in the basket, an article counting part (counting part) which counts a first number through the video, the first number being the number of articles thrown in the basket; an article registration information acquisition part (article number acquisition part) which acquires a second number, the second number being the number of articles that the cart terminal reads until the completion of the registration; and an article number comparison information output part which outputs the identification number, and the first number and the second number to let a portable terminal (terminal device) that a shop assistant carries give notice.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] An embodiment of the present invention relates to a product registration support device, a product registration support system, and a program. [Background technology]

[0002] Conventionally, a shopping system has been proposed in which an image of a product is taken when a customer places the product in a shopping cart, and the image is sent to a server, where the product is identified, thereby registering the product and settling the payment (for example, Patent Document 1).

[0003] Such a shopping system is effective in terms of shortening the time spent waiting at the cash register. However, the system of Patent Document 1 requires that products be placed in the shopping cart only from a fixed location in order to ensure that the products are photographed. This requires extensive modification of conventional shopping carts. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide a product registration support device, a product registration support system, and a program that enable customers to register products by themselves without making major modifications to conventional shopping carts. [Means for solving the problem]

[0005] A product registration support device according to an embodiment supports the operation of a product registration device that registers products by reading information that uniquely identifies a product to be purchased, and includes an image acquisition unit, a counting unit, a product number acquisition unit, and a product number comparison information output unit. The image acquisition unit acquires a video of the product being put into the storage unit, captured by a camera that captures the storage unit that stores the product whose information has been read, and an identification number that identifies the storage unit. The counting unit counts a first number, which is the number of products put into the storage unit, from the video acquired by the image acquisition unit. The product number acquisition unit acquires a second number, which is the number of products read by the product registration device until registration is completed. The product number comparison information output unit outputs the identification number, the first number, and the second number to be notified to a terminal device, on condition that the first number and the second number do not match. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a block diagram illustrating an example of a schematic configuration of a product sales data processing system according to an embodiment. [Diagram 2] FIG. 2 is a hardware block diagram showing an example of a hardware configuration of the cart terminal. [Diagram 3] FIG. 3 is a diagram illustrating an example of a data structure of the product master. [Figure 4] FIG. 4 is a diagram illustrating an example of a data structure of the product registration file. [Diagram 5] FIG. 5 is a hardware block diagram illustrating an example of a hardware configuration of the edge gateway. [Figure 6] FIG. 6 is a diagram illustrating an example of the data structure of the product count file. [Figure 7] FIG. 7 is a hardware block diagram illustrating an example of a hardware configuration of a mobile terminal. [Figure 8] FIG. 8 is a hardware block diagram showing an example of the hardware configuration of a payment machine. [Figure 9] FIG. 9 is a functional block diagram illustrating an example of a functional configuration of the cart terminal. [Figure 10]FIG. 10 is a functional block diagram illustrating an example of a functional configuration of the edge gateway. [Figure 11] FIG. 11 is a functional block diagram illustrating an example of a functional configuration of a mobile terminal. [Figure 12] FIG. 12 is a functional block diagram showing an example of the functional configuration of a payment machine. [Figure 13] FIG. 13 is a flowchart showing an example of the flow of processing performed by the cart terminal. [Figure 14] FIG. 14 is a flowchart illustrating an example of the flow of a process performed by the edge gateway. [Figure 15] FIG. 15 is a flowchart showing an example of the flow of processing performed by the mobile terminal. [Figure 16] FIG. 16 is a flow chart showing an example of the flow of processing performed by the payment machine. [Figure 17] FIG. 17 is a schematic perspective view of a self-service POS terminal included in the merchandise sales data processing system of the second embodiment. [Figure 18] FIG. 18 is a hardware block diagram showing an example of a hardware configuration of the self-checkout POS terminal. [Figure 19] FIG. 19 is a functional block diagram illustrating an example of a functional configuration of the self-checkout POS terminal. [Figure 20] FIG. 20 is a flowchart showing an example of the flow of processing performed by the self-checkout POS terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments described below.

[0008] (First embodiment) Hereinafter, a product sales data processing system 1 according to a first embodiment of the present disclosure will be described with reference to the drawings.

[0009] (Outline of product sales data processing system) 1 is a block diagram showing an example of a schematic configuration of a product sales data processing system according to an embodiment. The product sales data processing system 1 is a system that supports customers in shopping at a store.

[0010] The product sales data processing system 1 includes a shopping cart 5, an edge gateway 20, a store server 30, a mobile terminal 40, and a payment machine 50.

[0011] While a customer is pushing the shopping cart 5, the identification information (e.g., product code) that identifies the product to be purchased is read, and the product whose identification information has been read is stored in the shopping cart 5. The shopping cart 5 includes a basket 7, a cart terminal 10, a scanner 18, and a camera 19.

[0012] The basket 7 receives products to be purchased by customers and stores the products. The basket 7 is an example of a storage section in the present disclosure. Since there are multiple shopping carts 5 in the store, each shopping cart 5 is assigned an identification number that uniquely identifies the basket 7 of that shopping cart 5. This identification number will be referred to as a cart ID hereinafter.

[0013] The cart terminal 10 registers the product whose identification information has been read. The cart terminal 10 also transmits the product registration results to an edge gateway 20 or a store server 30, which will be described later, via access points 8, which are wireless communication repeaters installed in the store, and an in-store network N. The cart terminal 10 is an example of a product registration device in the present disclosure.

[0014] The scanner 18 reads a code symbol, such as a barcode, attached to a product, and obtains the product's identification information (for example, a product code) registered in the code symbol.

[0015] Camera 19 is installed on shopping cart 5 so as to be able to capture an image of basket 7 in its entirety, and captures images of products being placed into basket 7 until the customer has had the code symbols of all the products he wishes to purchase read. Camera 19 also associates the captured images with a cart ID that identifies shopping cart 5 in which camera 19 is installed, and transmits the images to edge gateway 20 (described below) via access point 8 and in-store network N. Note that if shopping cart 5 has two baskets, one above the other, camera 19 is provided in each of the upper and lower baskets.

[0016] The edge gateway 20 collects the video captured by the camera 19 via an interface such as a serial number, USB, or wireless / wired LAN. The edge gateway 20 also acquires the product registration results from the cart terminal 10. The edge gateway 20 then analyzes the acquired video and counts the number of products added to the basket 7. At this time, the edge gateway 20 recognizes the positions of the customer's arms and hands, for example, by performing image processing such as well-known skeletal structure estimation. Furthermore, by recognizing that the customer's hand is above the basket 7 and that an object has been removed from the hand (released), the edge gateway 20 detects that the customer has added products to the basket 7 of the shopping cart 5 and the number of products added. The edge gateway 20 also compares the counted number of products (first number) with the number of products in the product registration results (second number). When the first and second quantities do not match, the edge gateway 20 notifies the mobile terminal 40, which will be described later, of the cart ID and that the first and second quantities do not match. Note that the edge gateway 20 is an example of a product registration support device in the present disclosure.

[0017] The store server 30 manages all product transactions in the store. For example, the store server 30 transmits to the cart terminal 10 the contents of a product master, which is a master file that registers product information on handled products and is updated sequentially. The store server 30 also acquires product registration results from the cart terminal 10 and issues a transaction ID that uniquely identifies a transaction. The store server 30 notifies the cart terminal of the issued transaction ID. That is, the transaction ID has a one-to-one correspondence with the product registration results transmitted from the cart terminal 10. Furthermore, when a customer makes a transaction at a payment machine 50 (described below), the store server 30 receives the transaction ID transmitted from the payment machine 50 and notifies the payment machine 50 of the product registration results corresponding to that transaction ID.

[0018] The mobile terminal 40 is carried by a store clerk and exchanges various information with the store server 30 or between the mobile terminals 40. The mobile terminal 40 is, for example, a smartphone or a tablet terminal. The mobile terminal 40 also acquires information related to the customer's product registration results, such as a cart ID and information indicating that the first and second quantities do not match, from the edge gateway 20. If the first and second quantities do not match, the mobile terminal 40 notifies the clerk. The clerk who notices the notification goes to the shopping cart 5 having the corresponding cart ID, explains the situation to the customer, and checks the products put into the basket 7. The mobile terminal 40 is an example of a terminal device in the present disclosure.

[0019] The payment machine 50 is a device where a customer who has completed product registration makes a payment (settlement). The payment machine 50 reads the transaction ID from the cart terminal 10 and notifies the store server 30 of the read transaction ID. The payment machine 50 then obtains the product registration results corresponding to the transaction ID from the store server 30. The payment machine 50 then performs payment processing using the payment method specified by the customer. Note that to make payment processing more efficient, multiple payment machines 50 may be installed in a store.

[0020] (Cart terminal hardware configuration) The hardware configuration of the cart terminal 10 will be described with reference to Fig. 2. Fig. 2 is a hardware block diagram showing an example of the hardware configuration of the cart terminal.

[0021] The cart terminal 10 includes a control unit 11, a storage unit 12, a peripheral device controller 13, and a communication I / F (interface) 14.

[0022] The control unit 11 controls the overall operation of the cart terminal 10. The control unit 11 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. The CPU 111 is connected to the ROM 112 and the RAM 113 via internal buses such as an address bus and a data bus. The CPU 111 loads various programs stored in the ROM 112 and the storage unit 12 into the RAM 113. The CPU 111 controls the operation of the cart terminal 10 by operating in accordance with the various programs loaded into the RAM 113. In other words, the control unit 11 has the configuration of a typical computer.

[0023] The storage unit 12 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that is connected to the control unit 11 via an internal bus 15. The storage unit 12 may also be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The storage unit 12 stores a control program 121, a product master 122, a product registration file 123, and a cart ID 124.

[0024] The control program 121 is a program that controls the overall operation of the cart terminal 10. The control program 121 may be provided in a state stored in the storage unit 12, or may be provided by recording it in an installable or executable file format on a non-transitory computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD. The control program 121 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 121 may be provided or distributed via a network such as the Internet.

[0025] The product master 122 is a master file that stores product codes that uniquely identify products sold in a store and product information of the products in association with each other. The data structure of the product master 122 will be described in detail later (see FIG. 3).

[0026] The product registration file 123 is a file that stores the product code of the product whose code symbol the customer has had the scanner 18 read, that is, the product code of the product that the customer plans to purchase. The data structure of the product registration file 123 will be described in detail later (see FIG. 4).

[0027] The control unit 11 is connected to a display device 16 , an operation device 17 , a scanner 18 , and a camera 19 via a peripheral device controller 13 connected by an internal bus 15 .

[0028] The display device 16 is a display device such as a liquid crystal monitor or an organic EL monitor provided in the cart terminal 10. The display device 16 displays a product list read by the scanner 18, etc.

[0029] The operation device 17 is an information input device such as a touch panel that is layered on the display device 16. When a customer starts shopping, the customer instructs the cart terminal 10 to start shopping by pressing an operation button such as a start shopping button displayed on the display device 16. After the customer has completed registration of all products to be purchased, the customer notifies the cart terminal 10 that product registration is complete by pressing an operation button such as a checkout button displayed on the display device 16.

[0030] The scanner 18 reads a code symbol such as a barcode held over a reading window. The scanner 18 is, for example, a barcode reader. The scanner 18 decodes the read code symbol and outputs a registered product code.

[0031] Camera 19 is an imaging device equipped with an imaging device such as a CCD or CMOS, and is installed so as to capture an image of the entire car 7. Camera 19 starts capturing images upon receiving an instruction to start capturing images from control unit 11, and ends capturing images upon receiving an instruction to end capturing images from control unit 11. Camera 19 captures images of car 7 at a speed of, for example, 30 frames per second. Camera 19 outputs the captured images to edge gateway 20.

[0032] The communication I / F 14 enables wireless communication between the cart terminal 10 and the edge gateway 20 or the store server 30.

[0033] (Product master data structure) The data structure of the product master 122 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the data structure of the product master.

[0034] The product master 122 stores the product name and price, which are product information of the product, in association with a product code that uniquely identifies the product. The product information may also include other information, such as sale information.

[0035] (Product registration file data structure) The data structure of the product registration file 123 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the data structure of the product registration file.

[0036] The product registration file 123 stores the product code, unit price, quantity, and price (excluding tax) of each registered product. The product registration file 123 also stores the transaction ID, cart ID, total quantity of products, and total price.

[0037] The transaction ID is an identification number that uniquely identifies a transaction. The transaction ID is issued by the store server 3 that has acquired the product registration file 123, and is therefore blank when the cart terminal 10 generates the product registration file 123. The transaction ID field stores the transaction ID that the cart terminal 10 has received from the store server 3.

[0038] The cart ID is an identification number that identifies the shopping cart 5 in which the cart terminal 10 that has performed the product registration is placed. The cart ID is the cart ID 124 stored in the storage unit 12 of the cart terminal 10 (see FIG. 2).

[0039] The total number of items is the sum of the numbers of each item.

[0040] The total amount is the sum of the prices (excluding tax) of each product. Alternatively, the total amount may be the sum of the prices (excluding tax) of each product and the amount of consumption tax.

[0041] (Edge Gateway Hardware Configuration) The hardware configuration of the edge gateway 20 will be described with reference to Fig. 5. Fig. 5 is a hardware block diagram showing an example of the hardware configuration of the edge gateway.

[0042] The edge gateway 20 includes a control unit 21, a storage unit 22, and a communication I / F 23.

[0043] The control unit 21 controls the overall operation of the edge gateway 20. The control unit 21 includes a CPU 211, a ROM 212, and a RAM 213. The CPU 211 is connected to the ROM 212 and the RAM 213 via internal buses such as an address bus and a data bus. The CPU 211 loads various programs stored in the ROM 212 and the storage unit 22 into the RAM 213. The CPU 211 controls the operation of the edge gateway 20 by operating in accordance with the various programs loaded into the RAM 213. In other words, the control unit 21 has the configuration of a general computer.

[0044] The storage unit 22 is a storage device such as an HDD or SSD that is connected to the control unit 11 via an internal bus 24. The storage unit 22 may also be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The storage unit 22 stores a control program 221 and a product counting file 222.

[0045] The control program 221 is a program that controls the overall operation of the edge gateway 20. The control program 221 may be provided in a state stored in the storage unit 12, or may be provided by being recorded in an installable or executable file format on a non-transitory computer-readable recording medium such as a CD-ROM, a flexible disk, a CD-R, or a DVD. The control program 221 may also be provided by being stored on a computer connected to a network and downloaded via the network. Furthermore, the control program 221 may be provided or distributed via a network such as the Internet.

[0046] The product count file 222 is a file that registers the date and time of shopping and the number of products added to the basket 7 of the shopping cart 5 for each cart ID of the shopping cart 5. The data structure of the product count file 222 will be described in detail later (see FIG. 6).

[0047] The communication I / F 23 enables wireless communication between the edge gateway 20 and the store server 30, the cart terminal 10, the mobile terminal 40, and the payment machine 50.

[0048] (Product count file data structure) The data structure of the product counting file 222 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the data structure of the product counting file.

[0049] The product count file 222 stores the date and time and the number of products inserted in association with the cart ID.

[0050] The cart ID is identification information of the shopping cart 5 that is transmitted in association with the image captured by the camera 19 .

[0051] The date and time is, for example, the date and time when the camera 19 starts capturing images. Note that the date and time may further include the date and time when the camera 19 ends capturing images.

[0052] The number of put-in products is the number of products (first number) counted by the edge gateway 20 from the image captured by the camera 19 installed in the shopping cart 5 of the cart ID.

[0053] (Mobile device hardware configuration) The hardware of the mobile terminal 40 will be described with reference to Fig. 7. Fig. 7 is a hardware block diagram showing an example of the hardware configuration of the mobile terminal.

[0054] The mobile terminal 40 includes a control unit 41, a storage unit 42, a peripheral device controller 43, and a communication I / F 23.

[0055] The control unit 41 controls the overall operation of the mobile terminal 40. The control unit 41 includes a CPU 411, a ROM 412, and a RAM 413. The CPU 411 is connected to the ROM 412 and the RAM 413 via internal buses such as an address bus and a data bus. The CPU 411 loads various programs stored in the ROM 412 and the storage unit 42 into the RAM 413. The CPU 411 controls the operation of the mobile terminal 40 by operating according to the various programs loaded into the RAM 413. That is, the control unit 41 has the configuration of a general computer.

[0056] The storage unit 42 is a storage device such as an HDD or SSD that is connected to the control unit 41 via an internal bus 45. The storage unit 42 may also be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The storage unit 42 stores a control program 421.

[0057] The control program 421 is a program that controls the overall operation of the mobile terminal 40. The control program 421 may be provided in a state stored in the storage unit 42, or may be provided by recording it in an installable or executable file format on a non-transitory computer-readable recording medium such as a CD-ROM, a flexible disk, a CD-R, or a DVD. The control program 421 may be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 421 may be provided or distributed via a network such as the Internet.

[0058] The control unit 41 is connected to a display device 46 , an operation device 47 , and a speaker 48 via a peripheral device controller 43 connected by an internal bus 45 .

[0059] The display device 46 is a display device such as a liquid crystal monitor or an organic EL monitor provided in the mobile terminal 40. The display device 46 displays various information transmitted from the store server 30 and the edge gateway 20.

[0060] The operation device 47 is an information input device such as a touch panel that is stacked on the display device 46. A store clerk carrying a mobile terminal 40 operates the operation device 47 to, for example, check information sent from the store server 30 or the edge gateway 20, exchange information with other store clerks, and the like.

[0061] The communication I / F 44 enables wireless communication between the mobile terminal 40 and the edge gateway 20 or the store server 30.

[0062] (Accounting machine hardware configuration) The hardware of the payment machine 50 will be described with reference to Fig. 8. Fig. 8 is a hardware block diagram showing an example of the hardware configuration of the payment machine.

[0063] The payment machine 50 comprises a control unit 51, a memory unit 52, a peripheral device controller 53, and a communication I / F 54.

[0064] The control unit 51 controls the overall operation of the payment machine 50. The control unit 51 includes a CPU 511, a ROM 512, and a RAM 513. The CPU 511 is connected to the ROM 512 and the RAM 513 via internal buses such as an address bus and a data bus. The CPU 511 loads various programs stored in the ROM 512 and the storage unit 52 into the RAM 513. The CPU 511 controls the operation of the payment machine 50 by operating in accordance with the various programs loaded into the RAM 513. In other words, the control unit 51 has the configuration of a typical computer.

[0065] The storage unit 52 is a storage device such as an HDD or SSD that is connected to the control unit 51 via an internal bus 55. The storage unit 52 may also be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The storage unit 52 stores a control program 521 and a payment file 522.

[0066] The control program 521 is a program that controls the overall operation of the accounting machine 50. The control program 521 may be provided in a state stored in the storage unit 52, or may be provided by recording it in an installable or executable file format on a non-transitory computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD. The control program 521 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 521 may be provided or distributed via a network such as the Internet.

[0067] The payment file 522 is a file that adds payment details such as the payment date and time, payment method, transaction amount, etc. to the contents of the product registration file 123. The payment file 522 is sent to the store server 30 at a predetermined timing together with an identification number that uniquely identifies the accounting machine 50, and is stored and managed as a sales file in the store server 30.

[0068] The control unit 51 is connected to a display device 56 , an operation device 57 , a scanner 58 , a receipt printer 59 , and a warning light 60 via a peripheral device controller 53 connected by an internal bus 55 .

[0069] The display device 56 is a display device such as a liquid crystal monitor or an organic electroluminescence monitor provided in the payment machine 50. The display device 56 displays various information related to the payment process.

[0070] The scanner 58 is, for example, a hand scanner, and reads the code symbol including the transaction ID displayed on the display device 16 of the cart terminal 10 .

[0071] The receipt printer 59 issues a receipt on which the details of the transaction are printed.

[0072] The warning light 60 lights up or flashes in response to a customer's operation when assistance from a store clerk is required. When a store clerk notices that the warning light 60 is on or flashing, the store clerk rushes to the payment machine 50 to assist the customer. Note that instead of turning on or flashing the warning light 60, the payment machine 50 may send a signal requesting assistance to the mobile terminal 40 carried by the store clerk.

[0073] Although not shown in Fig. 8, the accounting machine 50 also includes a change machine and a card reader. When a customer makes a cash payment, the change machine accepts payment of bills or coins and dispenses bills or coins as change. When a customer makes a cashless payment, the card reader reads information registered on a medium such as a credit card or electronic money card.

[0074] The communication I / F 54 enables wireless communication between the payment device 50 and the edge gateway 20 or the store server 30.

[0075] (Functional configuration of cart terminal) The functional configuration of the cart terminal 10 will be described with reference to Fig. 9. Fig. 9 is a functional block diagram showing an example of the functional configuration of the cart terminal.

[0076] The control unit 11 of the cart terminal 10, by the CPU 111 operating in accordance with the control program 121 stored in the storage unit 12, functions as a product registration start instruction acquisition unit 61, a photography control unit 62, a video output unit 63, a product code acquisition unit 64, a product registration unit 65, a product registration completion instruction acquisition unit 66, a product registration information output unit 67, a transaction ID acquisition unit 68, a payment instruction acquisition unit 69, and a transaction ID display unit 70. All or part of these functions may be configured as hardware such as a dedicated circuit.

[0077] The product registration start instruction acquiring unit 61 detects, by the operation device 17, that a shopping start button displayed on the display device 16 has been pressed, and thereby acquires an instruction that product registration has started.

[0078] The shooting control unit 62 instructs the camera 19 to start and end shooting.

[0079] The video output unit 63 associates the video captured by the camera 19 with the cart ID 124 and outputs the video to the edge gateway 20.

[0080] The product code acquisition unit 64 reads a code symbol, such as a barcode, attached to a product held over the scanner 18, and acquires the product code registered in the code symbol.

[0081] The product registration unit 65 registers the product having the product code acquired by the product code acquisition unit 64 in the product registration file 123 .

[0082] The product registration completion instruction acquisition unit 66 acquires an instruction that product registration has been completed by detecting with the operation device 17, for example, the pressing of a checkout button displayed on the display device 16, which indicates that product registration has been completed.

[0083] The product registration information output unit 67 outputs the product registration file 123 to the edge gateway 20 .

[0084] The transaction ID acquisition unit 68 acquires the transaction ID that the store server 30 has assigned to the product registration file 123 from the edge gateway 20. The transaction ID acquisition unit 68 may acquire the transaction ID from the store server 30.

[0085] The payment instruction acquisition unit 69 acquires a payment start instruction by detecting with the operation device 17 that a payment button displayed on the display device 16, for example, that is pressed, instructing the start of payment.

[0086] The transaction ID display unit 70 displays a code symbol, such as a barcode, including the transaction ID on the display device 16 in a form that can be read by the scanner 58 of the accounting machine 50 .

[0087] (Edge Gateway Functional Configuration) The functional configuration of the edge gateway 20 will be described with reference to Fig. 10. Fig. 10 is a functional block diagram showing an example of the functional configuration of the edge gateway.

[0088] The control unit 21 of the edge gateway 20 functions as a video acquisition unit 71, a product counting unit 72, a product registration information acquisition unit 73, a product number comparison unit 74, a product registration information output unit 75, a transaction ID acquisition unit 76, a transaction ID output unit 77, and a product number comparison information output unit 78, as a result of the CPU 211 operating in accordance with the control program 221 stored in the storage unit 22. Note that all or part of these functions may be configured using hardware such as a dedicated circuit.

[0089] The image acquisition unit 71 acquires from the cart terminal 10 an image of products being put into the basket 7 of the shopping cart 5 captured by the camera 19 capturing an image of the basket 7, and a cart ID for identifying the shopping cart 5.

[0090] The product counting unit 72 counts a first number, which is the number of products added to the basket 7, from the image acquired by the image acquisition unit 71. The product counting unit is an example of a counting unit in the present disclosure. The product counting unit 72 recognizes the positions of the customer's arms and hands, for example, by performing image processing such as well-known skeletal estimation. Furthermore, by recognizing that the customer's hand is above the basket 7 and an object has been removed from the hand (disengaged), it is determined that the customer has added products to the basket 7. Then, the product counting unit 72 counts the number of products added to the basket 7. Alternatively, the product counting unit 72 may acquire an image of the inside of the basket 7 captured by the camera 19, and recognize the number of products inside the basket 7 using object recognition technology.

[0091] The product registration information acquisition unit 73 acquires a second number, which is the number of products read by the scanner 18 of the cart terminal 10 until registration is completed. More specifically, the product registration information acquisition unit 73 acquires the product registration file 123 from the cart terminal 10. The product registration information acquisition unit 73 is an example of a product number acquisition unit in the present disclosure.

[0092] The product number comparison unit 74 compares the first number counted by the product counting unit 72 with a second number, which is the number of products registered in the product registration file 123.

[0093] The product registration information output unit 75 outputs the identification number of the shopping cart 5 (basket 7) and the first and second quantities to be notified to a mobile terminal 40 carried by a store clerk, provided that the first and second quantities do not match.

[0094] The transaction ID acquisition unit 76 acquires from the store server 30 the transaction ID that the store server 30 has assigned to the product registration file 123 that the edge gateway 20 has output to the store server 30 .

[0095] The transaction ID output unit 77 outputs the transaction ID acquired from the store server 30 to the corresponding cart terminal 10.

[0096] Provided that the first and second quantities do not match, the product quantity comparison information output unit 78 outputs the cart ID that identifies the shopping cart 5, the first quantity, and the second quantity to the mobile terminal 40 carried by the store clerk for notification. The product quantity comparison information output unit 78 may also output the cart ID, the first quantity, and the product registration file 123 to the mobile terminal 40. The product quantity comparison information output unit 78 outputs this information to all mobile terminals 40.

[0097] (Functional configuration of mobile terminal) The functional configuration of the mobile terminal 40 will be described with reference to Fig. 11. Fig. 11 is a functional block diagram showing an example of the functional configuration of the mobile terminal.

[0098] The control unit 41 of the mobile terminal 40 functions as a product quantity comparison information acquisition unit 81, a notification control unit 82, and a product quantity comparison information display unit 83 by the CPU 411 operating in accordance with the control program 421 stored in the storage unit 42. Note that all or part of these functions may be configured with hardware such as a dedicated circuit.

[0099] The product quantity comparison information acquisition unit 81 acquires a cart ID for identifying the shopping cart 5, the first quantity, and the second quantity from the edge gateway 20. The product quantity comparison information acquisition unit 81 may acquire the cart ID, the first quantity, and the product registration file 123 from the edge gateway 20. Note that the product quantity comparison information acquisition unit 81 acquires this information only when the first quantity and the second quantity do not match.

[0100] The notification control unit 82 issues a notification on the condition that the product quantity comparison information acquisition unit 81 acquires the cart ID, the first quantity, and the second quantity from the edge gateway 20. The method of notification is not limited, and may be, for example, an alarm sound output from the speaker 48 of the mobile terminal 40. Alternatively, the mobile terminal 40 may vibrate a vibrator (not shown) that it is equipped with.

[0101] The product quantity comparison information display unit 83 displays the information acquired by the product quantity comparison information acquisition unit 81 on the display device 46 included in the mobile terminal 40.

[0102] (Functional configuration of accounting machine) The functional configuration of the payment machine 50 will be described with reference to Fig. 12. Fig. 12 is a functional block diagram showing an example of the functional configuration of the payment machine.

[0103] The control unit 51 of the payment machine 50 functions as a transaction ID acquisition unit 91, a product registration information acquisition unit 92, a payment method acquisition unit 93, a payment processing unit 94, a payment completion information display unit 95, and a receipt issuing unit 96, as a result of the CPU 511 operating in accordance with the control program 521 stored in the storage unit 52. Note that all or part of these functions may be configured as hardware, such as a dedicated circuit.

[0104] The transaction ID acquisition unit 91 acquires the transaction ID by reading a code symbol including the transaction ID displayed on the display device 16 of the cart terminal 10 with the scanner 58 provided in the payment device 50.

[0105] The product registration information acquisition unit 92 outputs the transaction ID acquired by the transaction ID acquisition unit 91 to the store server 30, and acquires from the store server 30 a product registration file corresponding to the transaction ID.

[0106] The payment method acquisition unit 93 acquires the payment method designated by the customer by detecting with the operation device 57 whether any of the selection buttons for selecting a payment method displayed on the display device 56 of the accounting machine 50 has been pressed.

[0107] The payment processing unit 94 performs payment using the payment method acquired by the payment method acquisition unit 93. If cash payment is selected, the payment processing unit 94 receives cash using a change dispenser provided in the accounting machine 50. If cashless payment is selected, the payment processing unit 94 reads the customer's registered credit card information and the charge amount of the customer's electronic money card using a card reader provided in the accounting machine 50 according to the payment method, and has an external server (not shown) that performs payment processing perform the payment.

[0108] The payment completion information display unit 95 displays information indicating that payment has been completed and the transaction details on the display device 56 of the payment device 50.

[0109] The receipt issuing unit 96 issues a receipt on which the details of the payment are printed from the receipt printer 59 provided in the accounting device 50.

[0110] (Store server hardware and function configuration) Although the hardware configuration and functional configuration of the store server 30 are not illustrated, the store server 30, like the edge gateway 20, has a general computer configuration.

[0111] The store server 30 transmits the product master, which is updated as needed, to the cart terminal 10. The store server 30 also acquires the product registration file 123 from the cart terminal 10, issues a transaction ID, and notifies the cart terminal 10 of the issued transaction ID. The store server 30 issues a transaction ID only when the number of products counted by the edge gateway 20 (first number) matches the number of products registered in the product registration file 123 (second number). Therefore, the edge gateway 20 may output the product registration file 123 acquired from the cart terminal 10 to the store server 30 only when it determines that the first number and the second number are equal.

[0112] The store server 30 issues a transaction ID that uniquely identifies the product registration file 123 to the product registration file 123 and associates the transaction ID with the product registration file 123.

[0113] (Processing flow performed by the cart terminal) The flow of processing performed by the cart terminal 10 will be described with reference to Fig. 13. Fig. 13 is a flow chart showing an example of the flow of processing performed by the cart terminal.

[0114] The product registration start instruction acquiring unit 61 acquires an instruction that product registration has started by detecting, via the operation device 17, that a shopping start button displayed on the display device 16 has been pressed (step S11).

[0115] The shooting control unit 62 causes the camera 19 to start shooting an image (step S12).

[0116] The video output unit 63 associates the video captured by the camera 19 with the cart ID 124 and outputs the video to the edge gateway 20 (step S13).

[0117] The product code acquisition unit 64 determines whether a product code has been acquired from the code symbol read by the scanner 18 (step S14). If it is determined that the product code has been acquired (step S14: Yes), the process proceeds to step S15. On the other hand, if it is determined that the product code has not been acquired (step S14: No), the process returns to step S13.

[0118] If it is determined in step S14 that the product code has been acquired, the product registration unit 65 registers the product having the product code acquired by the product code acquisition unit 64 in the product registration file 123 (step S15).

[0119] The product registration completion instruction acquisition unit 66 determines whether there is an instruction to the effect that product registration is complete (step S16). If it is determined that there is an instruction to the effect that product registration is complete (step S16: Yes), the process proceeds to step S17. On the other hand, if it is not determined that there is an instruction to the effect that product registration is complete (step S16: No), the process returns to step S13. The product registration completion instruction acquisition unit 66 determines that there is an instruction to the effect that product registration is complete by detecting, via the operation device 17, that the checkout button displayed on the display device 16 has been pressed.

[0120] If it is determined in step S16 that an instruction to the effect that product registration is complete has been given, the photography control unit 62 instructs the camera 19 to end photography (step S17). At this time, the video output unit 63 ends output of video to the edge gateway 20, although this is not shown in the flowchart of FIG.

[0121] The product registration information output unit 67 outputs the product registration file 123 to the edge gateway 20 (step S18).

[0122] The transaction ID acquisition unit 68 determines whether the transaction ID assigned to the product registration file 123 by the store server 30 has been acquired from the edge gateway 20 (step S19). If it is determined that the transaction ID has been acquired (step S19: Yes), the process proceeds to step S20. On the other hand, if it is determined that the transaction ID has not been acquired (step S19: No), the cart terminal 10 ends the process. The transaction ID acquisition unit 68 may acquire the transaction ID from the store server 30.

[0123] When it is determined in step S19 that the transaction ID has been acquired, the payment instruction acquisition unit 69 determines whether an instruction to start payment has been acquired from the customer (step S20). If it is determined that an instruction to start payment has been acquired from the customer (step S20: Yes), the process proceeds to step S21. On the other hand, if it is not determined that an instruction to start payment has been acquired from the customer (step S20: No), step S20 is repeated. The payment instruction acquisition unit 69 determines that an instruction to start payment has been received by detecting, via the operation device 17, for example, that a payment button displayed on the display device 16 has been pressed.

[0124] When it is determined in step S20 that a payment start instruction has been received from the customer, the transaction ID display unit 70 displays a code symbol, such as a barcode, including the transaction ID on the display device 16 in a form that can be read by the scanner 58 of the payment machine 50 (step S21). After that, the cart terminal 10 ends the process.

[0125] (Processing flow performed by edge gateway) The flow of processing performed by the edge gateway 20 will be described with reference to Fig. 14. Fig. 14 is a flowchart showing an example of the flow of processing performed by the edge gateway.

[0126] The video acquisition unit 71 acquires the video captured by the camera 19 and the cart ID 124 from the cart terminal 10 (step S31).

[0127] The product counting unit 72 analyzes the image acquired by the image acquisition unit 71 and determines whether a product has been added to the basket 7 (step S32). If it is determined that a product has been added to the basket 7 (step S32: Yes), the process proceeds to step S33. On the other hand, if it is not determined that a product has been added to the basket 7 (step S32: No), the process returns to step S31. The product counting unit 72 determines whether a product has been added to the basket 7 by, for example, recognizing that an object has left the customer's arm or hand detected by skeletal detection and is moving toward the basket 7.

[0128] When it is determined in step S32 that the product has been added to the basket 7, the product counting unit 72 adds the number of products added to the basket 7 of the corresponding cart ID (step S33).

[0129] The product registration information acquisition unit 73 determines whether the product registration file 123 has been acquired from the cart terminal 10 installed in the shopping cart 5 with the corresponding cart ID (step S34). If it is determined that the product registration file 123 has been acquired (step S34: Yes), the process proceeds to step S35. On the other hand, if it is not determined that the product registration file 123 has been acquired (step S34: No), the process returns to step S31.

[0130] When it is determined in step S34 that the product registration file 123 has been acquired, the product number comparison unit 74 determines whether the number of products counted by the product counting unit 72 (the number of products added to the basket 7) is equal to the number of products registered in the product registration file 123 (step S35). If it is determined that the two are equal (step S35: Yes), the process proceeds to step S36. On the other hand, if it is not determined that the two are equal (step S35: No), the process proceeds to step S39.

[0131] If it is determined in step S35 that the number of products put into the basket 7 is equal to the number of products registered in the product registration file 123, the product registration information output unit 75 outputs the product registration file 123 to the store server 30 (step S36).

[0132] The transaction ID acquisition unit 76 acquires from the store server 30 the transaction ID that the store server 30 assigned to the product registration file 123 output in step S36 (step S37).

[0133] The transaction ID output unit 77 outputs the transaction ID acquired by the transaction ID acquisition unit 76 in step S37 to the cart terminal 10 (step S38). After that, the edge gateway 20 ends the process.

[0134] Returning to step S35, if it is not determined in step S35 that the number of products added to the basket 7 is equal to the number of products registered in the product registration file 123, the product number comparison information output unit 78 outputs the cart ID and the product registration file 123 to the mobile terminal 40 (step S39). After that, the edge gateway 20 ends the process.

[0135] (Processing flow performed by mobile devices) The flow of processing performed by the mobile terminal 40 will be described with reference to Fig. 15. Fig. 15 is a flow chart showing an example of the flow of processing performed by the mobile terminal.

[0136] The product number comparison information acquisition unit 81 determines whether the product number comparison information output by the product number comparison information output unit 78 has been acquired from the edge gateway 20 (step S41). The product number comparison information is information including the cart ID, the first quantity, and the second quantity output by the edge gateway 20 on the condition that the first quantity and the second quantity do not match. If it is determined that the product number comparison information has been acquired (step S41: Yes), the process proceeds to step S42. On the other hand, if it is not determined that the product number comparison information has been acquired (step S41: No), step S41 is repeated.

[0137] When it is determined in step S41 that the product quantity comparison information has been acquired, the notification control unit 82 performs notification by outputting a sound or voice from the speaker 48 included in the mobile terminal 40 (step S42).

[0138] The product quantity comparison information display unit 83 displays the information acquired by the product quantity comparison information acquisition unit 81 on the display device 46 included in the mobile terminal 40 (Step S43). After that, the mobile terminal 40 ends the process.

[0139] Among the store clerks carrying the mobile terminal 40 that has received the notification, the store clerk who can rush to the location of the shopping cart 5 with the notified cart ID heads to the location of the shopping cart 5, gets the customer's consent to confirm the products, and confirms whether the products put in the basket 7 match the registered products.

[0140] (Processing flow of accounting machine) The flow of processing performed by the payment machine 50 will be described with reference to Figure 16. Figure 16 is a flow chart showing an example of the flow of processing performed by the payment machine.

[0141] The transaction ID acquisition unit 91 acquires the transaction ID by reading a code symbol including the transaction ID displayed on the display device 16 of the cart terminal 10 with the scanner 58 provided in the payment machine 50 (step S51).

[0142] The product registration information acquisition unit 92 outputs the transaction ID acquired by the transaction ID acquisition unit 91 to the store server 30 (step S52).

[0143] The product registration information acquisition unit 92 acquires the product registration file 123 corresponding to the transaction ID from the store server 30 (step S53).

[0144] The payment method acquisition unit 93 acquires the payment method specified by the customer by detecting with the operation device 57 whether any of the selection buttons for selecting a payment method displayed on the display device 56 of the payment machine 50 has been pressed (step S54).

[0145] The payment processing unit 94 performs payment processing according to the payment method acquired in step S54 (step S55).

[0146] The payment completion information display unit 95 displays information indicating that the payment has been completed and the transaction details on the display device 56 of the payment machine 50 (step S56).

[0147] The receipt issuing unit 96 issues a receipt with the payment details printed on it from the receipt printer 59 provided in the payment machine 50 (step S57). The payment machine 50 then ends the process.

[0148] Although not shown in the flowchart of FIG. 16, after the payment process is completed, the payment device 50 generates a payment file 522 indicating the details of the payment and outputs it to the store server 30.

[0149] (Effects of the first embodiment) As described above, the edge gateway 20 (product registration support device) included in the product sales data processing system 1 of the first embodiment supports the operation of the cart terminal 10 (product registration device) that registers products by reading information that uniquely identifies the product to be purchased. The edge gateway 20 includes an image acquisition unit 71 that acquires an image of the product being put into the basket 7 and an identification number that identifies the basket 7, the image acquisition unit 71 being photographed by a camera 19 (photographing device) that photographs the basket 7 (container) that contains the product whose information has been read. The shopping cart terminal 10 includes a product counting unit 72 (counting unit) that counts a first number, which is the number of products put into the basket 7, from the video captured by the shopping cart terminal 10, a product registration information acquisition unit 73 (product number acquisition unit) that acquires a second number, which is the number of products read by the scanner 18 until registration is completed, and a product number comparison information output unit 78 that outputs an identification number for identifying the basket 7, the first number, and the second number to be notified to a mobile terminal 40 (terminal device) carried by a store clerk, on the condition that the first number and the second number do not match. Therefore, a customer can register products by himself / herself without making a major modification to a conventional shopping cart. Furthermore, since the manner in which a customer puts products into the basket 7 of the shopping cart 5 is monitored and the number of products put into the basket 7 is counted, it is possible to reliably detect and notify a fraudulent act of a customer putting products into the basket 7 without reading the code symbol with the scanner 18.

[0150] In the edge gateway 20 (product registration support device) included in the product sales data processing system 1 of the first embodiment, the video acquisition unit 71 acquires video captured by the camera 19 (imaging device) from when the cart terminal 10 (product registration device) is instructed to start product registration until when it is instructed to complete product registration. Therefore, it is possible to capture the entire process of a customer putting products into the basket 7 of the shopping cart 5.

[0151] In the product sales data processing system 1 of the first embodiment, if the first number and the second number do not match, the first number and the second number are notified to the mobile terminal 40 (terminal device) carried by the store clerk. Therefore, the store clerk can be informed without fail that the first number, which is the number of products that the customer puts into the basket 7 of the shopping cart 5, differs from the second number, which is the number of products read by the scanner 18 until the products are completed. This allows the store clerk near the shopping cart 5 to immediately rush to the shopping cart 5 and support the customer.

[0152] The product sales data processing system 1 of the first embodiment includes a scanner 18 that is installed in the shopping cart 5 and reads a code symbol that is attached to the product and includes an identification number of the product, and a camera 19 (imaging device) that is installed in the shopping cart 5 and captures an image of the product whose code symbol has been read being placed into the basket 7 (container) of the shopping cart 5, and obtains the image and the identification number of the shopping cart 5, counts a first number that is the number of products placed in the shopping cart 5, and obtains a second number that is the number of products read by the scanner 18 until registration is complete. The system includes an edge gateway 20 (product registration support device) that outputs the identification number of the shopping cart 5, the first number, and the second number on the condition that the first number and the second number do not match, a mobile terminal 40 (terminal device) carried by a store clerk that issues a notification on the condition that the identification number of the shopping cart 5, the first number, and the second number output by the edge gateway 20 are acquired, a cart terminal 10 (product registration device) that registers products scanned by a scanner 18, and an accounting machine 50 (accounting device) that performs a payment process for the products registered by the cart terminal 10. This allows customers to register products themselves without making significant modifications to conventional shopping carts. Furthermore, the system monitors the way in which customers put products into the basket 7 of the shopping cart 5 and counts the number of products put into the basket 7, thereby preventing fraudulent acts in which customers put products into the basket 7 without reading the code symbols with the scanner 18.

[0153] Second embodiment Next, a second embodiment of the present disclosure will be described. In the product sales data processing system 2 (not shown) according to the second embodiment of the present disclosure, the shopping cart 5 does not include the cart terminal 10, the scanner 18, and the camera 19 in the product sales data processing system 1 shown in Fig. 1. Also, the product sales data processing system 2 includes a self-service POS terminal 130 shown in Fig. 17 instead of the checkout machine 50 shown in Fig. 1.

[0154] A customer performs shopping by pushing a shopping cart 5 or carrying a basket (not shown) and putting items into the basket 7 of the shopping cart 5 or a basket that the customer is carrying. After completing their shopping, the customer registers the items they wish to purchase and pays for the purchase at the self-service POS terminal 130. In other words, the self-service POS terminal 130 has both the functions of the cart terminal 10 in the first embodiment and the functions of the payment machine 50.

[0155] A camera 189 (see FIG. 17), which will be described later, is installed in the self-service POS terminal 130. The camera 189 captures an image of a customer putting into a basket a commodity (i.e., a registered commodity) whose code symbol has been read by the scanner 184 (see FIG. 17).

[0156] The self POS terminal 130 transmits to the edge gateway 20 the image captured by the camera 189 and a product registration file that stores the product information registered in the self POS terminal 130.

[0157] The edge gateway 20 has the same functions as those described in the first embodiment. That is, the edge gateway 20 counts the number of products that the customer puts into the basket by analyzing the image captured by the camera 189. The edge gateway 20 also compares the number of products that the customer puts into the basket (i.e., the first number in the first embodiment) with the number of products registered in the product registration file (i.e., the second number in the first embodiment). Then, if the first number and the second number do not match, the edge gateway 20 transmits information indicating that to the self-service POS terminal 130.

[0158] When the self-service POS terminal 130 receives information indicating that the first quantity and the second quantity do not match from the edge gateway 20, the self-service POS terminal 130 notifies a store clerk near the self-service POS terminal 130 by turning on or blinking a warning light 190 (see FIG. 17) provided therein. The store clerk who notices the notification goes to the customer who is operating the self-service POS terminal 130, explains the situation to the customer, and checks the products, etc. The self-service POS terminal 130 is an example of a terminal device in the present disclosure.

[0159] (Outline of accounting machine configuration) A schematic configuration of the self-checkout POS terminal 130 will be described with reference to Fig. 17. Fig. 17 is a schematic perspective view of the self-checkout POS terminal included in the product sales data processing system of the second embodiment.

[0160] The self-service POS terminal 130 includes a display device 182, a scanner 184, and a hand scanner 185. An operation device 183 is laminated on the surface of the display device 182.

[0161] The display device 182 is, for example, a liquid crystal monitor or an organic electroluminescence monitor. The display device 182 displays various information related to product transactions to the customer. For example, the display device 182 displays registered product information by reading a code symbol attached to the product with the scanner 184 or the hand scanner 185. The display device 182 also displays an accounting screen (not shown) that displays the total price of the products, the deposit amount, the change amount, etc., and allows the customer to select a payment method.

[0162] The customer checks the information displayed on the display device 182 and, if necessary, operates the operation buttons displayed on the screen to register the product and make the payment. At that time, the operation of the operation button by the customer is detected by the operation device 183, which is composed of, for example, a touch panel, and is notified to the self-service POS terminal 130.

[0163] The scanner 184 and the hand scanner 185 read code symbols such as bar codes and two-dimensional codes attached to products. The scanner 184 and the hand scanner 185 are equipped with optical imaging elements such as charge coupled devices (CCDs) and complementary metal oxide semiconductors (CMOSs), and capture an image of an imaging area in front of a reading window. The customer holds the code symbol attached to the product over the reading window of the scanner 184 to have the scanner 184 read the code symbol. For large products such as cardboard boxes and long products, it is difficult to hold the code symbol attached to the product over the reading window of the scanner 184. In such cases, the customer holds the hand scanner 185 over the code symbol, such as a bar code, attached to the product to have the code symbol read.

[0164] On the right side as one faces the self-service POS terminal 130, there is provided a product placement table 191 on which a customer places unpaid products in a basket. On the left side as one faces the self-service POS terminal 130, there is provided a product placement table 192 on which a customer places paid products. A customer places registered products in a basket placed on the product placement table 192. If a customer has prepared a bag-shaped reusable bag, the customer hooks the handle of the bag on a hook 193 provided above the product placement table 192 and places registered products into the bag.

[0165] A camera 189 is installed facing downward above the product placement stand 192. The camera 189 captures an image of a customer putting registered products into a basket placed on the product placement stand 192 or a bag with a handle hung on a hook 193. The self-service POS terminal 130 transmits the captured image to the edge gateway 20 in association with an identification number that uniquely identifies the self-service POS terminal 130.

[0166] The self-service POS terminal 130 further includes a card reader 186. The card reader 186 reads an inserted customer's point card, credit card, or the like. The self-service POS terminal 130 also includes a receipt printer 187. When payment is completed, the receipt printer 187 issues a receipt on which the transaction result is printed.

[0167] The self-service POS terminal 130 also includes a change machine 188 that calculates the amount of bills and coins deposited by the customer at the time of settlement and dispenses change bills and coins as necessary.

[0168] Furthermore, a warning light 190 is provided at the tip of a pole provided above the self-service POS terminal 130. The warning light 190 lights up or flashes when an abnormality occurs in the operation performed at the self-service POS terminal 130, when an abnormality occurs in the operation of the self-service POS terminal 130, when a store clerk needs to be called, etc. When the warning light 190 receives information from the edge gateway 20 indicating that the number of products put in the basket by the customer does not match the number of products read by the scanner 184 or the hand scanner 185, the warning light 190 lights up or flashes to alert the store clerk.

[0169] (Hardware configuration of self-service POS terminal) The hardware configuration of the self-service POS terminal 130 will be described with reference to Fig. 18. Fig. 18 is a hardware block diagram showing an example of the hardware configuration of the self-service POS terminal.

[0170] The self POS terminal 130 includes a control unit 151, a storage unit 152, a peripheral device controller 153, and a communication I / F 154.

[0171] The control unit 151 controls the overall operation of the self-service POS terminal 130. The control unit 151 includes a CPU 161, a ROM 162, and a RAM 163. The CPU 161 is connected to the ROM 162 and the RAM 163 via internal buses such as an address bus and a data bus. The CPU 161 loads various programs stored in the ROM 162 and the storage unit 152 into the RAM 163. The CPU 161 controls the operation of the self-service POS terminal 130 by operating in accordance with the various programs loaded into the RAM 163. That is, the control unit 151 has the configuration of a general computer.

[0172] The memory unit 152 is a storage device such as an HDD or SSD that is connected to the control unit 151 via an internal bus 155. The memory unit 152 may also be a non-volatile memory such as a flash memory that retains stored information even when the power is turned off. The memory unit 152 stores a control program 164, a product master 165, a member master 166, and a product registration file 167.

[0173] The control program 164 is a program that controls the overall operation of the self-service POS terminal 130. The control program 164 may be provided in a state stored in the storage unit 152, or may be provided by recording it in an installable or executable file format on a non-transitory computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD. The control program 164 may also be provided by storing it on a computer connected to a network and downloading it via the network. Furthermore, the control program 164 may be provided or distributed via a network such as the Internet.

[0174] The product master 165 is the same as the above-mentioned product master 122 (see FIG. 3).

[0175] Member master 166 is a master file that stores a customer's name, date of birth, sex, nationality, mobile terminal email address, etc. in association with the customer's member ID. Based on the member ID read from the member card by card reader 186, member master 166 reads out information about the customer who holds the member card, and updates the customer's purchase history, etc. The purchase history is used to improve the quality of service provided to the customer.

[0176] The product registration file 167 is the same as the above-mentioned product registration file 123 (see FIG. 4).

[0177] 18 via a peripheral device controller 153 connected by an internal bus 155. The outline of these peripheral devices has been described above, and therefore will not be described again.

[0178] The communication I / F 154 enables wireless communication between the self POS terminal 130 and the edge gateway 20 or the store server 30.

[0179] (Functional configuration of self-service POS terminal) The functional configuration of the self-service POS terminal 130 will be described with reference to Fig. 19. Fig. 19 is a functional block diagram showing an example of the functional configuration of the self-service POS terminal.

[0180] The control unit 151 of the self-service POS terminal 130 functions as a product code acquisition unit 231, a product registration unit 232, an image capture control unit 233, a video output unit 234, a product registration completion instruction acquisition unit 235, a product registration information output unit 236, a product quantity comparison information acquisition unit 237, a notification control unit 238, a payment method acquisition unit 239, a payment processing unit 240, a payment completion information display unit 241, and a receipt issuing unit 242, as a result of the CPU 161 operating in accordance with the control program 164 stored in the storage unit 152. Note that all or part of these functions may be configured using hardware such as a dedicated circuit.

[0181] The product code acquisition unit 231 reads a code symbol, such as a barcode, attached to a product held over the scanner 184 or the hand scanner 185, and acquires the product code registered to the code symbol.

[0182] The product registration unit 232 registers the product having the product code acquired by the product code acquisition unit 231 in the product registration file 167 .

[0183] The imaging control unit 233 issues instructions to the camera 189 to start and end imaging.

[0184] The video output unit 234 outputs the video captured by the camera 189 to the edge gateway 20 in association with an identification number that uniquely identifies the self POS terminal 130 .

[0185] The product registration completion instruction acquisition unit 235 acquires an instruction that product registration has been completed by detecting, with the operation device 183, for example, that a checkout button displayed on the display device 182 has been pressed, which indicates that product registration has been completed.

[0186] The product registration information output unit 236 outputs the product registration file 167 to the edge gateway 20 .

[0187] The product quantity comparison information acquisition unit 237 acquires from the edge gateway 20 the image transmitted from its own self-service POS terminal 130 and the first quantity (the number of products put into the basket) and the second quantity (the number of products registered in the product registration file 167), i.e., product quantity comparison information, based on the product registration file 167. Note that the edge gateway 20 outputs this information to the self-service POS terminal 130 only when the first quantity and the second quantity do not match.

[0188] The notification control unit 238 issues a notification by turning on or blinking the warning light 190, on the condition that the product quantity comparison information acquisition unit 237 has acquired the first quantity and the second quantity from the edge gateway 20.

[0189] The payment method acquisition unit 239 acquires the payment method designated by the customer by detecting with the operation device 183 whether any of the selection buttons for selecting a payment method displayed on the display device 182 of the self-service POS terminal 130 has been pressed.

[0190] The payment processing unit 240 performs payment using the payment method acquired by the payment method acquisition unit 239. When cash payment is selected, the payment processing unit 240 receives and receives cash using a change dispenser 188 provided in the self-service POS terminal 130. When cashless payment is selected, the payment processing unit 240 reads the customer's registered credit card information and the charge amount of the customer's electronic money card using a card reader 186 provided in the self-service POS terminal 130 according to the payment method, and causes an external server that performs payment processing (not shown) to perform the payment.

[0191] The payment completion information display unit 241 displays information indicating that the payment has been completed and the transaction details on the display device 182 of the self-service POS terminal 130.

[0192] The receipt issuing unit 242 issues a receipt on which the details of the payment are printed from the receipt printer 187 provided in the self-service POS terminal 130 .

[0193] (Processing flow of self-service POS terminal) The flow of processing performed by the self POS terminal 130 will be described with reference to Fig. 20. Fig. 20 is a flow chart showing an example of the flow of processing performed by the self POS terminal.

[0194] The product registration unit 232 detects, via the operation device 183, that a shopping start button displayed on the display device 182 has been pressed, thereby acquiring an instruction that product registration has started (step S61).

[0195] The shooting control unit 233 causes the camera 189 to start shooting video (step S62).

[0196] The video output unit 234 associates the video captured by the camera 189 with the identification number of the self-service POS terminal 130 and outputs the video to the edge gateway 20 (step S63).

[0197] The product code acquisition unit 231 determines whether a product code has been acquired from the code symbol read by the scanner 184 or the hand scanner 185 (step S64). If it is determined that the product code has been acquired (step S64: Yes), the process proceeds to step S65. On the other hand, if it is not determined that the product code has been acquired (step S64: No), the process returns to step S63.

[0198] If it is determined in step S64 that the product code has been acquired, the product registration unit 232 registers the product having the product code acquired by the product code acquisition unit 231 in the product registration file 167 (step S65).

[0199] The product registration completion instruction acquisition unit 235 determines whether there is an instruction to the effect that product registration is complete (step S66). If it is determined that there is an instruction to the effect that product registration is complete (step S66: Yes), the process proceeds to step S67. On the other hand, if it is not determined that there is an instruction to the effect that product registration is complete (step S66: No), the process returns to step S63. Note that the product registration completion instruction acquisition unit 235 determines that there is an instruction to the effect that product registration is complete by detecting, via the operation device 183, that the checkout button displayed on the display device 182 has been pressed.

[0200] If it is determined in step S66 that an instruction has been given to the effect that product registration has been completed, then the image capture control unit 233 instructs the camera 189 to end image capture (step S67). Although not shown in the flowchart of FIG. 20, at this time, the video output unit 234 ends the output of video to the edge gateway 20.

[0201] The product registration information output unit 236 outputs the product registration file 167 to the edge gateway 20 (step S68).

[0202] The product number comparison information acquisition unit 237 determines whether product number comparison information has been acquired from the edge gateway 20 (step S69). If it is determined that product number comparison information has been acquired (step S69: Yes), the process proceeds to step S70. On the other hand, if it is determined that product number comparison information has not been acquired (step S69: No), the process proceeds to step S71.

[0203] When it is determined in step S69 that the product quantity comparison information has been acquired, the notification control unit 238 issues a notification by turning on or blinking the warning light 190 (step S70). After that, the self-checkout POS terminal 130 ends the process.

[0204] On the other hand, if it is determined in step S69 that the product quantity comparison information has not been acquired, the payment method acquisition unit 239 acquires the payment method specified by the customer by detecting with the operation device 183 whether any of the selection buttons for selecting the payment method displayed on the display device 182 of the self-service POS terminal 130 has been pressed (step S71).

[0205] The payment processing unit 240 performs payment processing according to the payment method acquired in step S71 (step S72).

[0206] The payment completion information display unit 241 displays information indicating that the payment has been completed and the transaction details on the display device 182 of the self-service POS terminal 130 (step S73).

[0207] The receipt issuing unit 242 issues a receipt with the details of the payment printed on it from the receipt printer 187 of the self-service POS terminal 130 (step S74). The self-service POS terminal 130 then ends the process.

[0208] (Effects of the embodiment) As described above, in the product sales data processing system of the second embodiment, when the first quantity and the second quantity do not match, the first quantity and the second quantity are notified to the self-service POS terminal 130 (terminal device) where the customer registers and settles for the products he or she purchases. Therefore, without making significant modifications to a conventional self-service POS terminal, the self-service POS terminal can reliably detect and report fraudulent behavior in which a customer puts products into a basket or bag without reading the code symbol with the scanner 184 or hand scanner 185.

[0209] Although the embodiments of the present invention have been described above, these embodiments are merely examples and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0210] 1. Product sales data processing system 5. Shopping Cart 7 Basket (storage area) 8. Access Points 10 Cart terminal (product registration device) 18 Scanner 19,189 Camera (imaging device) 20 Edge Gateway (Product Registration Support Device) 30 Store Server 40 Mobile terminal (terminal device) 50 Accounting machine (accounting device) 61 Product registration start instruction acquisition unit 62,233 Shooting control section 63,234 Video output section 64,231 Product Code Acquisition Department 65,232 Product Registration Department 66,235 Product registration completion instruction acquisition department 67,236 Product registration information output section 68 Transaction ID Acquisition Section 69 Payment Instruction Acquisition Department 70 Transaction ID display section 71 Video Acquisition Unit 72 Product Counting Department (Counting Department) 73 Product registration information acquisition unit (product number acquisition unit) 74 Product number comparison section 75 Product registration information output section 76,91 Transaction ID Acquisition Section 77 Transaction ID output section 78 Product Quantity Comparison Information Output Section 81,237 Product number comparison information acquisition department 82,238 Notification control section 83 Product number comparison information display section 92 Product Registration Information Acquisition Department 93,239 Payment Method Acquisition Department 94,240 Payment processing unit 95,241 Payment completion information display section 96,242 Receipt issuing department 130 Self-service POS terminal (terminal device) N In-store network [Prior art documents] [Patent documents]

[0211] [Patent Document 1] JP 2014-235530 A

Claims

1. A product registration support device that supports an operation of a product registration device that registers a product by reading information that uniquely identifies the product to be purchased, comprising: an image acquisition unit that acquires an image of the product being inserted into the storage unit, the image being captured by an image capture device that captures an image of the storage unit that contains the product from which the information has been read, and an identification number that identifies the storage unit; a counting unit that counts a first number, which is the number of products placed in the storage unit, from the image acquired by the image acquisition unit; a product number acquisition unit that acquires a second number, which is the number of products read by the product registration device until registration is completed; a product number comparison information output unit that outputs the identification number, the first number, and the second number to be notified to a terminal device on the condition that the first number and the second number do not match. Product registration support device.

2. The image acquisition unit is acquiring images captured by the image capturing device from the time when the product registration device is instructed to start product registration to the time when the product registration device is instructed to complete product registration; The product registration support device according to claim 1.

3. The terminal device is a mobile terminal carried by a store clerk.

3. The product registration support device according to claim 1.

4. The terminal device is a self-service POS terminal that allows a customer to register and pay for the products he or she purchases.

3. The product registration support device according to claim 1.

5. a scanner installed in the shopping cart for reading a code symbol attached to the product, the code symbol including an identification number of the product; a photographing device that is installed in the shopping cart and photographs an image of the product, the code symbol of which has been read, being placed in a storage unit of the shopping cart; a product registration support device that acquires the video and an identification number of the shopping cart, counts a first number which is the number of products added to the shopping cart, acquires a second number which is the number of products read by the scanner until registration is complete, and outputs the identification number, the first number, and the second number on the condition that the first number and the second number do not match; a terminal device carried by a store clerk and configured to give a notification when the terminal device has acquired the identification number, the first quantity, and the second quantity output by the product registration support device; a product registration device that registers the product scanned by the scanner; and a checkout device that performs payment processing for the products registered by the product registration device. Product sales data processing system.

6. a computer for controlling a product registration support device that supports an operation of a product registration device for registering a product by reading information that uniquely identifies the product to be purchased; an image acquisition unit that acquires an image of the product being inserted into the storage unit, the image being captured by an image capture device that captures an image of the storage unit that contains the product whose information has been read, and an identification number that identifies the storage unit; a counting unit that counts a first number, which is the number of products placed in the storage unit, from the image acquired by the image acquisition unit; an acquisition unit that acquires a second number, which is the number of products read by the product registration device until registration is completed; a program that functions as a product quantity comparison information output unit that outputs the identification number, the first quantity, and the second quantity to be notified to a terminal device, on the condition that the first quantity and the second quantity do not match.

Images