Monitoring system, sales data processing device and program

Abstract

To provide a monitoring system, a sales data processing device and a program capable of preventing merchandise in the lower part of a shopping cart from being taken out of a store without payment. [Solution] A monitoring system including an exit gate that has a door blocking the passage to the store entrance / exit and that opens and closes the door in response to a predetermined process, and a sales data processing device that performs a registration process to register product information in a memory unit and a payment process for the products registered in the memory unit, has a processor that acquires an identifier displayed on a receipt issued by the sales data processing device, analyzes whether an image captured of the area where the lower level of the shopping cart is located includes the shopping cart and whether an item is placed on the lower level, and if an item is determined to be placed on the lower level, determines whether the item is information corresponding to the identifier and included in the information registered in the memory unit, and if it determines that the item is included, opens the door, and otherwise maintains the door blocking the passage.

Description

[Technical Field]

[0001] FIELD Embodiments of the present invention relate to a monitoring system, a sales data processing device, and a program. [Background technology]

[0002] Conventionally, some stores have installed exit gates (see, for example, Patent Document 1). The exit gates include, for example, an openable door, a drive unit for opening and closing the door, and a reader for reading receipts. If the read receipt is valid, the door opens and the customer is allowed to pass through.

[0003] Conventional exit gates such as those described above determine the validity of a receipt based on the date and time of the transaction printed on the receipt, whether the receipt has already been scanned (i.e., used) at the exit gate, etc. Therefore, they are not concerned with whether products that have not been registered or paid for in the sales data processing device are taken out of the store.

[0004] For example, when a customer uses a shopping cart, the counter table obstructs the view of the bottom of the shopping cart from the store clerk operating a standard POS terminal, which can lead to problems such as not being able to register or pay for items placed in the bottom of the shopping cart.

[0005] Furthermore, at self-checkout machines where product registration and payment are performed by customer operation, there is a risk of product registration and payment not being completed due to customer error or intentional misconduct. This problem is easy to detect as the top level of a shopping cart is easily visible on store surveillance cameras, but it is difficult to prevent this from happening for products in the bottom level of the shopping cart.

[0006] When the above-mentioned problems occur, customers end up taking items that have not been registered or paid for out of the store. Large or heavy items tend to be placed at the bottom of shopping carts. Since the prices of such items tend to be higher than those of smaller items, if the above-mentioned problems can be detected in advance, major losses to the store can be avoided. Summary of the Invention [Problem to be solved by the invention]

[0007] The problem to be solved by the present invention is to provide a monitoring system, a sales data processing device, and a program that can prevent items in the bottom row of a shopping cart from being taken out of the store without payment being made. [Means for solving the problem]

[0008] In one embodiment, the monitoring system includes an exit gate that has a door blocking the passage to the store entrance / exit and that opens and closes the door in response to a predetermined process, and a sales data processing device that performs a registration process to register information about products purchased by customers in a predetermined memory unit and a payment process for the products registered in the memory unit.The processor included in the monitoring system acquires the identifier of the receipt displayed on the receipt issued by the sales data processing device, analyzes whether an image captured of the area where the lower level of the shopping cart is located includes the shopping cart and whether an item is placed on the lower level, and if it is determined that an item is placed on the lower level, determines whether the item is information corresponding to the identifier and is included in the information registered in the memory unit, and if it determines that information about the item is included in the information registered in the memory unit, opens the door, and otherwise maintains the door blocking the passage. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a system installed in a store. [Figure 2]FIG. 2 is a diagram showing an example of the appearance of the exit gate in the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of the store server. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of a POS terminal. [Figure 5] FIG. 5 is a block diagram showing an example of the configuration of an exit gate. [Figure 6] FIG. 6 is a block diagram showing an example of processing units included in the control unit and the relationship between the processing units. [Figure 7] FIG. 7 is a flowchart showing an example of the flow of processing performed by the control unit. [Figure 8] FIG. 8 is a diagram for explaining monitoring of the lower level of a shopping cart at a fully self-service terminal in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] (First embodiment) An embodiment of a monitoring system will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of the configuration of a system installed in a store. The store is equipped with a system for processing sales data. The system includes a store server 1, a router 2, a POS terminal 3, a self-service terminal 5, a registration machine 6, a cashier 7, and an exit gate 8.

[0011] 2 is a diagram showing an example of the appearance of the exit gate 8 in the first embodiment. In this diagram, the symbol P indicates a customer, the symbol Q indicates a shopping cart, the symbol R indicates a shopping basket, and the symbol S indicates an item placed on the lower level.

[0012] The exit gate 8 is installed, for example, near the entrance / exit of a store. The exit gate 8 includes a pair of devices 85, a door 86, a code reader 87, an imaging unit 88, etc. The pair of devices 85 are installed on either side of the passage to the entrance / exit of the store. The door 86 blocks the passage between the pair of devices 85 and opens and closes automatically when a predetermined process is performed. When the predetermined process is not performed, the door 86 maintains its state of blocking the passage, i.e., is closed.

[0013] In order to prevent items in the bottom row of a shopping cart Q from being taken out of the store without payment, the monitoring system performs processing to notify an appropriate target when an item S is present in the bottom row of a shopping cart Q and there is a possibility that the item S is an unpaid item.

[0014] The monitoring system acquires information about the bottom row of the shopping cart Q, for example, using an imaging unit 88 installed at the exit gate 8. The monitoring system also acquires information about the products purchased by the customer P who is about to leave the store, for example, using the ID (identifier) ​​of the receipt read by a code reader 87 installed at the exit gate 8 as a key.

[0015] The store server 1 is an information processing device installed, for example, in the backyard of a store, and stores various information related to the store, such as information on products handled in the store and information on sales of the store.

[0016] The store server 1 may be installed, for example, at a headquarters that manages the chain to which the store belongs, and may store information on multiple stores in the same chain. The type of store in this embodiment is retail, but this is not a limitation. While the store server 1 is shown as a single device in this embodiment, the store server 1 may be implemented by multiple devices working together, or the store server 1 may be a cloud server (or cloud system) implemented by devices connected to a network.

[0017] The router 2 connects each device (store server 1, POS terminal 3, self-service terminal 5, registration machine 6, cashier machine 7, and exit gate 8) to a network such as a local area network (LAN) installed within the store. This allows each device to communicate with each other. Here, "POS" is an abbreviation for "Point Of Sale," which means "point of sale information management."

[0018] The POS terminal 3, full-self service terminal 5, registration machine 6, and payment machine 7 are sales data processing devices. The POS terminal 3 is a device that performs processes related to product registration and payment mainly through operation by a store clerk. The full-self service terminal 5 is a device that performs processes related to product registration and payment mainly through operation by a customer. The registration machine 6 is a device that performs processes related to product registration mainly through operation by a store clerk. The payment machine 7 is a device that performs processes related to payment mainly through operation by a customer.

[0019] 3 is a block diagram showing an example of the configuration of the store server 1. The store server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a communication unit 14, a storage unit 19, and the like.

[0020] The communication unit 14 is a wired or wireless communication interface that can be connected to a network such as a LAN, etc. The communication unit 14 communicates with various sales data processing devices via the network.

[0021] The CPU 11 is an example of a processor, and controls the overall operation of the store server 1. The ROM 12 stores various programs. The RAM 13 is a workspace where programs and various data are developed.

[0022] The CPU 11, ROM 12, and RAM 13 are connected via a bus or the like to form a computer-configured control unit 10. In the control unit 10, the CPU 11 operates in accordance with a program stored in the ROM 12 or the storage unit 19 and loaded into the RAM 13, thereby executing various processes.

[0023] The storage unit 19 is configured with a non-volatile storage medium such as a hard disk drive (HDD) or flash memory, and maintains its stored contents even when power is cut off. The storage unit 19 stores a program 191 that can be executed by the CPU 11 and various setting information. For example, the program 191 includes a program for realizing the functional configuration described below.

[0024] The storage unit 19 stores a product master 192 that compiles information on products (product information) handled by the store, transaction information 193, member information 194, and the like.

[0025] These are just examples, and other information may also be stored in the storage unit 19. Note that the various pieces of information stored in the storage unit 19 may be acquired in advance from other external devices via a network, or may be acquired and updated automatically.

[0026] Hereinafter, the product master 192 and transaction information may be referred to as “POS data.” In other words, the “POS data” that appears below is, for example, the product master 192 and transaction information 193.

[0027] <Product Master> The product master 192 is a compilation of information about products handled by the store, and is stored in the storage unit 19 in the form of a data table, for example. The data table serving as the product master 192 includes the following items, for example. Product code ·Product name ·unit price Verification data ·Classification

[0028] A product code is information (identification information) that allows a product to be uniquely identified, such as a JAN (Japanese Article Number) code. Other information (product name, unit price, matching data, classification, etc.) is stored in association with the product code. The "product name" field stores the name of the product. The "unit price" field stores the price of one product.

[0029] The "matching data" field stores reference feature quantities. Each device that processes sales data compares the feature quantities of the product image contained in an image (captured image) captured and output by a camera or the like with the matching data, and obtains a product code associated with the matching matching data, thereby recognizing the product. The above-mentioned match determination is made, for example, by calculating the similarity between the feature quantities of the captured image and the matching data, comparing the calculated similarity with a threshold, and determining that the matching data matches if the similarity is equal to or greater than the threshold. Note that the product code may also be obtained by reading (scanning or decoding) a code symbol such as a barcode or two-dimensional code attached to the product.

[0030] The items stored in the "classification" category are those that can be clearly identified by their external appearance, such as "cardboard box," "rice bag," and "multiple packs of tissue boxes."

[0031] <Transaction information> The transaction information 193 is information about products purchased by customers, and is received from a sales data processing device in the store and stored (registered). Note that the transaction information 193 may include not only information about the store itself, but also transaction information received from sales data processing devices of other stores.

[0032] The transaction information 193 is compiled in the form of, for example, a data table. The transaction information 193 includes, for example, the following items. Store ID Device ID Transaction ID Date and Time Member ID -Detailed information Transaction amount

[0033] The "Store ID" field stores the store ID of the store where the transaction in the record took place. The "Terminal ID" field stores the terminal ID of the sales data processing device that performed the transaction in the record. The terminal ID is identification information for the sales data processing device, and is assigned so as not to be duplicated at least within the same store.

[0034] The transaction ID is identification information for the transaction, and is automatically assigned (numbered) when, for example, the first product registration process for the transaction is performed. The "Date and Time" field stores the date and time when the transaction for the record was performed.

[0035] The "Member ID" field stores the member ID of the customer who performed the transaction in the record if the customer provided one. The member ID is identification information for the customer who is a member, and is, for example, a unique number assigned to each member.

[0036] The item "transaction amount" stores the total price (total amount) of all the products purchased in the transaction of the record.

[0037] Here, for a combination of a shop ID, terminal ID, and transaction ID, there is one transaction amount, but the number of detailed information is not limited to one, and multiple detailed information may be associated. The detailed information may include, for example, the following items: <Details> Product code ·Product name ·unit price ·quantity ·price

[0038] The product code, product name, and unit price are as described above and will be omitted here. The "quantity" field stores the quantity (number, weight, volume, etc.) of the product indicated by the product code purchased in the transaction for that record. The "price" field stores the value obtained by multiplying the unit price by the quantity.

[0039] <Membership information> Member information 194 is information about customers who are members, and is stored in the form of a data table in storage unit 19. Items included in the data table as member information 194 are, for example, as follows. Member ID ·full name ·contact address

[0040] The member ID is the member's identification information. The member ID is, for example, a unique number assigned to each member, and is not duplicated within the system. Other information (name, points held, points transferred, etc.) is stored in association with the member ID. The "Name" field stores the member's name. The "Contact Information" field stores the member's address, telephone number, email address, etc.

[0041] 4 is a block diagram showing an example of the configuration of the POS terminal 3. The POS terminal 3 includes a CPU 31, a ROM 32, a RAM 33, a communication unit 34, a display unit 35, an operation unit 36, a code reader 37, an imaging unit 38, a memory unit 39, a deposit / withdrawal unit 40, a receipt printer 41, an alarm unit 42, etc.

[0042] The communication unit 34 is a wired or wireless communication interface that can be connected to a network such as a LAN, etc. The communication unit 34 communicates with other devices connected via the network.

[0043] The display unit 35 has a display device such as an LCD (Liquid Crystal Display), and displays various types of information under the control of the CPU 31.

[0044] The operation unit 36 ​​has input devices such as a touch panel overlaid on the display surface of the display unit 35, a keyboard, and a pointing device, and outputs operation contents input via the input devices to the CPU 31. The touch panel of the operation unit 36, together with the display device of the display unit 35, constitutes a touch panel display.

[0045] The code reader 37 is, for example, a code reader or an image sensor, and reads (decodes) code symbols such as barcodes and two-dimensional codes. The code reader 37 may be a handheld scanner or a stationary type. The code reader 37 reads, for example, a code symbol in which information including a product code is coded, and acquires the product code.

[0046] The imaging unit 38 includes an image sensor and the like, and obtains image data (imaging data) of an image of the appearance of an object (for example, a product).

[0047] The deposit / withdrawal unit 40 may have a built-in coin deposit / withdrawal device or a banknote deposit / withdrawal device, and may accept cash payments. The deposit / withdrawal unit 40 may also be capable of accepting cashless payments, such as credit card payments, electronic money payments, and code payments that involve sending and receiving information via code symbols displayed on a smart device.

[0048] Upon completion of the payment process, the receipt printer 41 issues (outputs) a paper sheet (receipt) on which the transaction details are printed. A code symbol encoding the receipt ID (receipt ID) is printed on the receipt along with the transaction details. In this embodiment, the receipt ID is the same as the transaction ID. The receipt ID and the code symbol encoding the receipt ID are each an example of an identifier.

[0049] The notification unit 42 is specifically a device that produces sound, such as a buzzer or a speaker, or a device that emits light, such as an LED (light emitting diode), and operates under the control of the CPU 31.

[0050] The CPU 31 is an example of a processor, and controls the overall operation of the POS terminal 3. The ROM 32 stores various programs. The RAM 33 is a workspace where programs and various data are developed.

[0051] The CPU 31, ROM 32, and RAM 33 are connected via a bus or the like to constitute a computer-configured control unit 30. The CPU 31 operates in accordance with a program stored in the ROM 32 or the storage unit 39 and loaded into the RAM 33, causing the control unit 30 to function as various functional units and execute various processes.

[0052] The storage unit 39 has a storage medium such as a HDD or flash memory, and maintains its stored contents even when the power is turned off. The storage unit 39 stores a program 391 that can be executed by the CPU 31 and various setting information. For example, the program 391 includes a program for realizing the functions described below.

[0053] The storage unit 39 stores a product master 392, registration information 393, etc. These data are examples, and the storage unit 39 may also store other data.

[0054] The product master 392 stores information similar to that of the product master 192, and therefore detailed description thereof will be omitted. Note that the product master 392 may be periodically and automatically acquired and updated from a higher-level device via a network or the like.

[0055] Since the registration information 393 is the original information of the transaction information 193, the data structure is in the same format as the transaction information 193, and therefore a detailed description thereof will be omitted.

[0056] 5 is a block diagram showing an example configuration of the exit gate 8. The exit gate 8 includes a CPU 81, ROM 82, RAM 83, a communication unit 84, a code reader 87, an imaging unit 88, a memory unit 89, an alarm unit 92, a motor 93, etc. The explanation of the CPU 81, ROM 82, RAM 83, communication unit 84, imaging unit 88, and alarm unit 92 is omitted because it is the same as the explanation of the CPU 31, ROM 32, RAM 33, communication unit 34, imaging unit 38, and alarm unit 42.

[0057] The storage unit 89 has a storage medium such as a HDD or flash memory, and maintains its stored contents even when the power is turned off. The storage unit 89 stores programs 891 that can be executed by the CPU 81 and various setting information. For example, the programs 891 include programs for realizing the functions described below.

[0058] The code reader 87 is, for example, a code reader or an image sensor, and reads (decodes) code symbols such as barcodes and two-dimensional codes. The code reader 87 is provided in the device 85. The code reader 87 reads the code symbol printed on the receipt and obtains the receipt ID.

[0059] The imaging unit 88 is, for example, an image sensor, which captures an image of a predetermined range and outputs digital data (image data) that allows the captured image to be reproduced (displayed) on a display device.

[0060] The motor 93 generates a driving force for opening and closing the door 86 under the control of the CPU 81 .

[0061] 6 is a block diagram showing an example of the processing units provided in the control units 10, 30, and 80 and the relationship between each processing unit. The control unit 10 functions as an update processing unit 101, a query processing unit 102, an image processing unit 103, and a determination processing unit 104 when the CPU 11 executes a program 191. The control unit 30 functions as a registration processing unit 301 and a payment processing unit 302 when the CPU 31 executes a program 391. The control unit 80 functions as a reading processing unit 802, an imaging processing unit 803, an opening / closing processing unit 804, and a notification processing unit 805 when the CPU 81 executes a program 891.

[0062] The registration processing unit 301 performs registration processing in response to operations by an operator (mainly a store clerk) of the POS terminal 3. More specifically, the registration processing unit 301 acquires a product code via, for example, the code reader 37 and the operation unit 36. Alternatively, the registration processing unit 301 calculates feature amounts from a product image included in a captured image based on imaging data output by the imaging unit 38, and compares the calculated feature amounts with the verification data in the product master 392 to acquire a product code. Next, the registration processing unit 301 acquires product information corresponding to the acquired product code from the product master 392. The registration processing unit 301 then stores (registers) the acquired product information in the storage unit 39 as registration information 393.

[0063] The payment processing unit 302 performs payment processing in response to operations by an operator (mainly a store clerk) of the POS terminal 3. More specifically, the payment processing unit 302, for example, accepts deposits into the deposit / withdrawal unit 40 and causes change to be dispensed from the deposit / withdrawal unit 40. The payment processing unit 302 also causes the receipt printer 41 to print a receipt.

[0064] When the update processing unit 101 receives the product information registered by the registration processing unit 301, it stores the information in the storage unit 19 as transaction information 193. Furthermore, when the update processing unit 101 receives information on a transaction that has been settled by the payment processing unit 302, it updates the transaction information 193.

[0065] The reading processing unit 802 is an example of an acquisition unit that acquires a receipt identifier. The reading processing unit 802 decodes the code symbol from the output of the code reader 87 to acquire a receipt ID (corresponding to the transaction ID) and sends it to the store server 1. The imaging processing unit 803 sends the imaging data output by the imaging unit 88 to the store server 1.

[0066] The opening / closing processing unit 804 receives the output of the determination processing unit 104 and controls the motor 93 to open or close the door 86 .

[0067] If the item S that was placed on the bottom shelf of the shopping cart Q is not included in the detailed information corresponding to the receipt ID, the notification processing unit 805 performs processing to notify the user of this fact using visual or audio information. More specifically, the notification processing unit 805 receives the output of the determination processing unit 104 and operates the notification unit 92 as appropriate.

[0068] The inquiry processing unit 102 retrieves from the memory unit 19 transaction information 193 stored in association with a transaction ID that matches the receipt ID received from the exit gate 8. The inquiry processing unit 102 also determines whether the retrieved transaction information 193 is valid for the customer who is about to leave the store. For example, the inquiry processing unit 102 determines that the receipt is valid if the elapsed time from the date and time of the transaction information 193 to the current date and time is within a predetermined time, and determines that the receipt is invalid if the predetermined time has passed. The inquiry processing unit 102 sends the result of this determination to the exit gate 8.

[0069] The image processing unit 103 performs processing to analyze whether the captured image output by the imaging unit 88 includes the shopping cart Q and whether the item S is placed on the lower level of the shopping cart Q.

[0070] More specifically, the image processing unit 103 performs object detection processing based on the imaging data received from the exit gate 8. More specifically, the image processing unit 103 analyzes the imaging data to determine whether a shopping cart Q is present, and if so, whether an item S is placed below the shopping cart Q. Note that the object detection processing can utilize technology such as "SSD (Single Shot Multibox Detector)."

[0071] When the image processing unit 103 determines that an item S is placed on the lower level, the judgment processing unit 104 performs a process to determine whether the item S is information corresponding to the receipt ID (transaction ID) acquired by the reading processing unit 802 and is included in the information stored in the transaction information 193.

[0072] More specifically, when the image processing unit 103 detects that the item S is in the bottom row of the shopping cart Q, the determination processing unit 104 determines whether the item S is a product purchased by the customer. To make this determination, the determination processing unit 104 performs, for example, an identification process. The identification process is a process for identifying whether the item S is a product for which payment has been made. In the identification process, the determination processing unit 104 compares, for example, the feature amount of the item S with the feature amount of the product included in the transaction information 193. The comparison is performed, for example, based on the degree of similarity between the two feature amounts. Note that the identification process can utilize a technology such as "EfficientNet," for example.

[0073] FIG. 7 is a flowchart showing an example of the flow of processing performed by the control units 10 and 80.

[0074] The control unit 80 of the exit gate 8 performs a process to read the code symbol printed on the receipt via the code reader 87 (step S1). The control unit 80 repeats steps S1 to S2 until the code reader 87 acquires the receipt ID (step S2_No).

[0075] When the code reader 87 acquires the receipt ID (step S2_Yes), the control unit 80 sends the receipt ID to the store server 1 (step S3) and receives a response from the store server 1 (step S4). If the response from the store server 1 indicates that the receipt is valid (step S5_Yes), the control unit 80 acquires imaging data from the imaging unit 88 and sends it to the store server 1 (step S6), and the store server 1 takes over the processing.

[0076] The control unit 10 of the store server 1 performs object detection processing based on the received image data (step S7). If the shopping cart Q is present in the captured image (step S8_Yes) and there is an item S below it (step S9_Yes), the control unit 10 performs the loop processing of step S10 for each object region.

[0077] In the loop processing of step S10, the control unit 10 first performs an identification process (step S11). The identification process is performed by comparing the item S with the product included in the receipt. In the identification process, the control unit 10 calculates the similarity between the feature amount of the item S and the feature amount of the product included in the transaction information 193. Next, the control unit 10 determines whether the item S is included in the detailed information (step S12). At this time, if there is a product in the detailed information whose similarity with the item S exceeds a predetermined threshold, the control unit 10 presumes that the product is the item S. In other words, the control unit 10 determines that the item S is a product purchased by the customer (step S12_Yes).

[0078] If there are multiple items S, the control unit 10 performs the processing of steps S11 to S12 for each item S, and when the processing for all items S is completed, the control unit 10 exits the loop processing of step S10 and proceeds to step S13.

[0079] In step S13, the control unit 10 sends information to the exit gate 8 instructing it to open, and the process is handed over to the exit gate 8. The control unit 80 of the exit gate 8 that has received the information instructing it to open controls the motor 93 to move the door 86, and puts the exit gate 8 into an open state.

[0080] Next, the control unit 80 waits for the customer to pass through (step S14_No), and when it determines from the output of the imaging unit 88 that the customer has passed through (step S14_Yes), it controls the motor 93 to move the door 86, close the exit gate 8 (step S15), and terminates this process.

[0081] If the shopping cart Q is not included in the captured image (step S8_No), or if the shopping cart Q is present but there is no article S below it (step S9_No), the control unit 10 advances the process to step S13.

[0082] If the receipt that the customer has had the code reader 87 read is invalid (step S5_No), the control unit 80 proceeds to step S16, where the notification unit 92 issues an alert (step S16). If the item S in the bottom row of the shopping cart Q is not included in the detailed information (step S12_No), the control unit 10 proceeds to step S16, where it hands over to the control unit 80, which issues an alert (step S16). The control unit 10 then records information related to the alert in a log (step S17), and ends this process.

[0083] The monitoring system of this embodiment captures images of the inside of the exit gate 8 to detect the shopping cart Q, and if an item S is found in the lower level, it determines whether it is a product included in the detailed information, and if it is not, it issues an alert. This makes it possible to notify the customer if there is a possibility that the item S placed in the lower level of the shopping cart Q is an unpaid item. Also, by not opening the exit gate 8, it is possible to keep the customer in the store and prevent them from taking out unpaid items.

[0084] As described above, according to this embodiment, it is possible to provide a monitoring system that can prevent items in the bottom row of a shopping cart from being taken out of the store without payment being made.

[0085] In practice, when an alert is issued, the content of the alert may be notified to a mobile terminal device carried by a store clerk, a store server, or the like.

[0086] In the above embodiment, the item S is checked against the detailed information, but this is not the only possible implementation. For example, an alert may be issued if it is determined that the appearance of the item S is highly likely to fall into a "classification" (item master) such as a cardboard box, a rice bag, or a tissue box containing multiple packs.

[0087] In addition, in the above embodiment, the inquiry processing unit 102, image processing unit 103, and judgment processing unit 104 are provided in the store server 1, but this is not the only option for implementation, and they may be provided in other devices (for example, sales data processing devices such as the exit gate 8 or the POS terminal 3).

[0088] Furthermore, in implementation, steps S1 and S2 of the above embodiment may be configured to read the code symbols on multiple receipts. With this configuration, when a customer leaves the store after making multiple payments, the item S can be checked against the detailed information related to all payments, thereby avoiding the inconvenience of an alert being issued even though the item S has already been paid for.

[0089] Furthermore, in implementation, the receipt ID may be associated with the image data output by the image capture unit 88 and stored in a specified storage unit. In this way, the situation surrounding the alert can be confirmed later from the captured image.

[0090] The above-described embodiment can be modified as needed by partially changing the configuration or functions of each of the above-described devices. Therefore, several modifications of the above-described embodiment will be described below as other embodiments. The following mainly describes differences from the above-described embodiment, and the same reference numerals will be used for common features with the content already described, and detailed description will be omitted. The modifications described below may be implemented individually or in appropriate combination.

[0091] (Second embodiment) FIG. 8 is a diagram for explaining monitoring of the lower level of the shopping cart Q by the fully self-service terminal 5 in the second embodiment.

[0092] The self-service terminal 5 is equipped with a display unit 55, an operation unit 56, a code reader 37, an imaging unit 38, a cash deposit / withdrawal unit 40, and a receipt printer 61, which are generally similar to the display unit 35, operation unit 36, code reader 37, imaging unit 38, cash deposit / withdrawal unit 40, and receipt printer 41 that are equipped in the POS terminal 3. The self-service terminal 5 also has a built-in control unit 50 and memory unit 59, which are generally similar to the control unit 30 and memory unit 39 of the POS terminal 3. The memory unit 59 stores registration information 393, similar to the memory unit 39. The self-service terminal 5 is also equipped with an imaging unit 88, which was equipped in the exit gate 8 in the first embodiment, on the lower right side.

[0093] In this embodiment, the right side of the self-service terminal 5 is designated as the position where the shopping cart Q is placed. The imaging unit 88 of the self-service terminal 5 is provided in a position where it can capture an image of the area where the lower level of the shopping cart Q is located. As a result, when the shopping cart Q is in a predetermined position, if an item S is placed on the lower level, the imaging unit 88 captures an image of the item S.

[0094] The control unit 50 of the full-self terminal 5 functions as the registration processing unit 301, the payment processing unit 302, the image capture processing unit 803, and the notification processing unit 805 of the first embodiment. Note that the notification processing unit 805 in this embodiment uses, for example, the display unit 55 of the full-self terminal 5 as a notification unit, and issues an alert by appropriately operating the notification unit, i.e., the display unit 55.

[0095] When the customer completes the registration process and performs an operation to move on to the payment process, the control unit 50 of the full-self terminal 5 checks whether an item S is present in the bottom row of the shopping cart Q based on the output of the imaging unit 88. If it is determined that an item S is present, the control unit 50 performs an identification process to determine whether the item S is a product registered in the registration information 393. If the item S is not registered in the registration information 393, the control unit 50 issues an alert by displaying information on the display unit 55, for example.

[0096] The alert may be, for example, "Are there any unregistered products in the bottom row of your shopping cart?" When issuing this alert, the full-self-service terminal 5 may sound a buzzer or speaker if it is equipped with one, or may light up an LED or lamp if it is equipped with one.

[0097] After the alert is issued, for example, if no additional product registration is made, or if it is not detected (based on the output of the imaging unit 88) that the item S has been removed from the bottom shelf of the shopping cart Q, the control unit 50 may be configured to take further action. Such further action may include, for example, executing a process to call a store clerk.

[0098] In this way, according to the second embodiment, it is possible to prevent the items S in the lower part of the shopping cart Q at the fully self-service terminal 5 from being left unregistered and unpaid for.

[0099] The programs executed by each device in the above-described embodiments are provided in advance in a ROM, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0100] Furthermore, the programs executed by each device in the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device in the above-described embodiments may be provided or distributed via a network such as the Internet.

[0101] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0102] 1...Store server, 10...control unit, 101...update processing unit, 102...inquiry processing unit, 103...image processing unit, 104...determination processing unit, 11...CPU (an example of a processor), 12...ROM, 13...RAM, 14...communication unit, 19...Memory section, 191...Program, 192...Product master, 193...Transaction information, 194...Member information, 2...router, 3...POS terminal (an example of a sales data processing device), 30...control unit, 301...registration processing unit, 302...payment processing unit, 31...CPU (an example of a processor), 32...ROM, 33...RAM, 34...communication unit, 35...display unit, 36...operation unit, 37...code reader, 38...imaging unit, 39...Memory unit, 391...Program, 392...Product master, 393...Registered information, 40... deposit and withdrawal unit, 41... receipt printer, 42... notification unit, 5...Fully self-service terminals, 50...control unit, 55...display unit, 56...operation unit, 57...code reader, 58...imaging unit, 59...storage unit, 60...deposit / withdrawal unit, 61...receipt printer, 6...Registration machine, 7. Accounting machine, 8...Exit gate, 80...control unit, 802...reading processing unit (an example of an acquisition unit), 803...imaging processing unit, 804...opening / closing processing unit, 805...notification processing unit, 81...CPU (an example of a processor), 82...ROM, 83...RAM, 84...communication unit, 85...device, 86...door, 87...code reader, 88...imaging unit, 89...memory unit, 891...program, 92...alarm unit, 93...motor. [Prior art documents] [Patent documents]

[0103] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-243082 [Patent Document 2] WO2021 / 124584 publication [Patent Document 3] Japanese Patent Publication No. 2022-035589

Claims

1. a store exit gate that has a door that blocks a passageway to the store entrance and that opens and closes said door in response to a predetermined process; and a sales data processing device that performs a registration process for registering information on products purchased by customers in a predetermined storage unit and a payment process for the products registered in said storage unit, said monitoring system including: Acquire an identifier of the receipt displayed on the receipt issued by the sales data processing device; analyzing whether the shopping cart is included in the image captured of the area where the lower level of the shopping cart is located and whether any items are placed on the lower level; When it is determined that an article is placed on the lower level, it is determined whether the article is included in the information corresponding to the identifier and registered in the storage unit; opening the door when it is determined that the information registered in the storage unit includes information on the item, and otherwise maintaining the door blocking the passage; Surveillance system.

2. If the item determined to be placed on the lower level is information corresponding to the identifier and is not included in the information registered in the storage unit, an alert indicating this is given by visual information or audio information. The monitoring system of claim 1 .

3. The alert is notified at the exit gate. The monitoring system of claim 2 .

4. A sales data processing device that executes a registration process for registering information on products purchased by a customer in a predetermined storage unit through an operation by the customer, and a payment process for making payment for the products whose information has been registered in the storage unit, an imaging unit that captures an image of the area in which the lower level of the shopping cart is located; an image processing unit that performs processing to analyze whether a shopping cart is included in the captured image output by the imaging unit and whether an item is placed on the lower shelf; a determination processing unit that, when the image processing unit determines that an item is placed on the lower level, determines whether the item is included in the information registered in the storage unit when transitioning from the registration processing to the payment processing; and A sales data processing device comprising:

5. a notification processing unit that, when it is determined by the determination processing unit that the information registered in the storage unit does not include information about the item, issues an alert indicating that fact by visual information or audio information. The sales data processing device of claim 4 further comprising:

6. a sales data processing device computer that has an imaging unit that captures an image of the area where the bottom shelf of the shopping cart is located, and that executes a registration process that registers information about products purchased by a customer in a predetermined storage unit through an operation by the customer, and a payment process that performs payment for the products whose information is registered in the storage unit; an image processing function that performs processing to analyze whether a shopping cart is included in the captured image output by the imaging unit and whether an item is placed on the lower shelf; a determination processing function that, when the image processing function determines that an item is placed on the lower shelf, determines whether the item is included in the information registered in the storage unit; and A program to achieve this.

Images