Store exit management system, store exit management method, and program

Abstract

To provide a store leaving management system capable of supporting a countermeasure against an abnormality with a commodity carried by a leaving customer when the registration and the settlement are performed for the commodity through a portable terminal operated by the customer.SOLUTION: A store leaving management system according to the present disclosure includes: code acquisition means that, when the registration and the settlement are performed for a commodity through a portable terminal operated by a customer, acquires a settlement completion code from the portable terminal; paid commodity information acquisition means that acquires the number of paid commodities related to the settlement completion codes; estimation means that estimates the number of commodities carried by a customer from an image obtained by capturing luggage of the leaving customer; abnormality detection means that detects an abnormality on the basis of the acquired number of the paid commodities and the estimated number of the carried commodities; and abnormality output means that outputs detection of the abnormality.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a store exit management system and the like.

Background Art

[0002] There are stores where customers can register and settle goods through operations on a terminal. At the gates or counters of such stores, customer exits may be managed by having the customer scan the terminal.

[0003] Patent Document 1 discloses a system in which customers register goods using a portable terminal. In Patent Document 1, when the terminal is returned to the terminal management device, settlement processing for the registered goods is performed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When goods are registered and settled by a customer's operation, there may be a difference between the quantity of the registered and settled goods and the quantity of the goods taken out. For example, a difference occurs when a customer takes out goods without settlement or when a customer forgets the settled goods in the store. When such a difference occurs, it is preferable for the customer or the store clerk to take measures.

[0006] An object of the present disclosure is to provide a store exit management system and the like that can assist in dealing with abnormalities that occur with respect to the goods taken out by a customer leaving the store when goods are registered and settled via a portable terminal operated by the customer.

Means for Solving the Problems

[0007] The store exit management system described herein includes, when a customer registers and settles a payment for goods via a portable terminal operated by the customer, a code acquisition means for acquiring a settled code from the portable terminal, a settled product information acquisition means for acquiring the quantity of settled goods associated with the settled code, an estimation means for estimating the quantity of goods taken out by the customer from an image of the customer's luggage as they leave the store, an anomaly detection means for detecting an anomaly based on the acquired quantity of settled goods and the estimated quantity of goods taken out, and an anomaly output means for outputting that an anomaly has been detected.

[0008] The store exit management method described herein involves, when a customer registers and settles payment for goods via a portable terminal operated by the customer, obtaining a settled code from the portable terminal, obtaining the quantity of settled goods associated with the settled code, estimating the quantity of goods to be taken out by the customer from an image of the customer's luggage as they leave the store, detecting an anomaly based on the obtained quantity of settled goods and the estimated quantity of goods to be taken out, and outputting a message indicating that an anomaly has been detected.

[0009] The program relating to this disclosure causes a computer to perform the following processes when a customer registers and settles a purchase via a portable terminal operated by the customer: obtaining a settled code from the portable terminal, obtaining the quantity of settled items associated with the settled code, estimating the quantity of items taken out by the customer from an image of the customer's luggage as they leave the store, detecting an anomaly based on the obtained quantity of settled items and the estimated quantity of items taken out, and outputting that an anomaly has been detected. The program may be stored on a non-temporary recording medium that is readable by the computer. [Effects of the Invention]

[0010] According to this disclosure, when products are registered and paid for via a portable terminal operated by the customer, it is possible to assist in dealing with any abnormalities related to the products that the customer takes with them as they leave the store. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing an example configuration of a store system according to the first embodiment. [Figure 2] This is a schematic diagram showing an example of the reader and camera installation. [Figure 3] This is a schematic diagram showing other installation examples for the reader and camera. [Figure 4] This is a block diagram showing an example configuration of the portable terminal 20. [Figure 5] This figure shows an example of a screen displaying a completed payment code. [Figure 6] This is a flowchart showing an example of operation according to the first embodiment. [Figure 7] This is a block diagram showing an example configuration of a store system according to the second embodiment. [Figure 8] This is a flowchart showing an example of operation according to the second embodiment. [Figure 9] This is a block diagram showing an example configuration of a store system according to the third embodiment. [Figure 10] This is a flowchart showing an example of operation according to the third embodiment. [Figure 11] This is a block diagram showing an example of a computer hardware configuration. [Modes for carrying out the invention]

[0012] Embodiments of the store exit management system, store exit management method, program, and recording medium for non-temporarily recording the program relating to this disclosure will be described below with reference to the drawings. These embodiments are not intended to limit the disclosed technology.

[0013] [First Embodiment] The checkout management system 100 according to the first embodiment is a system that manages the quantity of products taken out by a customer when leaving the store and the quantity of products settled by the customer. The checkout management system 100 is used as the store system 1. FIG. 1 is a block diagram showing a configuration example of the store system 1 according to the first embodiment. The checkout management system 100 includes a code acquisition unit 101, a settled product information acquisition unit 102, an estimation unit 103, an abnormality detection unit 104, and an abnormality output unit 105.

[0014] In addition to the checkout management system 100, the store system 1 includes a POS (Point of Sales) server 31, a product database 32, and a sales database 33. The checkout management system 100, the POS server 31, the product database 32, and the sales database 33 are communicably connected by wire or wirelessly as appropriate according to the specific configuration of each system. Further, the POS server 31 is communicably connected to the portable terminal 20 by wire or wirelessly. The portable terminal 20 is a terminal operated by a customer.

[0015] The POS server 31 manages various information regarding products sold in the store, for example. The POS server 31 may be an application server. In addition to the portable terminal 20, the POS server 31 may also manage the registration and settlement of products using other terminals other than the portable terminal 20, such as a POS terminal operated by a store clerk. That is, in the store, either the existing POS terminal or the portable terminal 20 may be used for product registration and settlement.

[0016] In addition, the POS server 31 transmits a settled code to the portable terminal 20. The transmitted settled code is held by the portable terminal 20. The settled code is not particularly limited as long as it indicates that the customer has completed settlement. The settled code is also associated with information regarding settlement. Information regarding settlement includes, for example, the number of settled products, the identification information of the settled products, or the total amount. Since the settled code is used when the customer leaves the store, it is also called a checkout code.

[0017] As the settled code, for example, a settlement ID (Identifier) may be used. The settlement ID uniquely identifies each settlement. Also, as the settled code, a transaction ID or a customer ID may be used. The transaction ID uniquely identifies each transaction by treating the period from the start of the product registration process to the completion of the settlement as one transaction. Also, the customer ID uniquely identifies the customer. The transaction ID and the customer ID can be used as the settled code by being associated with information indicating that the settlement has been completed, for example.

[0018] The product database 32 stores, for each product, the identification information of the product and the information of the product in association with each other. For example, when the identification information of the product is a product code, the information of the product is information such as the name of the product and the price of the product. Note that the information of the product is not particularly limited.

[0019] The sales database 33 stores, for example, information regarding sales for each store. Also, the sales database 33 manages, for example, information regarding each settlement for each store. The sales database 33 may store the settled code in association with the information regarding each settlement.

[0020] Also, the store system 1 includes a reader 41 and a camera 42. A plurality of readers 41 and cameras 42 may be provided respectively. The reader 41 and the camera 42 are installed in the store. However, the camera 42 may be realized by the camera included in the portable terminal 20. The checkout management system 100 is communicably connected to the reader 41 and the camera 42 by wire or wirelessly.

[0021] The reader 41 reads the paid code from the portable terminal 20. The method by which the reader 41 reads the paid code is not particularly limited. For example, the reader 41 may read a barcode or a two-dimensional code that encodes the paid code displayed on the display of the portable terminal 20. Alternatively, the reader 41 may receive the paid code from the portable terminal 20 via wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), or Bluetooth (registered trademark). The reader 41 transmits the read paid code to the code acquisition unit 101 of the exit management system 100.

[0022] Camera 42 photographs the customer's belongings. Then, camera 42 transmits the captured image to the store exit management system 100.

[0023] A package is at least one object carried by a customer. Camera 42 may photograph a package placed in front of camera 42. Alternatively, camera 42 may photograph the package being carried by a customer by photographing the customer holding the package.

[0024] Camera 42, for example, takes images of a customer's belongings as they leave the store. In this case, camera 42 may be installed near the exit of the store.

[0025] Figure 2 is a schematic diagram showing an example of the installation of the reader 41 and the camera 42. The reader 41 is installed, for example, on the counter. The camera 42 is installed, for example, from above the counter so as to be able to photograph the luggage placed on the counter. Customer C1, for example, places luggage C2 on the counter before leaving the store and has the reader 41 read the payment code displayed on the portable terminal 20. After having the reader 41 read the payment code, customer C1 leaves the store.

[0026] Figure 3 is a schematic diagram showing other installation examples of the reader 41 and camera 42. The reader 41 is installed, for example, at the exit gate 44. The exit gate 44 is the gate through which customers pass when leaving the store. The exit gate 44 is made passable to customers when a payment code is presented. The camera 42 is installed, for example, to photograph customers passing through the exit gate 44. Customer C1, for example, carries luggage C2 and has the reader 41 read the payment code displayed on the portable terminal 20. After the payment code is read, customer C1 passes through the exit gate 44.

[0027] The installation examples of the reader 41 and camera 42 are not limited to those shown above. The reader 41 and camera 42 may be installed in other locations within the store. In other words, the reading of the paid code and the capture of the image may be performed in different locations.

[0028] In the first embodiment, a case will be described in which the store system 1 further includes a detection anomaly database 34 and a notification device 43. The store system 1 does not necessarily have to include the detection anomaly database 34 and the notification device 43. The store exit management system 100 is connected to the detection anomaly database 34 and the notification device 43 in a communicative manner.

[0029] The detection anomaly database 34 stores anomalies detected by the store exit management system 100. The notification device 43 may refer to the detection anomaly database 34 and notify the detected anomaly upon request from the store manager.

[0030] The notification device 43 notifies the store exit management system 100 of any abnormalities detected. The notification device 43 may be, for example, a display, a speaker, or a lamp. Multiple notification devices 43 may be installed in the store. The notification device 43 may notify customers who are leaving the store of any abnormalities. The notification device 43 may also notify store employees of any abnormalities. In this case, the notification device 43 may be a terminal operated by the store employee.

[0031] The notification device 43 may be installed on the counter where the reader 41 is located. Alternatively, the notification device 43 may be installed at the exit gate 44 as shown in Figure 3. By installing the notification device 43 near the reader 41, the notification device 43 can notify customers who are leaving the store of any abnormalities. The notification device 43 can also notify store employees and other customers who are near the customer who is leaving the store of any abnormalities.

[0032] The store exit management system 100, POS server 31, and each database related to store system 1 may be installed, for example, in the back room of the store, but the installation location is not particularly limited. Some of the devices constituting store system 1 may be implemented by a cloud server.

[0033] Each system related to store system 1, including the store exit management system 100, the POS server 31, and each database, may be implemented by separate information processing devices. Alternatively, the functions of each system may be implemented by a single information processing device. For example, each database related to store system 1 may be included in the information processing device that implements the POS server 31. Furthermore, each system may be implemented by a combination of multiple information processing devices.

[0034] The portable terminal 20 is, for example, a mobile device such as a smartphone or tablet. The type of portable terminal 20 is not particularly limited. The portable terminal 20 may be owned by the customer or rented out by the store. The portable terminal 20 may be attached to a shopping basket or shopping cart, or it may be provided integrally with the shopping basket or shopping cart. If the portable terminal 20 is attached to a shopping cart, the shopping cart may be self-propelled by, for example, having movable parts such as tires and a drive device such as a motor.

[0035] Figure 4 is a block diagram showing an example configuration of a portable terminal 20. The portable terminal 20 comprises a processing unit 21 and a storage unit 22. The following functions of the processing unit 21 may be realized by installing an application program in the storage unit 22. The processing unit 21 may not have some of the functions described below.

[0036] The configurations of store system 1 and portable terminal 20 are described in more detail below.

[0037] <Enter identification information> The processing unit 21 of the portable terminal 20 accepts input of product identification information. The POS server 31 may display a screen for accepting input of identification information.

[0038] The processing unit 21 receives input of product identification information, for example, via a camera (not shown). The camera is not particularly limited, but for example, it is a camera provided by the portable terminal 20. The processing unit 21 may also receive input of identification information by reading the one-dimensional code or two-dimensional code of the product captured by the imaging device. Alternatively, the processing unit 21 may also receive input of identification information by identifying the product from an image of the product captured by the imaging device using image recognition technology.

[0039] Furthermore, the processing unit 21 may obtain identification information by reading a tag to which an RFID (Radio Frequency Identifier) ​​has been attached via a reader. When using RFID, the reader is an RFID reader.

[0040] Furthermore, the processing unit 21 may accept product identification information by accepting product selection from the product search results. For example, the method of product search is not particularly limited. Product search may be performed using text or images. For example, the processing unit 21 may accept input of identification information by accepting product selection from the displayed product images.

[0041] Furthermore, the processing unit 21 may accept input of identification information by receiving numbers such as product codes via an input device (not shown). Examples of input devices include touch panel displays and keyboards capable of inputting numbers and characters.

[0042] The processing unit 21 of the portable terminal 20 transmits the identification information of the received products as described above to the POS server 31. For products that have been registered after transmitting the identification information, the processing unit 21 may display product information in accordance with the control of the POS server 31.

[0043] <Product Registration> The POS server 31 registers products based on identification information received from the portable terminal 20. The POS server 31 refers to the product database 32 and retrieves product information. Then, the POS server 31 uses the retrieved product information to register the products that the customer will purchase. As part of the product registration process, the POS server 31 generates a list of registered products for each customer, for example.

[0044] <Processing related to settlement> Furthermore, the processing unit 21 of the portable terminal 20 executes processing related to the settlement of registered products. The following describes cases where settlement is performed via a payment server and cases where settlement is performed using a settlement device installed in the store. However, the settlement method is not limited to these.

[0045] If settlement is performed via a settlement server, the processing unit 21 of the portable terminal 20 may communicate with a settlement server (not shown) and instruct the settlement server to perform the settlement. For example, the processing unit 21 sends the settlement instruction to the settlement server, including payment information and settlement information. The payment information is information that identifies the customer's credit card, debit card, electronic money, or points, etc. The settlement information is information that identifies the registered product or the purchase amount of the registered product, etc. The settlement server performs cashless payment using the payment information and settlement information. For example, the settlement server notifies the portable terminal 20 and the POS server 31 of the completion of the settlement.

[0046] Furthermore, the processing unit 21 of the portable terminal 20 may issue settlement instructions to the payment server via the POS server 31 or the store exit management system 100. In addition, some or all of the functions of the payment server may be implemented by the store exit management system 100 or the POS server 31.

[0047] Alternatively, if payment is made using a payment device installed in the store, the processing unit 21 of the portable terminal 20 may output information identifying the payment information to the payment device as part of the payment processing. The information identifying the payment information is stored in the POS server 31, for example, in association with the payment information. Based on the information identifying the payment information that the payment device has received, the payment device obtains the payment information from the POS server 31, for example. Based on the obtained payment information, the payment device performs the payment process by any method, such as cash payment or cashless payment. The payment device notifies the portable terminal 20 and the POS server 31, for example, of the completion of the payment.

[0048] The method for outputting information identifying the settlement information to the settlement device is not particularly limited. For example, the processing unit 21 may display a barcode or a two-dimensional code encoding the information identifying the settlement information on the display of the portable terminal 20. The settlement device reads the information identifying the settlement information displayed on the display. Alternatively, the processing unit 21 may transmit the information identifying the settlement information to the settlement device via wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0049] The processing unit 21 may also output settlement information to the settlement device as part of the settlement process. In this case, the settlement device will obtain the settlement information from the portable terminal 20.

[0050] The POS server 31 stores settlement information in the sales database 33. After settlement is complete, the POS server 31 sends a settlement code to the portable terminal 20.

[0051] <Detection of anomalies> The code acquisition unit 101 of the store exit management system 100 acquires a paid code from the portable terminal 20 when product registration and payment are performed via the portable terminal 20.

[0052] The code acquisition unit 101 of the store exit management system 100 acquires the settled code from the portable terminal 20 via the reader 41. In this case, the processing unit 21 of the portable terminal 20 first outputs the settled code.

[0053] For example, the processing unit 21 transmits a settled code to the reader 41 via wireless communication.

[0054] Alternatively, the processing unit 21 displays a barcode or 2D code encoding the paid code on the display of the portable terminal 20. Figure 5 shows an example of the display screen for the paid code shown on the portable terminal 20. In the display screen of Figure 5, a 2D code encoding the paid code is displayed. Before leaving the store, the customer has the reader 41 read the barcode displayed on the portable terminal 20.

[0055] Then, the code acquisition unit 101 acquires the settled code read from the reader 41.

[0056] The settlement product information acquisition unit 102 acquires the quantity of settlement products associated with the settlement code. For example, the settlement product information acquisition unit 102 refers to the sales database 33 and acquires the quantity of settlement products associated with the settlement code.

[0057] The quantity of settled goods may be the number of settled goods. Alternatively, the quantity of settled goods may be the volume of settled goods. The settled goods information acquisition unit 102 may, for example, estimate the volume of goods from the number of settled goods. Or, the settled goods information acquisition unit 102 may obtain the volume of settled goods by referring to the volume of goods stored in the goods database 32.

[0058] The estimation unit 103 estimates the quantity of goods taken by a customer from an image of the customer's luggage as they leave the store. The quantity of goods taken may be the number of items taken, or it may be the volume of the items taken.

[0059] The following describes how to estimate the quantity of goods to be taken out.

[0060] The estimation unit 103 acquires, for example, an image of a customer's luggage as they leave the store from the camera 42. The estimation unit 103 recognizes the luggage from the acquired image. The estimation unit 103 may also recognize products as luggage. The estimation unit 103 may also recognize products inside a container from an image of the inside of the container. The container for products may be, for example, a bag, paper bag, plastic bag, cardboard box, or shopping basket. The estimation unit 103 may estimate the quantity of recognized products as the quantity of products being taken out.

[0061] When products are in a container, it can be difficult to recognize all of the products. For example, if an image of a customer's luggage is taken from outside the container, the products inside the container may not be visible. Therefore, the estimation unit 103 may recognize the container as part of the luggage. The estimation unit 103 may then recognize the volume of the container using existing techniques for measuring size based on images. Furthermore, if a customer places products into a container with a known volume, the estimation unit 103 may recognize the volume of the container by recognizing the type of container. The estimation unit 103 may then estimate the volume of the container thus recognized as the quantity of products being carried out.

[0062] For example, the volume of a plastic bag can increase as more items are placed inside. Therefore, it is possible to estimate the volume of the plastic bag as the volume of the items placed inside.

[0063] Furthermore, customers may not fill the container to its full capacity. Therefore, the estimation unit 103 may estimate the quantity of goods inside the container as the quantity of goods to be taken out.

[0064] The estimation unit 103 may estimate the amount of goods in a container by using the proportion of the container's volume that the goods occupy. The estimation unit 103 may recognize the container's volume using existing techniques for measuring size based on images. Also, when a customer places goods in a container with a known volume, the estimation unit 103 may recognize the container's volume by recognizing the type of container. For example, the estimation unit 103 recognizes the position of the top layer of goods in the container from the image. Furthermore, the estimation unit 103 recognizes the bottom and top of the container from the image. The estimation unit 103 then calculates the proportion of the container's volume that the goods occupy by dividing the height from the bottom of the container to the position of the top layer of goods by the height of the container. The estimation unit 103 may estimate the amount of goods in the container by multiplying the container's volume by the proportion of goods occupying it.

[0065] Furthermore, the estimation unit 103 may estimate the amount of goods in the container using the amount of goods on the top layer and the number of layers of goods in the container. For example, the estimation unit 103 recognizes the goods on the top layer from an image taken from above of the inside of the container. The estimation unit 103 also recognizes the position of the goods on the top layer and the position of the bottom of the container from the image. Furthermore, the estimation unit 103 estimates the number of layers of goods in the container from the height from the bottom of the container to the goods on the top layer. The estimation unit 103 may then estimate the total amount of goods in the container as the value obtained by multiplying the amount of goods on the surface by the estimated number of layers of goods.

[0066] For example, consider a scenario where a customer places paid-for items into a shopping basket and takes them out of the store. If the volume of the shopping basket is known, the estimation unit 103 can estimate the volume of the items inside the basket based on the position of the items on the top layer of the basket.

[0067] The estimation unit 103 may estimate the number of items to be taken out based on the volume of the items to be taken out. For example, the estimation unit 103 may estimate the number of items to be taken out by dividing the estimated volume of the items to be taken out by the average volume of the items.

[0068] Furthermore, the estimation unit 103 may estimate the quantity of goods to be taken out from images of the customer's luggage as they leave the store and images of the customer's luggage before they pick up the goods to be taken out.

[0069] Camera 42, for example, takes an image of a customer's luggage before they pick up the goods to be taken out. Camera 42, which takes an image of a customer before they pick up the goods, may be installed, for example, near the entrance of the store. The estimation unit 103 acquires the image from camera 42.

[0070] The estimation unit 103, for example, recognizes the customer's luggage for each image and estimates the volume of the recognized luggage. The estimation unit 103 may also estimate the amount of goods being taken out by subtracting the volume of luggage recognized for the customer before they picked up the goods from the volume of luggage recognized for the customer leaving the store.

[0071] For example, a customer may place purchased items into a bag they brought with them. The bag may also contain items that the customer brings into the store from outside. Camera 42 transmits an image of the bag before the customer puts items into it, for example, near the entrance, to the estimation unit 103. Camera 42 also transmits an image of the bag after the customer puts items into it, near the exit, to the estimation unit 103. The estimation unit 103 may then calculate the volume of the bag from each image and estimate the amount of goods being taken out.

[0072] For example, a customer may register which bag they will put the items in before picking them up from the store. Alternatively, a customer may register their bag by having camera 42 photograph the bag they brought with them.

[0073] Furthermore, the estimation unit 103 may perform object recognition on each piece of luggage included in the image. For example, the estimation unit 103 may recognize the objects that are being taken out as the items being taken out, by subtracting the objects that were also recognized in the image of the luggage of a customer leaving the store from the objects that were also recognized in the image of the luggage before the customer picked up any items from the store.

[0074] The above describes methods for estimating the quantity of goods to be taken out. These methods may be used in combination. Furthermore, the methods for estimating the quantity of goods to be taken out are not limited to the examples given above.

[0075] The recognition of the customer's luggage may be performed by camera 42. Camera 42 may also transmit the recognition result to the store exit management system 100. The estimation unit 103 obtains the result of recognizing the customer's luggage from camera 42.

[0076] The anomaly detection unit 104 detects an anomaly based on the quantity of paid-for goods acquired by the paid-for goods information acquisition unit 102 and the quantity of goods being taken out estimated by the estimation unit 103. An anomaly occurs when there is a difference between the quantity of paid-for goods and the quantity of goods being taken out. For example, if the quantity of goods being taken out is greater than the quantity of paid-for goods, it is possible that unpaid goods have been illegally taken out by a customer. Also, if the quantity of goods being taken out is less than the quantity of paid-for goods, it is possible that a customer has left paid-for goods behind in the store. Therefore, the anomaly detection unit 104 detects an anomaly based on the difference between the quantity of paid-for goods and the quantity of goods being taken out.

[0077] The anomaly detection unit 104 may detect an anomaly if the amount of goods to be taken out, as estimated by the estimation unit 103, is greater than the amount of goods that have been settled, as obtained by the settlement product information acquisition unit 102. In other words, the anomaly detection unit 104 may detect an anomaly if it is estimated that there are goods among those to be taken out that have not been settled.

[0078] Furthermore, the anomaly detection unit 104 may detect an anomaly if the amount of goods to be taken out, as estimated by the estimation unit 103, is less than the amount of goods that have been paid for, as acquired by the payment item information acquisition unit 102. In other words, the anomaly detection unit 104 may detect an anomaly, for example, if it is estimated that there are goods left behind in the store despite having been paid for.

[0079] When the anomaly detection unit 104 detects an anomaly, a threshold may be set for the difference between the amount of goods that have been paid for and the amount of goods that are being taken out. For example, the anomaly detection unit 104 may detect an anomaly when the difference between the amount of goods being taken out and the amount of goods that have been paid for exceeds the threshold. Setting a threshold can suppress the number of anomalies that are detected.

[0080] The threshold may be set according to the estimation accuracy of the quantity of goods taken out. If the difference between the quantity of goods taken out and the quantity of goods that have been paid for is small, the anomaly detection unit 104 may falsely detect an anomaly. Therefore, for example, if the estimation accuracy of the estimation unit 103 is low, the threshold may be set high. If the difference does not exceed the threshold, the anomaly detection unit 104 may determine that it is an error in the estimation.

[0081] Furthermore, the threshold may be set according to the items purchased by the customer. Depending on the item, it may be difficult to recognize the volume from the image, which may reduce the estimation accuracy by the estimation unit 103. Therefore, if the items purchased by the customer include items for which it is difficult to recognize the volume from the image, the threshold may be set higher.

[0082] Furthermore, the threshold may be set according to the amount of goods the customer has paid for. For example, the threshold may be set lower when the payment amount is high. This allows the anomaly detection unit 104 to detect an anomaly even if the difference in the quantity of goods is small for customers with high payment amounts. Therefore, if a customer who has made a large purchase may have left behind expensive items in the store, the anomaly detection unit 104 can appropriately detect the anomaly. Alternatively, the threshold may be set lower when the payment amount is low. This allows the anomaly to be appropriately detected even if the difference in the quantity of goods is small for customers who may be paying for less goods than they actually took with them, thereby lowering the payment amount.

[0083] Furthermore, the threshold may be set according to the level of congestion. The level of congestion may be the real-time level of congestion or the expected level of congestion for each time period. For example, the threshold may be set high when the store is crowded. This makes it more difficult to detect anomalies, thus preventing further congestion caused by checking for anomalies. Alternatively, the threshold may be set low when the store is crowded. This makes it easier to detect anomalies, thus preventing unpaid items from being taken out amidst the congestion.

[0084] Furthermore, thresholds may be set according to the customer. For example, for customers who have been detected as having anomalies in the past, the threshold may be set lower. This allows for the detection of anomalies in customers who are highly likely to engage in fraudulent activity.

[0085] The anomaly detection unit 104 may also notify the anomaly output unit 105 of the difference between the amount of goods that have been paid for and the estimated amount of goods that will be taken out, as the degree of the anomaly.

[0086] <Notification of an anomaly> The abnormality output unit 105 outputs that an abnormality has been detected. For example, the abnormality output unit 105 may output to the notification device 43 that an abnormality has been detected, causing the notification device 43 to notify the abnormality. Alternatively, the abnormality output unit 105 may output to the detection abnormality database 34 that an abnormality has been detected, causing the detected abnormality to be stored in the database.

[0087] Since the detected anomalies are stored in the detected anomaly database 34, store managers can check for anomalies even after the customer has left the store. The manager can then carefully observe the customer when they next visit the store.

[0088] The abnormality output unit 105 may cause the notification device 43 to output an alarm sound or an alarm display.

[0089] Alternatively, the abnormality output unit 105 may cause the notification device 43 to notify the number of paid-for items by voice or display, indicating that an abnormality has been detected. That is, if no abnormality is detected, the abnormality output unit 105 will not notify the number of paid-for items. Therefore, store staff or customers can determine whether or not an abnormality has been detected based on whether or not the number of paid-for items is notified. The abnormality output unit 105 may obtain the number of paid-for items from, for example, the abnormality detection unit 104, the paid-for item information acquisition unit 102, or the sales database 33. Note that other information related to paid-for items may be used instead of the number of paid-for items.

[0090] The abnormality output unit 105 may change the notification device 43 that outputs based on the difference between the amount of goods being taken out and the amount of goods that have been paid for. For example, if the amount of goods being taken out is greater than the amount of goods that have been paid for, the abnormality output unit 105 may cause the notification device 43 for store employees to notify that an abnormality has been detected. This allows, for example, store employees to check the customer's belongings to see if any goods have been taken out illegally. Also, if the amount of goods being taken out is less than the amount of goods that have been paid for, the abnormality output unit 105 may cause the notification device 43 for customers to notify that an abnormality has been detected. This allows, for example, customers to check if any goods have been left behind in the store.

[0091] The abnormality output unit 105 may output that an abnormality has been detected, depending on the degree of the detected abnormality.

[0092] For example, the abnormality output unit 105 may change the level of notification in the notification device 43 according to the difference between the amount of goods that have been paid for and the estimated amount of goods that will be taken out. For example, if the difference is large, the abnormality output unit 105 will cause the notification device 43 to execute a higher level of notification compared to when the difference is small. A higher level of notification is a notification that attracts more human attention.

[0093] If the difference is small, there is a possibility that the anomaly is being falsely detected, so a low level of notification may be issued. If the difference is large, there is a high probability that an anomaly has occurred, so a high level of notification may be issued. Also, if the difference is large, there is a possibility that more items have been taken out without being paid for, or that more paid items have been left behind in the store. Therefore, a higher level of notification that conveys a greater sense of urgency may be issued.

[0094] If the notification device 43 is a speaker, the abnormality output unit 105 may, for example, output a short notification sound to the speaker when the difference is small. The abnormality output unit 105 may also output an alarm sound to the speaker when the difference is large. If the notification device 43 is a display, the abnormality output unit 105 may, for example, display an abnormality in yellow when the difference is small, and display an abnormality in red when the difference is large.

[0095] Next, the operation of the store exit management system 100 will be described. Figure 6 is a flowchart showing an example of the operation of the store exit management system 100 according to the first embodiment. For example, the store exit management system 100 may start the process shown in Figure 6 in response to the reader 41 reading the settled code.

[0096] The code acquisition unit 101 of the store exit management system 100 acquires the settled code from the portable terminal 20 via the reader 41 (step S1). The code acquisition unit 101 notifies the settled product information acquisition unit 102 of the acquired settled code.

[0097] The settlement product information acquisition unit 102 acquires the quantity of settlement products associated with the settlement code (step S2). The settlement product information acquisition unit 102 notifies the anomaly detection unit 104 of the acquired quantity of settlement products.

[0098] The estimation unit 103 estimates the quantity of goods taken by a customer from an image of the customer's luggage as they leave the store (step S3). The estimation unit 103 notifies the anomaly detection unit 104 of the estimated quantity of goods taken by the customer.

[0099] The anomaly detection unit 104 detects an anomaly based on the quantity of goods that have been paid for and the estimated quantity of goods that will be taken out (step S4). The anomaly detection unit 104 notifies the anomaly output unit 105 of the detected anomaly. If no anomaly is detected, the store exit management system 100 terminates its operation.

[0100] The abnormality output unit 105 outputs a message indicating that an abnormality has been detected (step S5). For example, upon outputting an abnormality, the store exit management system 100 terminates its operation. The store exit management system 100 then repeats the above series of operations as appropriate, for example, for each customer.

[0101] According to the first embodiment, when product registration and payment are performed via the portable terminal 20, the code acquisition unit 101 acquires the paid code from the portable terminal 20. The paid product information acquisition unit 102 then acquires the quantity of the paid product associated with the paid code. The estimation unit 103 estimates the quantity of products to be taken by the customer from an image of the customer's luggage as they leave the store. Furthermore, the anomaly detection unit 104 detects an anomaly based on the quantity of paid products and the estimated quantity of products to be taken. The anomaly output unit 105 then outputs that an anomaly has been detected. Therefore, according to the first embodiment, when product registration and payment are performed via a portable terminal operated by the customer, it is possible to assist in dealing with anomalies related to products taken by the customer as they leave the store.

[0102] [Second Embodiment] Next, as a second embodiment, another example of the store system 1 equipped with a store exit management system 100 will be described. The configuration of the second embodiment is similar to that of the first embodiment in some respects. Therefore, similar configurations will not be described. Figure 7 is a block diagram showing an example of the configuration of the store system 1 according to the second embodiment.

[0103] The exit management system 100 according to the second embodiment differs from the exit management system 100 according to the first embodiment in that it includes a gate control unit 106.

[0104] In the second embodiment, the store system 1 further includes an exit gate 44. The exit management system 100 is communicated with the exit gate 44.

[0105] An example of the installation of the exit gate 44 is shown in Figure 3. However, the installation of the exit gate 44 is not limited to this example.

[0106] The gate control unit 106 controls whether the exit gate 44 is passable or impassable. For example, the gate control unit 106 may control the opening and closing of the exit gate 44. The gate control unit 106 may open the exit gate 44 to allow customers to pass through, and close the exit gate 44 to impassable customers.

[0107] The gate control unit 106 may make it impossible to pass through the exit gate 44 if an abnormality is detected. For example, the abnormality output unit 105 outputs to the gate control unit 106 that an abnormality has been detected. When the gate control unit 106 receives an output from the abnormality output unit 105 indicating that an abnormality has been detected, it makes it impossible to pass through the exit gate 44.

[0108] Next, the operation of the exit management system 100 according to the second embodiment will be described. Figure 8 is a flowchart showing an example of the operation of the exit management system 100 according to the second embodiment. For example, when the reader 41 installed at the exit gate 44 reads the settlement code, the exit management system 100 may start the process shown in Figure 8.

[0109] The code acquisition unit 101 of the store exit management system 100 acquires the settled code from the portable terminal 20 via the reader 41 (step S11). The code acquisition unit 101 notifies the settled product information acquisition unit 102 of the acquired settled code.

[0110] The settlement product information acquisition unit 102 acquires the quantity of settlement products associated with the settlement code (step S12). The settlement product information acquisition unit 102 notifies the anomaly detection unit 104 of the acquired quantity of settlement products.

[0111] The estimation unit 103 estimates the quantity of goods taken by a customer from an image of the customer's luggage as they leave the store (step S13). The estimation unit 103 notifies the anomaly detection unit 104 of the estimated quantity of goods taken by the customer.

[0112] The anomaly detection unit 104 detects an anomaly based on the quantity of goods that have been paid for and the estimated quantity of goods that will be taken out. If the anomaly detection unit 104 detects an anomaly (step S14; Yes), it notifies the anomaly output unit 105 of the detected anomaly.

[0113] The abnormality output unit 105 outputs to the gate control unit 106 that an abnormality has been detected (step S15). In response to the output indicating that an abnormality has been detected, the gate control unit 106 makes it impossible to pass through the exit gate 44 (step S16).

[0114] If the abnormality detection unit 104 does not detect an abnormality (step S14; No), it outputs to the gate control unit 106 that there is no abnormality. In response to the output that there is no abnormality, the gate control unit 106 makes the exit gate 44 passable (step S17).

[0115] For example, the store exit management system 100 terminates its operation when the gate control unit 106 controls the gate.

[0116] According to the second embodiment, if an abnormality is detected, the gate control unit 106 makes it impossible to pass through the exit gate 44. Therefore, according to the second embodiment, if there is an abnormality with respect to the goods being taken out, it is possible to control the system so that the customer is not allowed to leave the store.

[0117] [Third Embodiment] Next, as a third embodiment, yet another example of the store system 1 equipped with a store exit management system 100 will be described. The configuration of the third embodiment is similar to that of the first embodiment in some respects. Therefore, similar configurations will not be described. Figure 9 is a block diagram showing an example of the configuration of the store system 1 according to the third embodiment.

[0118] The exit management system 100 according to the third embodiment differs from the exit management system 100 according to the first embodiment in that it includes a settlement product information output unit 107. Furthermore, the store system 1 according to the third embodiment includes a notification device 43.

[0119] The settlement product information output unit 107 outputs the number of settled products to the notification device 43 in response to the acquisition of settled code. In the third embodiment, the settlement product information output unit 107 causes the notification device 43 to notify the number of settled products regardless of whether an abnormality has been detected or not.

[0120] The settlement product information output unit 107 obtains the number of settled products, for example, from the settlement product information acquisition unit 102. The settlement product information output unit 107 then outputs the obtained number of settled products to the notification device 43.

[0121] In the third embodiment, the notification device 43 notifies the number of paid-for items that have been output. The notification device 43 is, for example, a display or a speaker. Also, as in the first embodiment, the notification device 43 notifies any abnormalities detected by the store exit management system 100.

[0122] The notification device 43 may also notify the customer of the number of items that have been paid for. This allows the customer to know that the number of items they have paid for is known as they leave the store. Therefore, it is expected that this will deter customers from leaving the store without paying for some items.

[0123] Furthermore, the notification device 43 may also notify the store clerk of the number of items that have been paid for. This allows the clerk to check if there is any discrepancy between the quantity of items taken out by the customer as they leave the store and the number of items that have been paid for. In other words, a double check is achieved: anomaly detection by the exit management system 100 and confirmation of the anomaly by the store clerk.

[0124] Alternatively, other information regarding the settled items may be used and reported instead of the number of settled items.

[0125] Figure 10 is a flowchart showing an example of the operation of the store exit management system 100 according to the third embodiment. For example, the store exit management system 100 may start the process shown in Figure 10 in response to the reader 41 reading the settled code.

[0126] The flowchart in Figure 10 includes the basic operation of the store exit management system 100 in the flowchart of Figure 6 according to the first embodiment. Therefore, the differences between the flowchart in Figure 10 and the flowchart in Figure 6 will be explained below.

[0127] In step S2, for example, the settlement product information acquisition unit 102 notifies the settlement product information output unit 107 of the number of settlement products out of the total quantity of settlement products.

[0128] After step S2, the settlement product information output unit 107 outputs the number of settled products to the notification device 43 (step S22). The notification device 43 receives the output and notifies the number of settled products.

[0129] The operation after step S22 is as described with reference to Figure 6. If no abnormality is detected (step S4; No), the store exit management system 100 terminates its operation.

[0130] The timing of step S22 is not particularly limited, as long as it is performed after step S2. For example, step S22 may be performed after an abnormality is detected in step S4. In this case, the settlement product information output unit 107 may obtain the number of settled products from the abnormality detection unit 104.

[0131] Furthermore, the timing at which the notification device 43 notifies the number of items that have been paid for is not particularly limited. For example, the notification device 43 may notify the number of items that have been paid for at the same time as notifying that an abnormality has been detected.

[0132] According to the third embodiment, the settlement product information output unit 107 outputs the number of settled products to the notification device 43 in response to the acquisition of a settled code. The notification device 43 then notifies the number of settled products. Therefore, according to the third embodiment, for example, abnormalities related to products taken out by customers leaving the store can be suppressed. Furthermore, according to the third embodiment, for example, store staff can be assisted in checking whether there is a difference between the quantity of products taken out by customers leaving the store and the number of settled products.

[0133] [Differentiation] Each of the above embodiments may be used in a modified form. The store exit management system 100 is applicable whether the customer is a single individual or a group of multiple customers. When the customer is a group, each customer belonging to the group is associated with a single settlement code. The estimation unit 103 can then estimate the total amount of goods taken by the group from images of each customer's luggage. According to this modification, even when a representative of the group settles the payment and multiple customers cooperate to take out the goods, any abnormalities regarding the goods being taken can be detected.

[0134] [Hardware configuration] In each of the embodiments described above, each component of the store exit management system 100 represents a functional unit block. Some or all of the components of the store exit management system 100 may be implemented by any combination of computer 500 and program.

[0135] Figure 11 is a block diagram showing an example of the hardware configuration of computer 500. Referring to Figure 11, computer 500 includes, for example, a processor 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0136] Program 504 includes instructions for implementing each function of the store exit management system 100. Program 504 is pre-stored in ROM 502, RAM 503, and storage device 505. The processor 501 implements each function of the store exit management system 100 by executing the instructions contained in Program 504. RAM 503 may also store data processed in each function of the store exit management system 100. The number of ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, and storage device 505 is not particularly limited and can be one or more.

[0137] The processor 501 controls the entire computer 500. An example of a processor 501 is a CPU (Central Processing Unit). The number of processors 501 is not particularly limited; there may be one or more processors 501.

[0138] The drive device 507 reads and writes to the recording medium 506. The communication interface 508 provides an interface with the communication network. The input device 509 is, for example, a mouse or keyboard, and receives information input from the store manager, etc. The output device 510 is, for example, a display, and outputs (displays) information to the store manager, etc. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects each of these hardware components. The program 504 may be supplied to the CPU 501 via the communication network, or it may be stored in the recording medium 506 beforehand, read by the drive device 507, and supplied to the CPU 501.

[0139] Note that the hardware configuration shown in Figure 11 is an example, and other components may be added, or some components may be omitted.

[0140] There are various ways to implement the store exit management system 100. For example, the store exit management system 100 may be implemented by any combination of different computers and programs for each component. Alternatively, the multiple components of the store exit management system 100 may be implemented by any combination of a single computer and program.

[0141] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the configuration and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with one another, as long as they do not depart from the scope of the present disclosure.

[0142] Some or all of the above embodiments may be described as follows, but are not limited to the following:

[0143] [Note 1] When product registration and payment are made via a portable terminal operated by the customer, a code acquisition means obtains a payment completion code from the said portable terminal. A means for obtaining settlement product information to obtain the quantity of settlement products associated with the settlement code, An estimation means for estimating the quantity of goods taken by the customer from an image of the customer's belongings as they leave the store, An anomaly detection means for detecting anomalies based on the amount of the settled goods acquired and the estimated amount of goods to be taken out, An abnormality output means that outputs that the aforementioned abnormality has been detected. A store exit management system equipped with the following features.

[0144] [Note 2] The anomaly detection means detects the anomaly based on the difference between the estimated quantity of goods to be taken out and the quantity of goods that have been paid for. The exit management system described in Appendix 1.

[0145] [Note 3] The anomaly detection means detects the anomaly when the difference between the estimated quantity of goods to be taken out and the quantity of goods that have been paid for exceeds a threshold. The exit management system described in Appendix 2.

[0146] [Note 4] The anomaly detection means detects the anomaly when the estimated quantity of goods to be taken out is greater than the quantity of goods that have been paid for. The exit management system described in any one of the appendices 1 to 3.

[0147] [Note 5] The anomaly detection means detects the anomaly when the estimated quantity of goods to be taken out is less than the quantity of goods that have been paid for. A store exit management system as described in any one of the appendices 1 through 4.

[0148] [Note 6] The quantity of the settled goods is the volume of the settled goods. The quantity of the goods to be taken out is the volume of the goods to be taken out. The exit management system described in any one of the appendices 1 through 5.

[0149] [Note 7] The quantity of the settled goods is the number of settled goods, The quantity of goods to be taken out is the number of goods to be taken out. The exit management system described in any one of the appendices 1 through 6.

[0150] [Note 8] The estimation means estimates the quantity of goods to be taken from the image of the customer's luggage as they leave the store and the image of the customer's luggage before they take the goods out. The exit management system described in any one of the appendices 1 through 7.

[0151] [Note 9] The system further includes gate control means for controlling the exit gate through which the customer passing out of the store passes, The gate control means, when the abnormality is detected, makes it impossible to pass through the exit gate. The exit management system described in any one of the appendices 1 through 8.

[0152] [Note 10] A settlement product information output means outputs the number of settlement products to a notification device in response to the acquisition of the settlement code. An exit management system described in any one of the appendices 1 to 9, further comprising the features described herein.

[0153] [Note 11] When a product is registered and payment is made via a portable terminal operated by the customer, the payment code is obtained from the portable terminal. Obtain the quantity of the settled product associated with the settled code, From images of the customer's belongings as they leave the store, the amount of goods taken by the customer is estimated. Based on the amount of goods that have been settled and the estimated amount of goods that will be taken out, an anomaly is detected. Output that the aforementioned abnormality has been detected. Customer departure management procedures.

[0154] [Note 12] When a product is registered and payment is made via a portable terminal operated by the customer, the payment code is obtained from the portable terminal. Obtain the quantity of the settled product associated with the settled code, From images of the customer's belongings as they leave the store, the amount of goods taken by the customer is estimated. Based on the amount of goods that have been settled and the estimated amount of goods that will be taken out, an anomaly is detected. Output that the aforementioned abnormality has been detected. A recording medium that temporarily stores programs that cause a computer to execute a process. [Explanation of Symbols]

[0155] 1 Store System 100 Store Exit Management System 101 Code Acquisition Section 102 Settlement product information acquisition department 103 Estimation part 104 Anomaly detection unit 105 Error Output Section 106 Gate Control Unit 107 Settlement Product Information Output Unit 20 Portable terminals 21 Processing Unit 22 Memory section 31 POS Server 32 Product Database 33 Sales Database 34 Anomaly Detection Database 41 Leader 42 cameras 43. Notification device 44 Exit Gate C1 Customer C2 Luggage

Claims

1. A code acquisition means that acquires a code from a portable terminal when a product is registered and payment is made via a portable terminal operated by the customer, A means for obtaining settled product information, which obtains information about settled products associated with the code, including at least one of the number of products or the volume of products, An estimation means for estimating information about the items in a shopping basket, including at least one of the number of items or the volume of items, from an image of the shopping basket of the customer leaving the store, An anomaly detection means for detecting anomalies based on the information regarding the paid-for items and the information regarding the items in the shopping cart, A store exit management system equipped with the following features.

2. The anomaly detection means detects the anomaly when the difference between the quantity of goods indicated by the information about the goods in the shopping cart and the quantity of goods indicated by the information about the goods that have been paid for exceeds a threshold. The store exit management system according to claim 1.

3. The anomaly detection means detects the anomaly when the quantity of items indicated by the information about items in the shopping cart is greater than the quantity of items indicated by the information about items that have been paid for. The store exit management system according to claim 1 or 2.

4. The anomaly detection means detects the anomaly when the quantity of items indicated by the information about the items in the shopping cart is less than the quantity of items indicated by the information about the items that have been paid for. The store exit management system according to any one of claims 1 to 3.

5. The estimation means estimates information about the products in the shopping basket using the proportion of the shopping basket's volume that the products occupy. The store exit management system according to any one of claims 1 to 4.

6. The estimation means estimates information about the items in the shopping basket based on the position of the items on the top layer of the shopping basket. The store exit management system according to any one of claims 1 to 5.

7. The system further includes gate control means for controlling the exit gate through which the customer passing out of the store passes, The gate control means, when the abnormality is detected, makes it impossible to pass through the exit gate. The store exit management system according to any one of claims 1 to 6.

8. When a product is registered and payment is made via a portable terminal operated by the customer, a code is obtained from the portable terminal. Obtain information about the settled goods associated with the code, including at least one of the number of goods or the volume of goods. From an image taken from above of the customer's shopping basket as they leave the store, information about the items in the shopping basket, including at least one of the number of items or the volume of items, is estimated. Based on the information regarding the paid-for items and the information regarding the items in the shopping cart, an anomaly is detected. Customer departure management procedures.

9. When a product is registered and payment is made via a portable terminal operated by the customer, a code is obtained from the portable terminal. Obtain information about the settled goods associated with the code, including at least one of the number of goods or the volume of goods. From an image taken from above of the customer's shopping basket as they leave the store, information about the items in the shopping basket, including at least one of the number of items or the volume of items, is estimated. Based on the information regarding the paid-for items and the information regarding the items in the shopping cart, an anomaly is detected. A program that instructs a computer to perform a process.

Images