Exiting management system, exiting management method, and program

Abstract

To provide an exiting management system and the like that can support handling of an abnormality having occurred in relation to commodities to be taken out by an exiting customer when registration and settlement of commodities are performed through a portable terminal operated by the customer.SOLUTION: An exiting management system according to the present disclosure includes: code acquisition means for, when registration and settlement of commodities are performed through a portable terminal operated by a customer, acquiring a settled code from the portable terminal; settled commodity information acquisition means for acquiring the amount of settled commodities associated with the settled code; estimation means for estimating the amount of commodities to be taken out by the customer from an image captured by imaging baggage of the exiting customer; abnormality detection means for detecting an abnormality based on the acquired amount of settled commodities and the estimated amount of commodities to be taken out; and abnormality output means for outputting the fact that the abnormality has been detected.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a store exit management system and the like. [Background technology]

[0002] In some stores, product registration and payment are performed by customers operating a terminal. At the gate or counter of such a store, customers may be required to scan a terminal to manage their exit from the store.

[0003] Patent Document 1 discloses a system in which a customer registers a product using a portable terminal. In Patent Document 1, when the terminal is returned to the terminal management device, a payment process for the registered product is performed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-099441 A Summary of the Invention [Problem to be solved by the invention]

[0005] When a customer operates the machine to register and pay for products, a discrepancy may occur between the amount of products registered and paid for and the amount of products taken out. For example, a discrepancy may occur when a customer takes out products without paying for them, or when a customer leaves paid products in the store. When such a discrepancy occurs, it is preferable for the customer or a store clerk to take action.

[0006] The present disclosure aims to provide a store exit management system etc. that can assist in dealing with any abnormalities that occur regarding products taken out by customers leaving a store when products are registered and settled via a portable terminal operated by the customer. [Means for solving the problem]

[0007] The store exit management system of the present disclosure comprises a code acquisition means for acquiring a settled code from a portable terminal operated by a customer when the customer registers and settles for goods via the portable terminal, a settled goods information acquisition means for acquiring the amount of settled goods associated with the settled code, an estimation means for estimating the amount of goods to be taken out by the customer from an image taken of the customer's luggage as the customer leaves the store, anomaly detection means for detecting an abnormality based on the acquired amount of settled goods and the estimated amount of goods to be taken out, and an abnormality output means for outputting the detection of the abnormality.

[0008] The store exit management method disclosed herein, when registration and settlement of goods are performed via a portable terminal operated by a customer, obtains a settled code from the portable terminal, obtains the amount of settled goods associated with the settled code, estimates the amount of goods to be taken by the customer from an image taken of the customer's luggage as they leave the store, detects an abnormality based on the obtained amount of settled goods and the estimated amount of goods to be taken, and outputs a message that the abnormality has been detected.

[0009] A program according to the present disclosure causes a computer to execute a process, when a product is registered and settled via a portable terminal operated by a customer, to obtain a settled code from the portable terminal, obtain a paid product quantity associated with the settled code, estimate the quantity of products to be taken out by the customer from an image of the customer's luggage as the customer leaves a store, detect an abnormality based on the obtained paid product quantity and the estimated product quantity to be taken out, and output a notice that the abnormality has been detected. The program may be stored in a computer-readable non-transitory recording medium. Effect of the Invention

[0010] According to the present disclosure, when product registration and payment are performed via a portable terminal operated by a customer, it is possible to assist in dealing with abnormalities regarding products taken out by a customer as they leave the store. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of the configuration of a store system according to a first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example of installation of a reader and a camera. [Diagram 3] 11 is a schematic diagram showing another example of installation of a reader and a camera. FIG. [Figure 4] 2 is a block diagram showing a configuration example of a portable terminal 20. FIG. [Diagram 5] FIG. 13 is a diagram showing an example of a display screen of a settled code. [Figure 6] 4 is a flowchart showing an operation example according to the first embodiment. [Figure 7] FIG. 11 is a block diagram showing an example of the configuration of a store system according to a second embodiment. [Figure 8] 13 is a flowchart showing an operation example according to the second embodiment. [Figure 9] FIG. 13 is a block diagram showing an example of the configuration of a store system according to a third embodiment. [Figure 10] 13 is a flowchart showing an operation example according to the third embodiment. [Figure 11] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, with reference to the drawings, an embodiment of a store exit management system, a store exit management method, a program, and a recording medium for non-temporarily recording the program according to the present disclosure will be described. The present embodiment does not limit the disclosed technology.

[0013] [First embodiment] The store exit management system 100 according to the first embodiment is a system that manages the amount of merchandise that a customer takes away when leaving a store and the amount of merchandise that the customer has paid for. The store exit management system 100 is used as a store system 1. FIG. 1 is a block diagram showing an example of the configuration of the store system 1 according to the first embodiment. The store exit management system 100 comprises a code acquisition unit 101, a paid merchandise information acquisition unit 102, an estimation unit 103, an anomaly detection unit 104, and an anomaly output unit 105.

[0014] In addition to the store exit management system 100, the store system 1 includes a POS (Point of Sales) server 31, a product database 32, and a sales database 33. The store exit management system 100, the POS server 31, the product database 32, and the sales database 33 are connected to each other so as to be able to communicate with each other via wire or wirelessly as appropriate depending on the specific configuration of each system. The POS server 31 is also connected to the portable terminal 20 so as to be able to communicate with each other via wire or wirelessly. The portable terminal 20 is a terminal operated by a customer.

[0015] The POS server 31 manages, for example, various information related to products sold in a store. The POS server 31 may be an application server. The POS server 31 may also manage product registration and settlement using terminals other than the portable terminal 20, such as a POS terminal operated by a store clerk, in addition to the portable terminal 20. In other words, both the existing POS terminal and the portable terminal 20 may be used in a store to register products and settle accounts.

[0016] The POS server 31 also transmits a payment completion code to the portable terminal 20. The transmitted payment completion code is stored in the portable terminal 20. There are no particular limitations on the payment completion code, so long as it indicates that the customer has completed payment. The payment completion code is also associated with information regarding the payment. The information regarding the payment includes, for example, the number of paid items, identification information of the paid items, or the total amount. The payment completion code is also called a store exit code, as it is used when a customer leaves the store.

[0017] As the settled code, for example, a settlement ID (Identifier) ​​may be used. The settlement ID uniquely identifies each settlement. Furthermore, a transaction ID or a customer ID may be used as the settled code. The transaction ID uniquely identifies each transaction, with the period from the start of the product registration process to the completion of settlement being considered as one transaction. Furthermore, the customer ID uniquely identifies a customer. The transaction ID and the customer ID can be used as the settled code, for example, by being linked to information indicating that settlement has been completed.

[0018] The product database 32 stores product identification information and product information in association with each other for each product. For example, when the product identification information is a product code, the product information is information such as the product name and the product price. Note that the product information is not particularly limited.

[0019] The sales database 33 stores, for example, information about sales for each store. The sales database 33 also manages information about each settlement for each store. The sales database 33 may store information about each settlement in association with a settlement code.

[0020] The store system 1 also includes a reader 41 and a camera 42. A plurality of readers 41 and a plurality of cameras 42 may be provided. The reader 41 and the camera 42 are installed in the store. However, the camera 42 may be realized by a camera provided in the portable terminal 20. The store exit management system 100 is connected to the reader 41 and the camera 42 so as to be able to communicate with each other via wired or wireless communication.

[0021] The reader 41 reads the settled code from the portable terminal 20. The method by which the reader 41 reads the settled code is not particularly limited. For example, the reader 41 may read a barcode or a two-dimensional code that encodes the settled code and is displayed on the display of the portable terminal 20. Alternatively, the reader 41 may receive the settled code from the portable terminal 20 via wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), or Bluetooth (registered trademark). The reader 41 transmits the read settled code to the code acquisition unit 101 of the store exit management system 100.

[0022] The camera 42 takes an image of the customer's baggage. Then, the camera 42 transmits the captured image to the store exit management system 100.

[0023] The baggage is at least one object carried by a customer. The camera 42 may capture an image of the baggage placed in front of the camera 42. Alternatively, the camera 42 may capture an image of the baggage carried by the customer by capturing an image of the customer carrying the baggage.

[0024] The camera 42, for example, captures an image of a customer's baggage as he or she leaves the store. In this case, the camera 42 may be installed near the exit of the store.

[0025] 2 is a schematic diagram showing an example of the installation of the reader 41 and the camera 42. The reader 41 is installed, for example, on a counter. The camera 42 is installed, for example, from above the counter so that it can capture an image of luggage placed on the counter. For example, before leaving the store, customer C1 places luggage C2 on the counter and has the reader 41 read the settled code displayed on the portable terminal 20. After having the reader 41 read the settled code, customer C1 leaves the store.

[0026] 3 is a schematic diagram showing another installation example of the reader 41 and the camera 42. The reader 41 is installed, for example, at the exit gate 44. The exit gate 44 is a gate through which customers passing to leave the store. When the paid code is presented, the exit gate 44 becomes ready for the customer to pass through. The camera 42 is installed, for example, so as to be able to photograph customers passing through the exit gate 44. Customer C1, for example, carrying baggage C2, has the reader 41 read the paid code displayed on the portable terminal 20. After the paid code is read, customer C1 passes through the exit gate 44.

[0027] The installation example of the reader 41 and the camera 42 is not limited to the above example. The reader 41 and the camera 42 may be installed in different locations in the store. In other words, the reading of the payment completion code and the taking of the image may be performed in different locations.

[0028] In the first embodiment, a case will be described in which the store system 1 further includes a detected anomaly database 34 and an alarm device 43. The store system 1 does not necessarily have to include the detected anomaly database 34 and the alarm device 43. The store exit management system 100 is communicatively connected to the detected anomaly database 34 and the alarm device 43.

[0029] The detected anomaly database 34 stores anomalies detected in the store exit management system 100. The notification device 43 may refer to the detected anomaly database 34 and notify the detected anomaly in response to a request from a store manager.

[0030] The notification device 43 notifies an abnormality detected in the store exit management system 100. The notification device 43 is, for example, a display, a speaker, or a lamp. A plurality of notification devices 43 may be provided in the store. The notification device 43 may notify an abnormality to a customer leaving the store. The notification device 43 may also notify a store clerk of the abnormality. In this case, the notification device 43 may be a terminal operated by the store clerk.

[0031] The notification device 43 may be provided at the counter where the reader 41 is installed. The notification device 43 may also be provided at an exit gate 44 as shown in Fig. 3. By providing the notification device 43 near the reader 41, the notification device 43 can notify a customer leaving the store of an abnormality. The notification device 43 can also notify store clerks near the customer leaving the store and other customers of the abnormality.

[0032] The store exit management system 100, POS server 31, and each database related to the store system 1 may be installed, for example, in a back yard of a store, but the installation location is not particularly limited. Some of the devices constituting the store system 1 may be realized by a cloud server.

[0033] Each system including the store exit management system 100, POS server 31, and each database related to the store system 1 may be realized by a separate information processing device. Alternatively, the functions of each system may be realized by a single information processing device. For example, each database related to the store system 1 may be included in an information processing device that realizes the POS server 31. Furthermore, each system may be realized by a combination of multiple information processing devices.

[0034] The portable terminal 20 is, for example, a mobile terminal such as a smartphone or a tablet. The type of the portable terminal 20 is not particularly limited. The portable terminal 20 may be owned by a customer or may be rented out at a store. The portable terminal 20 may be attached to a shopping basket or shopping cart, or may be provided integrally with the shopping basket or shopping cart. When the portable terminal 20 is attached to a shopping cart, the shopping cart may be self-propelled by being provided with, for example, movable parts such as tires and a driving device such as a motor.

[0035] 4 is a block diagram showing a configuration example of the portable terminal 20. The portable terminal 20 includes a processing unit 21 and a storage unit 22. An application program may be installed in the storage unit 22 to realize the following functions of the processing unit 21. The processing unit 21 may not have some of the functions described below.

[0036] The configurations of the store system 1 and the portable terminal 20 will be described in more detail below.

[0037] <Enter identification information> The processing unit 21 of the portable terminal 20 accepts the input of the identification information of the product. The POS server 31 may display a screen for accepting the input of the identification information.

[0038] The processing unit 21 accepts input of product identification information, for example, via a camera (not shown). The camera is not particularly limited, but is, for example, a camera provided in the portable terminal 20. The processing unit 21 may accept input of the identification information by reading a one-dimensional code or two-dimensional code of the product photographed by an imaging device. The processing unit 21 may also accept input of the identification information by identifying the product from an image of the product photographed by the imaging device using image recognition technology.

[0039] Furthermore, the processing unit 21 may obtain the identification information by reading a tag to which an RFID (Radio Frequency Identifier) ​​is attached via a reading device. When an RFID is used, the reading device is an RFID reader.

[0040] Furthermore, the processing unit 21 may accept product identification information by accepting a product selection from the product search results. For example, the method of product search is not particularly limited. The product search may be performed by text or image. For example, the processing unit 21 may accept input of product identification information by accepting a product selection from a displayed product image.

[0041] Furthermore, the processing unit 21 may receive input of identification information by receiving input of a number such as a product code via an input device (not shown). Examples of the input device include a touch panel display and a keyboard capable of inputting numbers and letters.

[0042] The processing unit 21 of the portable terminal 20 transmits the identification information of the product received as described above to the POS server 31. For the product whose identification information has been transmitted and registered, the processing unit 21 may display the product information according to the control of the POS server 31.

[0043] <Product registration> The POS server 31 registers the product based on the identification information received from the portable terminal 20. The POS server 31 refers to the product database 32 to acquire product information. The POS server 31 then registers the product purchased by the customer using the acquired product information. As a process of registering products, the POS server 31 generates, for example, a registered product list for each customer.

[0044] <Settlement processing> Furthermore, the processing unit 21 of the portable terminal 20 executes a process related to the settlement of the registered product. Below, we will explain the case where the settlement is performed via a payment server and the case where the settlement is performed using a settlement device installed in the store. However, the settlement method is not limited to these.

[0045] When the settlement is performed via a settlement server, the processing unit 21 of the portable terminal 20 may communicate with the settlement server (not shown) as a process related to the settlement, and instruct the settlement server to settle the settlement. For example, the processing unit 21 transmits a settlement instruction including the payment information and the settlement information to the settlement server. The payment information is information that identifies the customer's credit card, debit card, electronic money, points, etc. The settlement information is information that identifies the registered product, or the purchase amount of the registered product, etc. The settlement server executes the cashless settlement using the payment information and the settlement information. For example, the settlement server notifies the portable terminal 20 and the POS server 31 of the completion of the settlement.

[0046] The processing unit 21 of the portable terminal 20 may instruct the payment server to settle the account via the POS server 31 or the store exit management system 100. In addition, some or all of the functions of the payment server may be realized by the store exit management system 100 or the POS server 31.

[0047] Alternatively, when settlement is performed using a settlement device installed in a store, the processing unit 21 of the portable terminal 20 may output information identifying settlement information to the settlement device as a process related to settlement. The information identifying the settlement information is stored, for example, in association with the settlement information by the POS server 31. The settlement device acquires settlement information, for example, from the POS server 31, based on the output information identifying the settlement information. The settlement device executes settlement processing by any method, such as cash settlement or cashless payment, based on the acquired settlement information. For example, the settlement device notifies the portable terminal 20 and the POS server 31 of the completion of settlement.

[0048] There is no particular limitation on the method of outputting the information identifying the settlement information to the settlement device. For example, the processing unit 21 may cause a barcode or a two-dimensional code that encodes the information identifying the settlement information to be displayed on the display of the portable terminal 20. The settlement device reads the information identifying the settlement information displayed on the display. Alternatively, the processing unit 21 may transmit the information identifying the settlement information to the settlement device via wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0049] The processing unit 21 may output settlement information to the settlement device as a process related to settlement. In this case, the settlement device acquires the settlement information from the portable terminal 20.

[0050] The POS server 31 stores information regarding the settlement in the sales database 33. In addition, the POS server 31 transmits a settlement completion code to the portable terminal 20 after the settlement is completed.

[0051] <Anomaly detection> When product registration and payment are performed via the portable terminal 20, the code acquisition unit 101 of the store exit management system 100 acquires a payment completion code from the portable terminal 20.

[0052] The code acquisition unit 101 of the store exit management system 100 acquires the payment completion code from the portable terminal 20 via the reader 41. In this case, the processing unit 21 of the portable terminal 20 first outputs the payment completion code.

[0053] For example, the processing unit 21 transmits a settlement code to the reader 41 by wireless communication.

[0054] Alternatively, the processing unit 21 causes a barcode or a two-dimensional code that encodes the settled code to be displayed on the display of the portable terminal 20. Fig. 5 is a diagram showing an example of a display screen of the settled code displayed on the portable terminal 20. On the display screen of Fig. 5, a two-dimensional code that encodes the settled code is displayed. Before leaving the store, the customer causes the reader 41 to read the barcode displayed on the portable terminal 20.

[0055] Then, the code acquisition unit 101 acquires the read settlement code from the reader 41.

[0056] The settled product information acquisition unit 102 acquires the amount of settled products associated with the settled code. For example, the settled product information acquisition unit 102 refers to the sales database 33 and acquires the amount of settled products associated with the settled code.

[0057] The amount of the paid products may be the number of paid products. The amount of the paid products may also be the volume of the paid products. For example, the paid product information acquisition unit 102 may estimate the volume of the products from the number of paid products. Alternatively, the paid product information acquisition unit 102 may refer to the volume of the products stored in the product database 32 and acquire the volume of the paid products.

[0058] The estimation unit 103 estimates the amount of merchandise taken by a customer from an image of the baggage of the customer leaving the store. The amount of merchandise taken may be the number of merchandise taken out. Alternatively, the amount of merchandise taken out may be the volume of the merchandise taken out.

[0059] The following describes a method for estimating the amount of goods taken out.

[0060] The estimation unit 103 acquires, for example, an image of luggage of a customer leaving the store from the camera 42. The estimation unit 103 recognizes the luggage from the acquired image. The estimation unit 103 may recognize merchandise as luggage. The estimation unit 103 may recognize merchandise in a container from an image of the inside of the container. The container for the merchandise is, for example, a bag, a paper bag, a plastic bag, a cardboard box, or a shopping basket. The estimation unit 103 may estimate the amount of recognized merchandise as the amount of merchandise to be taken out.

[0061] When products are in a container, it may be difficult to recognize all the products. For example, when an image of a customer's luggage is taken from the outside of the container, the products inside the container may not be visible. Therefore, the estimation unit 103 may recognize the container as luggage. Then, the estimation unit 103 may recognize the volume of the container using existing technology related to measuring size based on an image. Also, when a customer puts products into a container with a known volume, the estimation unit 103 may recognize the volume of the container by recognizing the type of container. The estimation unit 103 may estimate the volume of the container recognized in this way as the amount of products to be taken out.

[0062] For example, a plastic bag may have a larger volume the more products it contains, so it is possible to estimate the volume of the plastic bag as the volume of the products contained in the plastic bag.

[0063] In addition, a customer may not fill a container with products. Therefore, the estimation unit 103 may estimate the amount of products in the container as the amount of products to be taken out.

[0064] The estimation unit 103 may estimate the amount of the product in the container by using the ratio of the product to the volume of the container. The estimation unit 103 may recognize the volume of the container by using existing technology related to size measurement based on an image. In addition, when a customer puts a product in a container whose volume is known, the estimation unit 103 may recognize the volume of the container by recognizing the type of the container. Then, for example, the estimation unit 103 recognizes the position of the topmost product in the container from the image. Furthermore, the estimation unit 103 recognizes the bottom and the top end of the container from the image. Then, the estimation unit 103 calculates the ratio of the product to the volume of the container by dividing the height from the bottom of the container to the position of the topmost product by the height of the container. The estimation unit 103 may estimate the volume obtained by multiplying the volume of the container by the ratio of the product to the volume of the container as the amount of the product in the container.

[0065] The estimation unit 103 may also estimate the amount of products in the container using the amount of products in the top layer and the number of layers of products in the container. For example, the estimation unit 103 recognizes the products in the top layer of the container from an image of the inside of the container taken from above. The estimation unit 103 also recognizes the position of the products in the top layer of the container and the position of the bottom of the container from the image. Furthermore, the estimation unit 103 estimates the number of layers of products in the container from the height from the bottom of the container to the products in the top layer. The estimation unit 103 may then estimate the total amount of products in the container to be the value obtained by multiplying the amount of products in the surface layer by the estimated number of layers of products.

[0066] As an example, a customer may put paid items into a shopping cart and take the items out of a store. If the volume of the shopping cart is known, the estimation unit 103 can estimate the volume of the items in the cart based on the position of the topmost item in the shopping cart.

[0067] The estimation unit 103 may estimate the number of products to be taken out from the volume of the products to be taken out. For example, the estimation unit 103 may estimate the number of products to be taken out by dividing the result of estimating the volume of the products to be taken out by the average volume of the products.

[0068] Furthermore, the estimation unit 103 may estimate the amount of merchandise to be taken out from an image taken of the baggage of a customer leaving the store and an image taken of the baggage of the customer before picking up the merchandise to be taken out.

[0069] The camera 42 captures an image of the customer's baggage before the customer picks up the product to be taken out, for example. The camera 42 capturing the image of the customer before picking up the product may be installed, for example, near the entrance of the store. The estimation unit 103 acquires the image from the camera 42.

[0070] For example, the estimation unit 103 recognizes the customer's belongings for each image and estimates the volume of the recognized belongings. The estimation unit 103 may estimate the amount of goods to be taken out as the volume obtained by subtracting the volume of the belongings recognized for the customer before picking up the goods from the volume of the belongings recognized for the customer leaving the store.

[0071] As an example, a customer may put merchandise that has already been paid for into a bag that the customer has brought with them. The bag may contain items that the customer brings into the store from outside the store. For example, camera 42 may take an image of the bag near the entrance before the customer puts the merchandise in it, and transmit it to estimation unit 103. Camera 42 may also take an image of the bag near the exit after the customer puts the merchandise in it, and transmit it to estimation unit 103. Then, estimation unit 103 may calculate the volume of the bag from each image and estimate the amount of merchandise to be taken out.

[0072] For example, a customer may register which bag the customer will put the products in before carrying the products in the store. A customer may register a bag by having the camera 42 take a picture of the bag that the customer has brought with them.

[0073] The estimation unit 103 may also perform object recognition for each piece of luggage included in the image. Then, the estimation unit 103 may recognize, for example, objects recognized in an image of a luggage of a customer leaving the store, excluding objects recognized in an image of the luggage before the customer picked up the products in the store, as products to be taken out.

[0074] The method for estimating the amount of products to be taken out has been described above. The methods described above may be used in combination. Furthermore, the method for estimating the amount of products to be taken out is not limited to the above example.

[0075] The recognition of the customer's baggage may be performed by the camera 42. The camera 42 may transmit the recognition result to the store exit management system 100. The estimation unit 103 acquires the recognition result of the customer's baggage from the camera 42.

[0076] The anomaly detection unit 104 detects an anomaly based on the amount of paid-for goods acquired by the paid-for goods information acquisition unit 102 and the amount of goods to be taken out estimated by the estimation unit 103. An anomaly occurs when there is a difference between the amount of paid-for goods and the amount of goods to be taken out. For example, if the amount of goods to be taken out is greater than the amount of paid-for goods, there is a possibility that the customer has illegally taken out unpaid goods. Also, if the amount of goods to be taken out is less than the amount of paid-for goods, there is a possibility that the customer has left paid-for goods behind in the store. Therefore, the anomaly detection unit 104 detects an anomaly based on the difference between the amount of paid-for goods and the amount of goods to be taken out.

[0077] The anomaly detection unit 104 may detect an anomaly when the amount of goods to be taken out estimated by the estimation unit 103 is greater than the amount of paid goods acquired by the paid goods information acquisition unit 102. In other words, the anomaly detection unit 104 may detect an anomaly when it is estimated that there is an unpaid item among the goods to be taken out.

[0078] Furthermore, the anomaly detection unit 104 may detect an anomaly when the amount of merchandise to be taken out estimated by the estimation unit 103 is less than the amount of merchandise that has been paid for acquired by the paid merchandise information acquisition unit 102. That is, the anomaly detection unit 104 may detect an anomaly when, for example, it is estimated that some merchandise has been left behind in the store despite the fact that payment has been made.

[0079] When the anomaly detection unit 104 detects an anomaly, a threshold may be set for the difference between the amount of merchandise paid for and the amount of merchandise taken out. For example, the anomaly detection unit 104 may detect an anomaly when the difference between the amount of merchandise taken out and the amount of merchandise paid for exceeds the threshold. By setting a threshold, the number of anomalies detected can be reduced.

[0080] The threshold may be set according to the estimation accuracy of the amount of goods to be taken out. If the difference between the amount of goods to be taken out and the amount of goods that has been paid for is small, the anomaly detection unit 104 may erroneously detect an anomaly. Therefore, for example, if the estimation accuracy of the estimation unit 103 is low, the threshold may be set high. If the difference does not exceed the threshold, the anomaly detection unit 104 may determine that there is an error in the estimation.

[0081] The threshold value may be set according to the products checked out by the customer. For some products, it may be difficult to recognize the volume from an image, which may reduce the estimation accuracy by the estimation unit 103. Therefore, if the products checked out by the customer include a product whose volume is difficult to recognize from an image, the threshold value may be set high.

[0082] The threshold may also be set according to the amount of merchandise paid by a customer. For example, the threshold may be set low when the payment amount is high. This allows the anomaly detection unit 104 to detect an anomaly for a customer who has paid a high amount, even if the difference in the amount of merchandise is small. Therefore, if a customer who has made an expensive purchase may have left a high-priced item in the store after payment, the anomaly detection unit 104 can appropriately detect the anomaly. Alternatively, the threshold may be set low when the payment amount is low. This allows the anomaly detection unit 104 to appropriately detect an anomaly for a customer who may have reduced the payment amount by paying for an amount of merchandise less than the amount actually taken out, even if the difference in the amount of merchandise is small.

[0083] The threshold value may also be set according to the degree of congestion. The degree of congestion may be the real-time degree of congestion or the degree of congestion expected for each time period. For example, when the store is crowded, the threshold value may be set high. This makes it difficult to detect abnormalities, and further congestion due to confirmation of an abnormality can be prevented. Alternatively, the threshold value may be set low when the store is crowded. This makes it easy to detect abnormalities, and prevents products that have not been paid for from being taken out due to the congestion.

[0084] The threshold may be set depending on the customer. For example, the threshold may be set low for a customer in whom an abnormality has been detected in the past. This makes it possible to detect an abnormality in a customer who is likely to commit fraud.

[0085] The anomaly detection unit 104 may notify the anomaly output unit 105 of the difference between the amount of merchandise already paid for and the estimated amount of merchandise to be taken out as the degree of the anomaly.

[0086] <Abnormality Report> The abnormality output unit 105 outputs the fact that an abnormality has been detected. For example, the abnormality output unit 105 may output the fact that an abnormality has been detected to the notification device 43, and cause the notification device 43 to notify the abnormality. In addition, the abnormality output unit 105 may output the fact that an abnormality has been detected to the detected abnormality database 34, and cause the detected abnormality to be stored in the database.

[0087] By storing the detected anomaly in the detected anomaly database 34, the store manager can check for the anomaly even after the customer has left the store. The manager may then carefully observe the customer the next time he or she visits the store.

[0088] The abnormality output unit 105 may cause the notification device 43 to output an alarm sound or an alarm display.

[0089] Alternatively, the abnormality output unit 105 may cause the notification device 43 to notify the number of paid items by voice or display when an abnormality has been detected. In other words, if no abnormality is detected, the abnormality output unit 105 does not notify the number of paid items. Therefore, depending on whether or not the number of paid items is notified, the store clerk or customer can determine whether or not an abnormality has been detected. The abnormality output unit 105 may obtain the number of paid items from, for example, the abnormality detection unit 104, the paid item information acquisition unit 102, or the sales database 33. Note that other information regarding the paid items may be used instead of the number of paid items.

[0090] The abnormality output unit 105 may change the notification device 43 to output based on the difference between the amount of goods to be taken out and the amount of goods that has been paid for. For example, if the amount of goods to be taken out is greater than the amount of goods that has been paid for, the abnormality output unit 105 may cause the notification device 43 for the store clerk to notify that an abnormality has been detected. This allows, for example, the store clerk to check the customer's belongings to see if any goods have been illegally taken out. Also, if the amount of goods to be taken out is less than the amount of goods that has been paid for, the abnormality output unit 105 may cause the notification device 43 for the customer to notify that an abnormality has been detected. This allows, for example, the customer to check if any goods have been left behind in the store.

[0091] The abnormality output unit 105 may output the fact that an abnormality has been detected, depending on the degree of the detected abnormality.

[0092] As an example, the abnormality output unit 105 may change the level of notification in the notification device 43 depending on the difference between the amount of merchandise that has been paid for and the estimated amount of merchandise to be taken out. For example, when the difference is large, the abnormality output unit 105 causes the notification device 43 to execute a higher level of notification compared to when the difference is small. A higher level of notification is a notification that attracts more attention.

[0093] If the difference is small, a low level of notification may be issued since there is a possibility that an abnormality has been erroneously detected. If the difference is large, there is a high possibility that an abnormality has occurred, so a high level of notification may be issued. Also, if the difference is large, there is a possibility that more products have been taken out without being paid for, or that more paid-for products have been left behind in the store. Therefore, a high level of notification may be issued, which conveys a greater degree of urgency.

[0094] When the notification device 43 is a speaker, the abnormality output unit 105 may, for example, cause the speaker to output a short notification sound when the difference is small. When the difference is large, the abnormality output unit 105 may cause the speaker to output an alarm sound. When the notification device 43 is a display, the abnormality output unit 105 may, for example, cause the abnormality to be displayed in yellow when the difference is small and to be displayed in red when the difference is large.

[0095] Next, an operation of the store exit management system 100 will be described. Fig. 6 is a flowchart showing an example of the operation of the store exit management system 100 according to the first embodiment. For example, the store exit management system 100 may start the process of Fig. 6 in response to the reader 41 reading the settled code.

[0096] The code acquisition unit 101 of the store exit management system 100 acquires a payment completion code from the portable terminal 20 via the reader 41 (step S1). The code acquisition unit 101 notifies the payment completion code acquired to the payment product information acquisition unit 102.

[0097] The paid product information acquisition unit 102 acquires the amount of paid products associated with the paid code (step S2). The paid product information acquisition unit 102 notifies the anomaly detection unit 104 of the acquired amount of paid products.

[0098] The estimation unit 103 estimates the amount of merchandise taken by the customer from an image of the customer's baggage when the customer leaves the store (step S3). The estimation unit 103 notifies the anomaly detection unit 104 of the estimated amount of merchandise taken by the customer.

[0099] The anomaly detection unit 104 detects an anomaly based on the amount of merchandise that has been paid for and the estimated amount of merchandise to be taken out (step S4). The anomaly detection unit 104 notifies the anomaly output unit 105 of the detected anomaly. If no anomaly is detected, the store exit management system 100 ends operation.

[0100] The abnormality output unit 105 outputs that an abnormality has been detected (step S5). For example, the store exit management system 100 ends operation due to the output of the abnormality. Note that the store exit management system 100 repeatedly executes the above-mentioned series of operations, for example, for each customer as appropriate.

[0101] According to the first embodiment, when a product is registered and settled via the portable terminal 20, the code acquisition unit 101 acquires a settled code from the portable terminal 20. Then, the settled product information acquisition unit 102 acquires the amount of settled products associated with the settled code. The estimation unit 103 estimates the amount of products to be taken out by the customer from an image of the customer's luggage as he or she leaves the store. Furthermore, the anomaly detection unit 104 detects an anomaly based on the amount of settled products and the estimated amount of products to be taken out. Then, the anomaly output unit 105 outputs a notification that an anomaly has been detected. Therefore, according to the first embodiment, when a product is registered and settled via a portable terminal operated by the customer, it is possible to assist in dealing with an anomaly related to the products taken out by the customer as he or she leaves the store.

[0102] [Second embodiment] Next, as a second embodiment, another example of a store system 1 equipped with a store exit management system 100 will be described. The configuration of the second embodiment is similar to a part of the configuration of the first embodiment. Therefore, a description of the similar configuration will be omitted. FIG. 7 is a block diagram showing an example of the configuration of the store system 1 according to the second embodiment.

[0103] The store exit management system 100 according to the second embodiment differs from the store exit management system 100 according to the first embodiment in that it includes a gate control unit 106.

[0104] In the second embodiment, the store system 1 further includes a store exit gate 44. The store exit management system 100 is connected to the store exit gate 44 so as to be able to communicate with each other.

[0105] An example of the installation of the exit gate 44 is as shown in Fig. 3. However, the installation example of the exit gate 44 is not limited to this example.

[0106] The gate control unit 106 controls whether the exit gate 44 is in a passable state or a pass-through state. For example, the gate control unit 106 may control the opening and closing of the exit gate 44. The gate control unit 106 may open the exit gate 44 to allow customers to pass through, and close the exit gate 44 to prevent customers from passing through.

[0107] When an abnormality is detected, the gate control unit 106 may set the exit gate 44 to a state in which it is impossible to pass through. For example, the abnormality output unit 105 outputs a signal that an abnormality has been detected to the gate control unit 106. When the gate control unit 106 receives an output from the abnormality output unit 105 indicating that an abnormality has been detected, it sets the exit gate 44 to a state in which it is impossible to pass through.

[0108] Next, the operation of the store exit management system 100 according to the second embodiment will be described. Fig. 8 is a flowchart showing an example of the operation of the store exit management system 100 according to the second embodiment. For example, the store exit management system 100 may start the process of Fig. 8 in response to the reader 41 installed at the store exit gate 44 reading the settled code.

[0109] The code acquisition unit 101 of the store exit management system 100 acquires a payment completion code from the portable terminal 20 via the reader 41 (step S11). The code acquisition unit 101 notifies the payment completion code acquired to the payment product information acquisition unit 102.

[0110] The paid product information acquisition unit 102 acquires the amount of paid products associated with the paid code (step S12). The paid product information acquisition unit 102 notifies the anomaly detection unit 104 of the acquired amount of paid products.

[0111] The estimation unit 103 estimates the amount of merchandise taken out by the customer from an image of the baggage of the customer leaving the store (step S13). The estimation unit 103 notifies the anomaly detection unit 104 of the estimated amount of merchandise taken out by the customer.

[0112] The anomaly detection unit 104 detects an anomaly based on the amount of merchandise already paid for and the estimated amount of merchandise to be taken out. If the anomaly detection unit 104 detects an anomaly (step S14; Yes), it notifies the anomaly output unit 105 of the detected anomaly.

[0113] The abnormality output unit 105 outputs the abnormality detection to the gate control unit 106 (step S15). In response to the output of the abnormality detection, the gate control unit 106 makes the exit gate 44 pass-through impossible (step S16).

[0114] When the abnormality detection unit 104 does not detect an abnormality (step S14; No), it outputs a signal indicating that there is no abnormality to the gate control unit 106. In response to the signal indicating that there is no abnormality, the gate control unit 106 sets the exit gate 44 to a state in which the customer can pass through (step S17).

[0115] For example, the store exit management system 100 ends its operation due to gate control by the gate control unit 106.

[0116] According to the second embodiment, if an abnormality is detected, the gate control unit 106 makes the exit gate 44 pass-through impossible. Therefore, according to the second embodiment, if there is an abnormality with the product being taken out, it is possible to control the customer not to leave the store.

[0117] [Third embodiment] Next, as a third embodiment, yet another example of a store system 1 equipped with a store exit management system 100 will be described. The configuration of the third embodiment is similar to a part of the configuration of the first embodiment. Therefore, a description of the similar configuration will be omitted. FIG. 9 is a block diagram showing an example of the configuration of the store system 1 according to the third embodiment.

[0118] The store exit management system 100 according to the third embodiment differs from the store exit management system 100 according to the first embodiment in that it includes a payment product information output unit 107. In addition, the store system 1 according to the third embodiment includes an alarm device 43.

[0119] In response to acquiring the payment completion code, the payment completion code output unit 107 outputs the number of payment completion products to the notification device 43. In the third embodiment, the payment completion code output unit 107 causes the notification device 43 to notify the number of payment completion products regardless of whether an abnormality is detected or not.

[0120] The paid product information output unit 107 acquires the number of paid products, for example, from the paid product information acquisition unit 102. Then, the paid product information output unit 107 outputs the acquired number of paid products to the notification device 43.

[0121] In the third embodiment, the notification device 43 notifies the customer of the number of items for which the output has been received. The notification device 43 is, for example, a display or a speaker. Similarly to the first embodiment, the notification device 43 notifies the customer of an abnormality detected in the store exit management system 100.

[0122] The notification device 43 may notify the customer of the number of items that have been paid for. This makes it possible to show a customer who is leaving the store that the number of items that have been paid for is known. This is expected to prevent a customer from leaving the store without paying for some of the items.

[0123] The notification device 43 may also notify the store clerk of the number of items that have been paid for. This allows the store clerk to check whether the amount of items taken out by the customer leaving the store is the same as the number of items that have been paid for. In other words, a double check is realized: the store exit management system 100 detects an abnormality, and the store clerk checks for the abnormality.

[0124] Instead of the number of paid items, other information regarding the paid items may be used and notified.

[0125] Fig. 10 is a flowchart showing an example of the operation of the store exit management system 100 according to the third embodiment. For example, the store exit management system 100 may start the process of Fig. 10 in response to the reader 41 reading the settled code.

[0126] The flowchart in Fig. 10 includes basic operations of the store exit management system 100 in the flowchart in Fig. 6 according to the first embodiment. Therefore, the flowchart in Fig. 10 will be described only in terms of parts that differ from the flowchart in Fig. 6.

[0127] In step S2, for example, the paid product information acquisition unit 102 notifies the paid product information output unit 107 of the number of paid products out of the amount of paid products.

[0128] After step S2, the paid product information output unit 107 outputs the number of paid products to the notification device 43 (step S22). The notification device 43 receives the output and notifies the number of paid products.

[0129] The operation after step S22 is as described with reference to Fig. 6. If no abnormality is detected (step S4; No), the store exit management system 100 ends the operation.

[0130] The timing of step S22 is not particularly limited as long as it is performed after step S2. For example, step S22 may be performed after an abnormality is detected in step S4. In this case, the paid product information output unit 107 may obtain the number of paid products from the abnormality detection unit 104.

[0131] Furthermore, the timing at which the notification device 43 notifies the user of the number of paid items is not particularly limited. For example, the notification device 43 may notify the user of the number of paid items at the same time as notifying the user of the detection of an abnormality.

[0132] According to the third embodiment, the paid item information output unit 107 outputs the number of paid items to the notification device 43 in response to obtaining the paid code. The notification device 43 then notifies the number of paid items. Therefore, according to the third embodiment, for example, it is possible to prevent abnormalities regarding items taken out by customers who are leaving the store. Furthermore, according to the third embodiment, it is possible to assist a store clerk in checking whether there is a difference between the amount of items taken out by a customer who is leaving the store and the number of paid items, for example.

[0133] [Variations] The above embodiments may be modified. The store exit management system 100 is applicable to cases where there is one customer or a group of multiple customers. When there is a group of customers, each customer belonging to the group is associated with one payment-completed code. The estimation unit 103 may then estimate the total amount of merchandise taken out by the group from images of each customer's luggage. According to this modification, even when a representative of the group settles the bill and multiple customers cooperate to take out merchandise, it is possible to detect anomalies related to the merchandise being taken out.

[0134] [Hardware configuration] In each of the above-described embodiments, each component of the store exit management system 100 is shown as a functional block. Some or all of the components of the store exit management system 100 may be realized by any combination of a computer 500 and a program.

[0135] Fig. 11 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 11, the computer 500 includes, for example, a processor 501, a read only memory (ROM) 502, a random access memory (RAM) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0136] The program 504 includes instructions for implementing each function of the store exit management system 100. The program 504 is stored in advance in the ROM 502, RAM 503, and storage device 505. The processor 501 implements each function of the store exit management system 100 by executing the instructions included in the program 504. The RAM 503 may also store data processed in each function of the store exit management system 100. The number of ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, and storage device 505 is not particularly limited and may be one or more.

[0137] The processor 501 controls the entire computer 500. An example of the processor 501 is a CPU (Central Processing Unit). The number of processors 501 is not particularly limited, and the processor 501 may be one or more.

[0138] The drive device 507 reads and writes data from the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and receives information input from a store manager or the like. The output device 510 is, for example, a display, and outputs (displays) information to the store manager or the like. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0139] It should be noted that the hardware configuration shown in FIG. 11 is merely an example, and other components may be added, or some components may not be included.

[0140] There are various variations in the method of implementing the store exit management system 100. For example, the store exit management system 100 may be implemented by any combination of different computers and programs for each component. Furthermore, multiple components included in the store exit management system 100 may be implemented by any combination of a single computer and program.

[0141] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with each other without departing from the scope of the present disclosure.

[0142] A part or all of the above-described embodiments may be described as, but are not limited to, the following supplementary notes.

[0143] [Appendix 1] a code acquisition means for acquiring a payment completion code from a portable terminal operated by a customer when the product is registered and payment is made via the portable terminal; A payment product information acquisition means for acquiring a quantity of a payment product associated with the payment code; An estimation means for estimating an amount of merchandise taken out by a customer from an image of the customer's baggage as the customer leaves the store; an anomaly detection means for detecting an anomaly based on the acquired amount of the paid-for goods and the estimated amount of the goods to be taken out; an abnormality output means for outputting the detection of the abnormality; A store exit management system equipped with the above.

[0144] [Appendix 2] The anomaly detection means detects the anomaly based on a difference between the estimated amount of merchandise to be taken out and the amount of merchandise that has been paid for. The store exit management system described in Appendix 1.

[0145] [Appendix 3] The anomaly detection means detects the anomaly when a difference between the estimated amount of merchandise to be taken out and the amount of merchandise that has been paid for exceeds a threshold value. The store exit management system described in Appendix 2.

[0146] [Appendix 4] The abnormality detection means detects the abnormality when the estimated amount of the goods to be taken out is greater than the amount of the goods that has been paid for. 4. A store exit management system according to any one of claims 1 to 3.

[0147] [Appendix 5] The abnormality detection means detects the abnormality when the estimated amount of the product to be taken out is less than the amount of the product that has been paid for. 5. A store exit management system according to any one of claims 1 to 4.

[0148] [Appendix 6] The amount of the checked out product is a volume of the checked out product; The amount of the product to be taken out is the volume of the product to be taken out. 6. A store exit management system according to any one of claims 1 to 5.

[0149] [Appendix 7] The amount of the checked out product is the number of the checked out products; The amount of goods taken out is the number of goods taken out. 7. A store exit management system according to any one of appendix 1 to 6.

[0150] [Appendix 8] The estimation means estimates the amount of the goods to be taken out from the image of the baggage of the customer leaving the store and an image of the baggage of the customer before picking up the goods to be taken out. 8. A store exit management system according to any one of claims 1 to 7.

[0151] [Appendix 9] The store further includes a gate control means for controlling an exit gate through which the customer exits the store, The gate control means makes the exit gate in a state where passage is not possible when the abnormality is detected. 9. A store exit management system according to any one of appendix 1 to 8.

[0152] [Appendix 10] a payment product information output means for outputting the number of the paid products to a notification device in response to acquisition of the payment completion code; 10. The store exit management system according to any one of claims 1 to 9, further comprising:

[0153] [Appendix 11] When the product is registered and settled via a portable terminal operated by a customer, a settled code is obtained from the portable terminal; Obtaining a quantity of redeemed goods associated with the redeemed code; Estimating the amount of merchandise taken away by the customer from an image of the customer's baggage as the customer leaves the store; Detecting an anomaly based on the acquired amount of the paid-for goods and the estimated amount of the goods to be taken out; Output that the abnormality was detected Exit management method.

[0154] [Appendix 12] When the product is registered and settled via a portable terminal operated by a customer, a settled code is obtained from the portable terminal; Obtaining a quantity of redeemed goods associated with the redeemed code; Estimating the amount of merchandise taken away by the customer from an image of the customer's baggage as the customer leaves the store; Detecting an anomaly based on the acquired amount of the paid-for goods and the estimated amount of the goods to be taken out; Output that the abnormality was detected A recording medium that non-temporarily records a program that causes a computer to execute a process. [Explanation of symbols]

[0155] 1 Store System 100 Store Exit Management System 101 Code Acquisition Department 102 Settlement product information acquisition department 103 Estimation part 104 Anomaly detection unit 105 Abnormal output section 106 Gate control section 107 Payment product information output section 20 Portable terminals 21 Processing section 22 Memory section 31 POS Server 32 Product Database 33 Sales Database 34 Detected Anomaly Database 41 Leader 42 Camera 43 Alarm device 44 Exit Gate C1 Customer C2 Baggage

Claims

1. a code acquisition means for acquiring a code from a portable terminal operated by a customer when the product is registered and settled via the portable terminal; A payment product information acquisition means for acquiring a quantity of a payment product associated with the code; an estimation means for estimating an amount of merchandise in a shopping basket of the customer who is leaving the store from an image of the shopping basket; an anomaly detection means for detecting an anomaly based on the amount of the checked out merchandise and the amount of the merchandise in the shopping cart; an abnormality output means for outputting the detection of the abnormality; A store exit management system equipped with the above.

2. The estimation means estimates the amount of products in the shopping basket from an image taken from above the inside of the shopping basket. The store exit management system according to claim 1 .

3. The abnormality detection means detects the abnormality when a difference between an amount of products in the shopping cart and an amount of products that has been paid for exceeds a threshold value. The store exit management system according to claim 1 or 2.

4. The abnormality detection means detects the abnormality when the amount of products in the shopping cart is greater than the amount of the purchased products. The store exit management system according to any one of claims 1 to 3.

5. The abnormality detection means detects the abnormality when the amount of products in the shopping cart is less than the amount of the checked-out products. The store exit management system according to any one of claims 1 to 4.

6. The estimation means estimates the amount of the products in the shopping basket using a ratio of the volume of the shopping basket occupied by the products. The store exit management system according to any one of claims 1 to 5.

7. The estimation means estimates the amount of products in the shopping basket based on the position of the product in the top layer of the shopping basket. The store exit management system according to any one of claims 1 to 6.

8. The store further includes a gate control means for controlling an exit gate through which the customer exits the store, The gate control means makes the exit gate in a state where passage is not possible when the abnormality is detected. The store exit management system according to any one of claims 1 to 7.

9. When the product is registered and settled via a portable terminal operated by the customer, a code is obtained from the portable terminal; Obtaining a quantity of a checked-out item associated with the code; Estimating the amount of merchandise in the shopping basket from an image of the shopping basket of the customer who is leaving the store; Detecting an anomaly based on the amount of the checked out items and the amount of items in the shopping cart; Output that the abnormality was detected Exit management method.

10. When the product is registered and settled via a portable terminal operated by the customer, a code is obtained from the portable terminal; Obtaining a quantity of a checked-out item associated with the code; Estimating the amount of merchandise in the shopping basket from an image of the shopping basket of the customer who is leaving the store; Detecting an anomaly based on the amount of the checked out items and the amount of items in the shopping cart; Output that the abnormality was detected A program that causes a computer to carry out processing.

Images