Store Closure Management System, Store Closure Management Method, and Program

Abstract

To provide an exiting management system and the like that can support handling of an abnormality having occurred in relation to commodities to be taken out by an exiting customer when registration and settlement of commodities are performed through a portable terminal operated by the customer.SOLUTION: An exiting management system according to the present disclosure includes: code acquisition means for, when registration and settlement of commodities are performed through a portable terminal operated by a customer, acquiring a settled code from the portable terminal; settled commodity information acquisition means for acquiring the amount of settled commodities associated with the settled code; estimation means for estimating the amount of commodities to be taken out by the customer from an image captured by imaging baggage of the exiting customer; abnormality detection means for detecting an abnormality based on the acquired amount of settled commodities and the estimated amount of commodities to be taken out; and abnormality output means for outputting the fact that the abnormality has been detected.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a store exit management system and the like.

Background Art

[0002] There are stores where customers can register and settle goods through operations on a terminal. At the gates or counters of such stores, the store may manage the exit of customers by having the customers scan the terminal.

[0003] Patent Document 1 discloses a system in which customers register goods using a portable terminal. In Patent Document 1, when the terminal is returned to the terminal management device, settlement processing for the price of the registered goods is performed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When goods are registered and settled through customer operations, there may be a difference between the quantity of goods registered and settled and the quantity of goods taken out. For example, a difference occurs when a customer takes out goods without settlement or when a customer forgets the settled goods in the store. When such a difference occurs, it is preferable for the customer or the store clerk to take measures.

[0006] An object of the present disclosure is to provide a store exit management system and the like that can assist in dealing with abnormalities that occur with respect to the goods taken out by customers leaving the store when goods are registered and settled via a portable terminal operated by the customers.

Means for Solving the Problems

[0007] When merchandise registration and settlement are performed via a portable terminal operated by a customer, the checkout management system according to the present disclosure includes: a code acquisition unit that acquires a settled code from the portable terminal; a settled merchandise information acquisition unit that acquires the quantity of settled merchandise associated with the settled code; an estimation unit that estimates the quantity of merchandise taken out by the customer from an image of the customer's luggage taken before leaving the store; an abnormality detection unit that detects an abnormality based on the acquired quantity of settled merchandise and the estimated quantity of merchandise taken out; and an abnormality output unit that outputs that the abnormality has been detected.

[0008] When merchandise registration and settlement are performed via a portable terminal operated by a customer, the checkout management method according to the present disclosure acquires a settled code from the portable terminal, acquires the quantity of settled merchandise associated with the settled code, estimates the quantity of merchandise taken out by the customer from an image of the customer's luggage taken before leaving the store, detects an abnormality based on the acquired quantity of settled merchandise and the estimated quantity of merchandise taken out, and outputs that the abnormality has been detected.

[0009] When merchandise registration and settlement are performed via a portable terminal operated by a customer, the program according to the present disclosure causes a computer to execute a process of acquiring a settled code from the portable terminal, acquiring the quantity of settled merchandise associated with the settled code, estimating the quantity of merchandise taken out by the customer from an image of the customer's luggage taken before leaving the store, detecting an abnormality based on the acquired quantity of settled merchandise and the estimated quantity of merchandise taken out, and outputting that the abnormality has been detected. The program may be stored in a non-transitory computer-readable recording medium.

Advantages of the Invention

[0010] According to the present disclosure, when merchandise registration and settlement are performed via a portable terminal operated by a customer, it is possible to assist in dealing with abnormalities related to merchandise taken out by a customer leaving the store.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Modes for Carrying Out the Invention

[0012] Hereinafter, embodiments of a checkout management system, a checkout management method, a program, and a recording medium for non-temporarily recording the program according to the present disclosure will be described with reference to the drawings. The present embodiment does not limit the disclosed technology.

[0013] [First Embodiment] The store exit management system 100 according to the first embodiment is a system that manages the quantity of goods that a customer takes out when leaving the store and the quantity of goods that the customer has settled. The store exit management system 100 is used as the store system 1. FIG. 1 is a block diagram showing a configuration example of the store system 1 according to the first embodiment. The store exit management system 100 includes a code acquisition unit 101, a settled goods information acquisition unit 102, an estimation unit 103, an abnormality detection unit 104, and an abnormality output unit 105.

[0014] In addition to the store exit management system 100, the store system 1 includes a POS (Point of Sales) server 31, a product database 32, and a sales database 33. The store exit management system 100, the POS server 31, the product database 32, and the sales database 33 are communicably connected by wire or wirelessly as appropriate according to the specific configuration of each system. Further, the POS server 31 is communicably connected to the portable terminal 20 by wire or wirelessly. The portable terminal 20 is a terminal operated by the customer.

[0015] The POS server 31 manages, for example, various information related to goods sold in the store. The POS server 31 may be an application server. In addition to the portable terminal 20, the POS server 31 may also manage the registration and settlement of goods using other terminals other than the portable terminal 20, such as a POS terminal operated by a store clerk. That is, in the store, either the existing POS terminal or the portable terminal 20 may be used for the registration and settlement of goods.

[0016] Further, the POS server 31 transmits a settled code to the portable terminal 20. The transmitted settled code is held by the portable terminal 20. The settled code is not particularly limited as long as it indicates that the customer has completed the settlement. The settled code is also associated with information related to the settlement. The information related to the settlement includes, for example, the number of settled goods, the identification information of the settled goods, or the total amount. Since the settled code is used when the customer leaves the store, it is also called an exit code.

[0017] For example, a settlement ID (Identifier) may be used as the settlement code. The settlement ID uniquely identifies each settlement. Alternatively, a transaction ID or a customer ID may be used as the settlement code. The transaction ID uniquely identifies each transaction, with the entire process from the start of the product registration process to the completion of settlement being considered as one transaction. Also, the customer ID uniquely identifies the customer. The transaction ID and customer ID can be used as the settlement code, for example, by being linked to information indicating that the settlement has been completed.

[0018] The product database 32 stores product identification information and product information in association with each other for each product. For example, if the product identification information is a product code, the product information is information such as the product name and product price. Note that the product information is not particularly limited.

[0019] The sales database 33 stores, for example, information about sales for each store. The sales database 33 also manages, for example, information about each settlement for each store. The sales database 33 may store information about each settlement in association with a settlement code.

[0020] The store system 1 also includes a reader 41 and a camera 42. Multiple readers 41 and multiple cameras 42 may be provided. The reader 41 and the camera 42 are installed in the store. However, the camera 42 may be realized by a camera provided in the portable terminal 20. The store exit management system 100 is connected to the reader 41 and the camera 42 so that they can communicate with each other via wired or wireless communication.

[0021] The reader 41 reads the paid code from the portable terminal 20. The method by which the reader 41 reads the paid code is not particularly limited. For example, the reader 41 may read a barcode or a two-dimensional code encoding the paid code displayed on the display of the portable terminal 20. Alternatively, the reader 41 may receive the paid code from the portable terminal 20 via wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. The reader 41 transmits the read paid code to the code acquisition unit 101 of the store exit management system 100.

[0022] The camera 42 photographs the customer's luggage. Then, the camera 42 transmits the photographed image to the store exit management system 100.

[0023] The luggage is at least one object carried by the customer. The camera 42 may photograph the luggage placed in front of the camera 42. Alternatively, the camera 42 may photograph the customer carrying the luggage to photograph the luggage carried by the customer.

[0024] The camera 42 photographs, for example, an image of the luggage of the customer leaving the store. In this case, the camera 42 may be installed near the exit of the store.

[0025] FIG. 2 is a schematic diagram showing an installation example of the reader 41 and the camera 42. The reader 41 is installed, for example, on the counter. Also, the camera 42 is installed so as to be able to photograph the luggage placed on the counter from above the counter. The customer C1 places the luggage C2 on the counter before leaving the store and has the reader 41 read the paid code displayed on the portable terminal 20. After having the reader 41 read the paid code, the customer C1 leaves the store.

[0026] FIG. 3 is a schematic diagram showing another installation example of the reader 41 and the camera 42. The reader 41 is installed, for example, at the exit gate 44. The exit gate 44 is a gate through which customers who are leaving the store pass. When a settled code is presented, the exit gate 44 is set to a state where customers can pass through. The camera 42 is installed, for example, so as to be able to photograph customers passing through the exit gate 44. For example, the customer C1 makes the reader 41 read the settled code displayed on the portable terminal 20 while carrying the luggage C2. After making the reader 41 read the settled code, the customer C1 passes through the exit gate 44.

[0027] Note that the installation examples of the reader 41 and the camera 42 are not limited to the above examples. The reader 41 and the camera 42 may be provided at other locations in the store. That is, the reading of the settled code and the taking of images may be performed at different locations respectively.

[0028] In the first embodiment, a case where the store system 1 further includes a detection abnormality database 34 and a notification device 43 will be described. The store system 1 may not include the detection abnormality database 34 and the notification device 43. The exit management system 100 is communicably connected to the detection abnormality database 34 and the notification device 43.

[0029] The detection abnormality database 34 stores the abnormalities detected in the exit management system 100. The notification device 43 may refer to the detection abnormality database 34 and notify the detected abnormalities in response to a request from the store manager.

[0030] The notification device 43 notifies the abnormalities detected in the exit management system 100. The notification device 43 is, for example, a display, a speaker, or a lamp. A plurality of notification devices 43 may be provided in the store. The notification device 43 may notify the abnormalities to the customers who are leaving the store. Also, the notification device 43 may notify the abnormalities to the store employees. In this case, the notification device 43 may be a terminal operated by the store employees.

[0031] The notification device 43 may be provided at the counter where the reader 41 is installed. Further, the notification device 43 may be provided at the exit gate 44 as shown in FIG. 3. By providing the notification device 43 near the reader 41, the notification device 43 can notify a customer who is leaving the store abnormally of the abnormality. Further, the notification device 43 can also notify a store clerk or other customers near the customer who is leaving the store of the abnormality.

[0032] The checkout management system 100, the POS server 31, and each database related to the store system 1 may be installed, for example, in the backyard of the store, but the installation location is not particularly limited. A part of the devices constituting the store system 1 may be realized by a cloud server.

[0033] The checkout management system 100, the POS server 31, and each system including each database related to the store system 1 may each be realized by a separate information processing device. Alternatively, the functions of each system may be realized by a single information processing device. For example, each database related to the store system 1 may be included in the information processing device that realizes the POS server 31. Further, each system may each be realized by a combination of a plurality of information processing devices.

[0034] The portable terminal 20 is, for example, a portable terminal such as a smartphone or a tablet. The type of the portable terminal 20 is not particularly limited. The portable terminal 20 may be owned by a customer or may be lent out in the store. The portable terminal 20 may be attached to a shopping basket or a shopping cart, or may be provided integrally with the shopping basket or the shopping cart. When the portable terminal 20 is attached to the shopping cart, the shopping cart may be self-propelled by including, for example, a movable part such as a tire and a driving device such as a motor.

[0035] FIG. 4 is a block diagram showing a configuration example of the portable terminal 20. The portable terminal 20 includes a processing unit 21 and a storage unit 22. By installing an application program in the storage unit 22, the following functions of the processing unit 21 may be realized. The processing unit 21 may not have some of the functions described below.

[0036] Hereinafter, the configurations of the store system 1 and the portable terminal 20 will be described in more detail.

[0037] <Input of Identification Information> The processing unit 21 of the portable terminal 20 receives an input of identification information of a product. The POS server 31 may display a screen for receiving an input of identification information.

[0038] The processing unit 21 receives an input of identification information of a product, for example, via a camera (not shown). The camera is not particularly limited, but for example, it is a camera provided in the portable terminal 20. The processing unit 21 may receive an input of identification information by reading a one-dimensional code or a two-dimensional code of a product photographed by an imaging device. Further, the processing unit 21 may receive an input of identification information by identifying a product from an image of the product photographed by an imaging device using image recognition technology.

[0039] Also, the processing unit 21 may acquire identification information by reading a tag to which an RFID (Radio Frequency Identifier) is attached via a reading device. When using RFID, the reading device is an RFID reader.

[0040] Also, the processing unit 21 may receive identification information of a product by receiving a selection of a product from the results of a product search. For example, the method of product search is not particularly limited. The product search may be performed by characters or by an image. For example, the processing unit 21 may receive an input of identification information by receiving a selection of a product from the displayed image of the product.

[0041] Further, the processing unit 21 of the portable terminal 20 may receive the input of identification information by receiving the input of numbers such as product codes via an input device (not shown). Examples of the input device include a touch panel display, a keyboard capable of inputting numbers and characters, and the like.

[0042] The processing unit 21 of the portable terminal 20 transmits the identification information of the product received as described above to the POS server 31. For the product for which the identification information has been transmitted and registered, the processing unit 21 may display the product information according to the control of the POS server 31.

[0043] <Registration of Product> The POS server 31 registers the product based on the identification information received from the portable terminal 20. The POS server 31 refers to the product database 32 to acquire the product information. Then, the POS server 31 uses the acquired product information to register the product purchased by the customer. As a process of registering the product, the POS server 31 generates, for example, a registered product list for each customer.

[0044] <Processing Related to Settlement> Furthermore, the processing unit 21 of the portable terminal 20 executes processing related to the settlement of the registered product. Hereinafter, cases where the settlement is performed via a settlement server and cases where the settlement is performed using a settlement device installed in the store will be described. However, the settlement method is not limited to these.

[0045] When the settlement is performed via a settlement server, the processing unit 21 of the portable terminal 20 may communicate with a settlement server (not shown) as processing related to settlement and instruct the settlement server to perform settlement. For example, the processing unit 21 transmits to the settlement server an instruction for settlement including settlement information and settlement details information. The settlement information is information specifying the customer's credit card, debit card, electronic money, or points. The settlement details information is information specifying the registered product or the purchase amount of the registered product. The settlement server performs cashless settlement using the settlement information and the settlement details information. The settlement server notifies, for example, the completion of the settlement to the portable terminal 20 and the POS server 31.

[0046] Note that the processing unit 21 of the portable terminal 20 may give an instruction for settlement to the settlement server via the POS server 31 or the store exit management system 100. Also, part or all of the functions of the settlement server may be realized by the store exit management system 100 or the POS server 31.

[0047] Alternatively, when settlement is performed using a settlement device installed in the store, the processing unit 21 of the portable terminal 20 may output information for specifying settlement information to the settlement device as processing related to settlement. The information for specifying settlement information is stored in the POS server 31 in association with the settlement information, for example. Based on the information for specifying the received output settlement information, the settlement device acquires the settlement information from the POS server 31, for example. Based on the acquired settlement information, the settlement device executes settlement processing by any method such as cash settlement or cashless settlement. The settlement device notifies the portable terminal 20 and the POS server 31 of the completion of settlement, for example.

[0048] The method for outputting information for specifying settlement information to the settlement device is not particularly limited. For example, the processing unit 21 may display a barcode or a two-dimensional code obtained by encoding the information for specifying settlement information on the display of the portable terminal 20. The settlement device reads the information for specifying the settlement information displayed on the display. Alternatively, the processing unit 21 may transmit the information for specifying settlement information to the settlement device by wireless communication such as NFC (Near Field Communication), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0049] Note that the processing unit 21 may output settlement information to the settlement device as processing related to settlement. In this case, the settlement device acquires the settlement information from the portable terminal 20.

[0050] The POS server 31 stores information related to settlement in the sales database 33. Also, after the settlement is completed, the POS server 31 transmits a settled code to the portable terminal 20.

[0051] <Detection of Abnormality> When the code acquisition unit 101 of the store exit management system 100 performs product registration and settlement via the portable terminal 20, it acquires the settled code from the portable terminal 20.

[0052] The code acquisition unit 101 of the store exit management system 100 acquires the settled code from the portable terminal 20 via the reader 41. In this case, the processing unit 21 of the portable terminal 20 first outputs the settled code.

[0053] For example, the processing unit 21 transmits the settled code to the reader 41 by wireless communication.

[0054] Alternatively, the processing unit 21 causes a barcode or a two-dimensional code obtained by encoding the settled code to be displayed on the display of the portable terminal 20. FIG. 5 is a diagram showing an example of a display screen of the settled code displayed on the portable terminal 20. In the display screen of FIG. 5, a two-dimensional code obtained by encoding the settled code is displayed. Before leaving the store, the customer causes the barcode displayed on the portable terminal 20 to be read by the reader 41.

[0055] Then, the code acquisition unit 101 acquires the read settled code from the reader 41.

[0056] The settled product information acquisition unit 102 acquires the quantity of the settled products associated with the settled code. For example, the settled product information acquisition unit 102 refers to the sales database 33 and acquires the quantity of the settled products associated with the settled code.

[0057] The quantity of the settled products may be the number of the settled products. Also, the quantity of the settled products may be the volume of the settled products. The settled product information acquisition unit 102 may, for example, estimate the volume of the products from the number of the settled products. Alternatively, the settled product information acquisition unit 102 may refer to the volume of the products stored in the product database 32 and acquire the volume of the settled products.

[0058] The estimation unit 103 estimates the quantity of the goods taken out by the customer from the image of the customer's luggage being photographed when leaving the store. The quantity of the goods taken out may be the number of the goods taken out. Also, the quantity of the goods taken out may be the volume of the goods taken out.

[0059] A method for estimating the quantity of the goods taken out will be described below.

[0060] The estimation unit 103, for example, acquires an image of the customer's luggage being photographed when leaving the store from the camera 42. The estimation unit 103 recognizes the luggage from the acquired image. The estimation unit 103 may recognize goods as the luggage. The estimation unit 103 may also recognize the goods contained in the container from the image of the inside of the container being photographed. The container for containing the goods is, for example, a bag, a paper bag, a plastic bag, a cardboard box, or a shopping basket. The estimation unit 103 may estimate the quantity of the recognized goods as the quantity of the goods taken out.

[0061] When the goods are contained in a container, it may be difficult to recognize all the goods. For example, when the image of the customer's luggage being photographed is taken from the outside of the container, the goods inside the container may not be visible. Therefore, the estimation unit 103 may recognize the container as the luggage. Then, the estimation unit 103 may recognize the volume of the container by using an existing technique related to the measurement of the size based on the image. Also, when the customer puts goods into a container with a known volume, the estimation unit 103 may recognize the volume of the container by recognizing the type of the container. The estimation unit 103 may estimate the volume of the container recognized in this way as the quantity of the goods taken out.

[0062] As an example, a plastic bag may increase in volume as goods are put into it. Therefore, it is possible to estimate the volume of the plastic bag as the volume of the goods contained in the plastic bag.

[0063] Also, the customer may not fill the container with goods completely. Therefore, the estimation unit 103 may estimate the quantity of the goods inside the container as the quantity of the goods taken out.

[0064] The estimating unit 103 may estimate the quantity of the product in the container by using the ratio of the volume of the container occupied by the product. The estimating unit 103 may recognize the volume of the container by using existing techniques related to the measurement of the size based on the image. Also, when the customer puts the product into a container with a known volume, the estimating unit 103 may recognize the volume of the container by recognizing the type of the container. Then, for example, the estimating unit 103 recognizes the position of the topmost product in the container from the image. Further, the estimating unit 103 recognizes the bottom and the top end of the container from the image. Then, the estimating unit 103 calculates the ratio of the volume of the container occupied by the product by dividing the height from the bottom of the container to the position of the topmost product by the height of the container. The estimating unit 103 may estimate the volume obtained by multiplying the ratio of the volume of the container occupied by the product by the volume of the container as the quantity of the product in the container.

[0065] Also, the estimating unit 103 may estimate the quantity of the product in the container by using the quantity of the topmost product in the container and the number of layers of the products in the container. For example, the estimating unit 103 recognizes the topmost product in the container from an image taken from above the inside of the container. Also, the estimating unit 103 recognizes the position of the topmost product in the container and the position of the bottom of the container from the image. Further, the estimating unit 103 estimates the number of layers of the products in the container from the height from the bottom of the container to the topmost product. Then, the estimating unit 103 may estimate the value obtained by multiplying the quantity of the surface layer product by the estimated number of layers of the products as the total quantity of the products in the container.

[0066] As an example, it is assumed that the customer puts the products that have been settled in the shopping basket and takes the products out of the store. If the volume of the shopping basket is known, the estimating unit 103 can estimate the volume of the product in the container according to the position of the topmost product in the shopping basket.

[0067] The estimating unit 103 may estimate the number of products to be taken out from the volume of the products to be taken out. For example, the estimating unit 103 may estimate the number of products to be taken out by dividing the result of estimating the volume of the products to be taken out by the average volume of the products.

[0068] Furthermore, the estimation unit 103 may estimate the quantity of the merchandise to be taken out based on an image of the customer's luggage taken when the customer is leaving the store and an image of the customer's luggage taken before the customer has the merchandise to be taken out.

[0069] The camera 42 captures, for example, an image of the customer's luggage before the customer has the merchandise to be taken out. The camera 42 that captures an image of the customer before the customer has the merchandise may be installed, for example, near the entrance of the store. The estimation unit 103 acquires the image from the camera 42.

[0070] The estimation unit 103 recognizes the customer's luggage for each image, for example, and estimates the volume of the recognized luggage. The estimation unit 103 may estimate the volume obtained by subtracting the volume of the luggage recognized for the customer before having the merchandise from the volume of the luggage recognized for the customer leaving the store as the quantity of the merchandise to be taken out.

[0071] As an example, the customer may put the merchandise that has been settled in the bag brought in. The bag may contain items that the customer brings into the store from outside the store. The camera 42 transmits, for example, an image of the bag before the customer puts the merchandise in it to the estimation unit 103 near the entrance. Also, the camera 42 transmits an image of the bag after the customer puts the merchandise in it to the estimation unit 103 near the exit. Then, the estimation unit 103 may calculate the volume of the bag from each image and estimate the quantity of the merchandise to be taken out.

[0072] For example, the customer may register which bag to put the merchandise in before having the merchandise in the store. The customer may register the bag by having the camera 42 capture the bag brought in.

[0073] Also, the estimation unit 103 may perform object recognition of each piece of luggage included in the image. Then, the estimation unit 103 may recognize, for example, the objects obtained by excluding the objects recognized in the image of the customer's luggage before the customer has the merchandise in the store from the objects recognized in the image of the customer's luggage leaving the store as the merchandise to be taken out.

[0074] The method for estimating the quantity of goods to be taken out has been described above. The methods described above may be used in combination. Also, the method for estimating the goods to be taken out is not limited to the above examples.

[0075] Note that the recognition of the customer's luggage may be performed by the camera 42. The camera 42 may transmit the recognized result to the store exit management system 100. The estimation unit 103 acquires the result of recognizing the customer's luggage from the camera 42.

[0076] The abnormality detection unit 104 detects an abnormality based on the quantity of the settled goods acquired by the settlement goods information acquisition unit 102 and the quantity of the goods to be taken out estimated by the estimation unit 103. An abnormality means that there is a difference between the quantity of the settled goods and the quantity of the goods to be taken out. For example, when the quantity of the goods to be taken out is more than the quantity of the settled goods, there is a possibility that un-settled goods are being illegally taken out by the customer. Also, when the quantity of the goods to be taken out is less than the quantity of the settled goods, there is a possibility that the customer has left the settled goods in the store. Therefore, the abnormality detection unit 104 detects an abnormality based on the difference between the quantity of the settled goods and the quantity of the goods to be taken out.

[0077] The abnormality detection unit 104 may detect an abnormality when the quantity of the goods to be taken out estimated by the estimation unit 103 is more than the quantity of the settled goods acquired by the settlement goods information acquisition unit 102. That is, the abnormality detection unit 104 may detect an abnormality when it is estimated that there are goods among the goods to be taken out for which settlement has not been performed.

[0078] Also, the abnormality detection unit 104 may detect an abnormality when the quantity of the goods to be taken out estimated by the estimation unit 103 is less than the quantity of the settled goods acquired by the settlement goods information acquisition unit 102. That is, the abnormality detection unit 104 may detect an abnormality when, for example, it is estimated that there are goods left in the store despite having been settled.

[0079] When the abnormality detection unit 104 detects an abnormality, a threshold value may be set for the difference between the quantity of the paid-for goods and the quantity of the goods taken out. For example, the abnormality detection unit 104 may detect an abnormality when the difference between the quantity of the goods taken out and the quantity of the paid-for goods exceeds the threshold value. By setting the threshold value, the number of detected abnormalities can be suppressed.

[0080] The threshold value may be set according to the estimation accuracy of the quantity of the goods taken out. When the difference between the quantity of the goods taken out and the quantity of the paid-for goods is small, the abnormality detection unit 104 may have a risk of false detection of an abnormality. Therefore, for example, when the estimation accuracy of the estimation unit 103 is low, the threshold value may be set high. When the difference does not exceed the threshold value, the abnormality detection unit 104 may determine that it is an error in the estimation.

[0081] Also, the threshold value may be set according to the goods paid for by the customer. Depending on the goods, it may be difficult to recognize the volume from the image, and the estimation accuracy by the estimation unit 103 may decrease. Therefore, when the goods paid for by the customer include goods for which it is difficult to recognize the volume from the image, the threshold value may be set high.

[0082] Also, the threshold value may be set according to the amount of the goods paid for by the customer. For example, the threshold value may be set low when the paid amount is high. Thereby, for a customer who may have a low paid amount by paying for a quantity less than the actual quantity of the goods taken out, the abnormality detection unit 104 can appropriately detect an abnormality even if the difference in the quantity of the goods is small. Or, the threshold value may be set low when the paid amount is low. Thereby, for a customer who may be reducing the paid amount by paying for a quantity less than the actual quantity of the goods taken out, the abnormality detection unit 104 can appropriately detect an abnormality even if the difference in the quantity of the goods is small.

[0083] Further, the threshold value may be set according to the congestion level. The congestion level may be the real-time congestion level or the congestion level predicted for each time zone. For example, when the store is crowded, the threshold value may be set high. As a result, it becomes difficult to detect an abnormality, so further congestion due to confirmation of the abnormality can be prevented. Alternatively, when the store is crowded, the threshold value may be set low. As a result, it becomes easy to detect an abnormality, so it is possible to prevent unaccounted-for items from being carried out unnoticed due to congestion.

[0084] Further, the threshold value may be set according to the customer. For example, for a customer who has been detected as having an abnormality in the past, the threshold value may be set low. Thereby, an abnormality can be detected for a customer who is likely to commit fraud.

[0085] The abnormality detection unit 104 may notify the abnormality output unit 105 of the difference between the quantity of settled items and the estimated quantity of items to be carried out as the degree of abnormality.

[0086] <Notification of Abnormality> The abnormality output unit 105 outputs that an abnormality has been detected. For example, the abnormality output unit 105 may output to the notification device 43 that an abnormality has been detected and cause the notification device 43 to notify of the abnormality. Further, the abnormality output unit 105 may output to the detected abnormality database 34 that an abnormality has been detected and store the detected abnormality in the database.

[0087] By storing the detected abnormality in the detected abnormality database 34, the store manager can confirm the abnormality even after the customer has left the store. Then, when the customer comes to the store next time, the manager may observe the customer attentively.

[0088] The abnormality output unit 105 may cause the notification device 43 to output an alarm sound or an alarm display.

[0089] Alternatively, as an indication that an abnormality has been detected, the abnormality output unit 105 may cause the notification device 43 to notify, by voice or display, the number of settled items. That is, when no abnormality is detected, the abnormality output unit 105 does not cause the number of settled items to be notified. Therefore, based on whether or not the number of settled items is notified, a store clerk or customer can determine whether or not an abnormality has been detected. The abnormality output unit 105 can obtain the number of settled items, for example, from the abnormality detection unit 104, the settled item information acquisition unit 102, or the sales database 33. Note that other information regarding the settled items may be used instead of the number of settled items.

[0090] The abnormality output unit 105 may change the notification device 43 to be output based on the difference between the quantity of items taken out and the quantity of settled items. For example, when the quantity of items taken out is greater than the quantity of settled items, the abnormality output unit 105 may cause the notification device 43 for store clerks to notify that an abnormality has been detected. Thereby, for example, the store clerk can check whether there are any items being taken out illegally or check the customer's luggage. Also, when the quantity of items taken out is less than the quantity of settled items, the abnormality output unit 105 may cause the notification device 43 for customers to notify that an abnormality has been detected. Thereby, for example, the customer can check whether there are any items left in the store.

[0091] The abnormality output unit 105 may output that an abnormality has been detected according to the degree of the detected abnormality.

[0092] As an example, the abnormality output unit 105 may change the notification level in the notification device 43 according to the difference between the quantity of settled items and the estimated quantity of items taken out. For example, when the difference is large, the abnormality output unit 105 causes the notification device 43 to execute a higher-level notification than when the difference is small. A higher-level notification is a notification that attracts more attention from people.

[0093] When the difference is small, there is a possibility that an abnormality has been misdetected, so a low-level notification may be issued. When the difference is large, since there is a high possibility that an abnormality has occurred, a high-level notification may be issued. Also, when the difference is large, there is a possibility that more products are taken out without being settled, or that more settled products are left in the store. Therefore, a high-level notification that conveys a higher level of urgency may be issued.

[0094] When the notification device 43 is a speaker, the abnormality output unit 105 may output a short notification sound to the speaker, for example, when the difference is small. And the abnormality output unit 105 may output an alarm sound to the speaker when the difference is large. When the notification device 43 is a display, the abnormality output unit 105 may display the abnormality in yellow when the difference is small and display the abnormality in red when the difference is large, for example.

[0095] Next, the operation of the store exit management system 100 will be described. FIG. 6 is a flowchart showing an operation example of the store exit management system 100 according to the first embodiment. For example, the store exit management system 100 may start the processing of FIG. 6 in response to the reader 41 reading the settled code.

[0096] The code acquisition unit 101 of the store exit management system 100 acquires the settled code from the portable terminal 20 via the reader 41 (step S1). The code acquisition unit 101 notifies the settled product information acquisition unit 102 of the acquired settled code.

[0097] The settled product information acquisition unit 102 acquires the quantity of the settled products associated with the settled code (step S2). The settled product information acquisition unit 102 notifies the abnormality detection unit 104 of the acquired quantity of the settled products.

[0098] The estimation unit 103 estimates the quantity of products taken out by the customer from the image of the customer's luggage at the time of store exit (step S3). The estimation unit 103 notifies the abnormality detection unit 104 of the estimated quantity of products taken out by the customer.

[0099] The abnormality detection unit 104 detects an abnormality based on the quantity of settled goods and the estimated quantity of goods to be taken out (step S4). The abnormality detection unit 104 notifies the detected abnormality to the abnormality output unit 105. If no abnormality is detected, the store exit management system 100 ends its operation.

[0100] The abnormality output unit 105 outputs that an abnormality has been detected (step S5). For example, due to the output of the abnormality, the store exit management system 100 ends its operation. Note that the store exit management system 100 appropriately repeats the above-described series of operations for each customer, for example.

[0101] According to the first embodiment, when goods are registered and settled via the portable terminal 20, the code acquisition unit 101 acquires a settled code from the portable terminal 20. Then, the settled goods information acquisition unit 102 acquires the quantity of settled goods associated with the settled code. The estimation unit 103 estimates the quantity of goods to be taken out by the customer from an image of the customer's luggage at the time of store exit. Further, the abnormality detection unit 104 detects an abnormality based on the quantity of settled goods and the estimated quantity of goods to be taken out. Then, the abnormality output unit 105 outputs that an abnormality has been detected. Therefore, according to the first embodiment, when goods are registered and settled via the portable terminal operated by the customer, it is possible to assist in dealing with abnormalities related to the goods taken out by the customer at the time of store exit.

[0102] [Second Embodiment] Next, as a second embodiment, another example of the store system 1 including the store exit management system 100 will be described. The configuration of the second embodiment is the same as a part of the configuration of the first embodiment. Therefore, the description of the same configuration will be omitted. FIG. 7 is a block diagram showing a configuration example of the store system 1 according to the second embodiment.

[0103] The store exit management system 100 according to the second embodiment is different from the store exit management system 100 according to the first embodiment in that it includes a gate control unit 106.

[0104] Also, in the second embodiment, the store system 1 further includes a checkout gate 44. The checkout management system 100 is communicably connected to the checkout gate 44.

[0105] An installation example of the checkout gate 44 is as shown in FIG. 3. However, the installation example of the checkout gate 44 is not limited to this example.

[0106] The gate control unit 106 controls whether the checkout gate 44 is in a passable state or a non-passable state. For example, the gate control unit 106 may control the opening and closing of the checkout gate 44. The gate control unit 106 may open the checkout gate 44 to make it in a passable state for customers and close the checkout gate 44 to make it in a non-passable state for customers.

[0107] When an abnormality is detected, the gate control unit 106 may set the checkout gate 44 to a non-passable state. For example, the abnormality output unit 105 outputs to the gate control unit 106 that an abnormality has been detected. When the gate control unit 106 receives the output that an abnormality has been detected from the abnormality output unit 105, it sets the checkout gate 44 to a non-passable state.

[0108] Next, the operation of the checkout management system 100 according to the second embodiment will be described. FIG. 8 is a flowchart showing an operation example of the checkout management system 100 according to the second embodiment. For example, when the reader 41 installed at the checkout gate 44 reads the settled code, the checkout management system 100 may start the processing in FIG. 8.

[0109] The code acquisition unit 101 of the checkout management system 100 acquires the settled code from the portable terminal 20 via the reader 41 (step S11). The code acquisition unit 101 notifies the acquired settled code to the settled product information acquisition unit 102.

[0110] The settlement product information acquisition unit 102 acquires the quantity of the settled products associated with the settlement code (step S12). The settlement product information acquisition unit 102 notifies the acquired quantity of the settled products to the abnormality detection unit 104.

[0111] The estimation unit 103 estimates the quantity of the products taken out by the customer from the image of the customer's luggage taken at the time of leaving the store (step S13). The estimation unit 103 notifies the estimated quantity of the products taken out by the customer to the abnormality detection unit 104.

[0112] The abnormality detection unit 104 detects an abnormality based on the quantity of the settled products and the estimated quantity of the products taken out. When the abnormality detection unit 104 detects an abnormality (step S14; Yes), it notifies the detected abnormality to the abnormality output unit 105.

[0113] The abnormality output unit 105 outputs to the gate control unit 106 that an abnormality has been detected (step S15). In response to the output that an abnormality has been detected, the gate control unit 106 sets the state such that it is impossible to pass through the exit gate 44 (step S16).

[0114] When the abnormality detection unit 104 does not detect an abnormality (step S14; No), it outputs to the gate control unit 106 that there is no abnormality. In response to the output that there is no abnormality, the gate control unit 106 sets the state such that it is possible to pass through the exit gate 44 (step S17).

[0115] For example, due to the control of the gate by the gate control unit 106, the exit management system 100 ends its operation.

[0116] According to the second embodiment, when an abnormality is detected, the gate control unit 106 sets the state such that it is impossible to pass through the exit gate 44. Therefore, according to the second embodiment, when there is an abnormality regarding the products taken out, it is possible to control so that the customer is not allowed to leave the store.

[0117] [Third Embodiment] Next, as a third embodiment, another example of the store system 1 including the checkout management system 100 will be described. The configuration of the third embodiment is the same as a part of the configuration of the first embodiment. Therefore, the description of the same configuration will be omitted. FIG. 9 is a block diagram showing a configuration example of the store system 1 according to the third embodiment.

[0118] The checkout management system 100 according to the third embodiment differs from the checkout management system 100 according to the first embodiment in that it includes a settled product information output unit 107. Further, the store system 1 according to the third embodiment includes a notification device 43.

[0119] The settled product information output unit 107 outputs the number of settled products to the notification device 43 in response to the acquisition of the settled code. In the third embodiment, the settled product information output unit 107 causes the notification device 43 to notify the number of settled products regardless of whether an abnormality is detected.

[0120] The settled product information output unit 107 acquires the number of settled products from, for example, the settled product information acquisition unit 102. Then, the settled product information output unit 107 outputs the acquired number of settled products to the notification device 43.

[0121] In the third embodiment, the notification device 43 notifies the number of settled products received. The notification device 43 is, for example, a display or a speaker. Also, the notification device 43 notifies the abnormality detected in the checkout management system 100 in the same manner as in the first embodiment.

[0122] The notification device 43 may notify the customer of the number of settled products. Thereby, it can be shown to the customer who is checking out that the number of settled products is grasped. Therefore, it is expected to prevent the customer from checking out without settling some of the products.

[0123] In addition, the notification device 43 may notify the store clerk of the number of settled goods. As a result, the store clerk can check whether there is a difference between the quantity of goods taken out by the customer leaving the store and the number of settled goods. That is, double-checking of the detection of abnormalities by the checkout management system 100 and the confirmation of abnormalities by the store clerk is realized.

[0124] Note that other information regarding the settled goods may be used and notified instead of the number of settled goods.

[0125] FIG. 10 is a flowchart showing an operation example of the checkout management system 100 according to the third embodiment. For example, the checkout management system 100 may start the processing of FIG. 10 in response to the reader 41 reading the settlement code.

[0126] The flowchart of FIG. 10 includes the basic operations of the checkout management system 100 in the flowchart of FIG. 6 according to the first embodiment. Therefore, the parts different from the flowchart of FIG. 6 will be described for the flowchart of FIG. 10.

[0127] In step S2, for example, the settlement goods information acquisition unit 102 notifies the settlement goods information output unit 107 of the number of settled goods among the quantity of settled goods.

[0128] After step S2, the settlement goods information output unit 107 outputs the number of settled goods to the notification device 43 (step S22). The notification device 43 receives the output and notifies the number of settled goods.

[0129] The operations after step S22 are as described with respect to FIG. 6. If no abnormality is detected (step S4; No), the checkout management system 100 ends the operation.

[0130] Note that as long as step S22 is after step S2, the timing of execution is not particularly limited. For example, step S22 may be executed after an abnormality is detected in step S4. In this case, the settlement product information output unit 107 may acquire the number of settled products from the abnormality detection unit 104.

[0131] Also, the timing at which the notification device 43 notifies the number of settled products is not particularly limited. For example, the notification device 43 may notify the number of settled products simultaneously with the notification of the detection of an abnormality.

[0132] According to the third embodiment, the settlement product information output unit 107 outputs the number of settled products to the notification device 43 in response to the acquisition of the settled code. Then, the notification device 43 notifies the number of settled products. Therefore, according to the third embodiment, for example, it is possible to suppress an abnormality regarding the products taken out by a customer leaving the store. Also, according to the third embodiment, for example, by looking at the quantity of products taken out by a customer leaving the store, it is possible to assist the store clerk in confirming whether there is no difference from the number of settled products.

[0133] [Modification Example] Each of the above embodiments may be used in a modified form. The checkout management system 100 is applicable whether the customer is alone or a group composed of a plurality of people. When the customer is a group, each customer belonging to the group is associated with one settled code. Then, the estimation unit 103 can estimate the total quantity of products taken out by the group from the images of the respective luggage of each customer. According to this modification example, even when the representative of the group settles the bill and a plurality of customers cooperate to take out the products, it is possible to detect an abnormality regarding the products taken out.

[0134] [Hardware Configuration] In each of the above-described embodiments, each component of the checkout management system 100 indicates a block of a functional unit. A part or all of each component of the checkout management system 100 may be realized by any combination of a computer 500 and a program.

[0135] FIG. 11 is a block diagram showing an example of the hardware configuration of computer 500. Referring to FIG. 11, computer 500 includes, for example, a processor 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0136] Program 504 includes instructions for implementing each function of the checkout management system 100. Program 504 is stored in advance in ROM 502, RAM 503, or storage device 505. Processor 501 implements each function of the checkout management system 100 by executing the instructions included in program 504. Also, RAM 503 may store data processed in each function of the checkout management system 100. The number of ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, and storage device 505 is not particularly limited and may be one or more.

[0137] Processor 501 controls the entire computer 500. Processor 501 may be, for example, a CPU (Central Processing Unit). The number of processors 501 is not particularly limited and may be one or more.

[0138] The drive device 507 reads from and writes to the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse, a keyboard, or the like, and receives input of information from a store manager or the like. The output device 510 is, for example, a display, and outputs (displays) information to a store manager or the like. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. Note that the program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0139] Note that the hardware configuration shown in FIG. 11 is an example, and other components may be added, or some components may not be included.

[0140] There are various modifications to the method for implementing the store closing management system 100. For example, the store closing management system 100 may be implemented by any combination of different computers and programs for each component. Also, a plurality of components included in the store closing management system 100 may be implemented by any combination of one computer and a program.

[0141] Although the present disclosure has been described with reference to the embodiments above, the present disclosure is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Also, the configurations in each embodiment can be combined with each other as long as they do not depart from the scope of the present disclosure.

[0142] Some or all of the above embodiments can be described as follows in the appended claims, but are not limited thereto.

[0143] [Appended Claim 1] When registration and settlement of a product are performed via a portable terminal operated by a customer, code acquisition means for acquiring a settled code from the portable terminal, Settlement product information acquisition means for acquiring the quantity of settled products associated with the settled code; Estimation means for estimating the quantity of products taken out by the customer from an image of the customer's luggage taken before leaving the store; Abnormality detection means for detecting an abnormality based on the acquired quantity of settled products and the estimated quantity of products taken out; Abnormality output means for outputting that the abnormality has been detected A store exit management system comprising the above.

[0144] [Appendix 2] The abnormality detection means detects the abnormality based on the difference between the estimated quantity of products taken out and the quantity of settled products. The store exit management system according to Appendix 1.

[0145] [Appendix 3] The abnormality detection means detects the abnormality when the difference between the estimated quantity of products taken out and the quantity of settled products exceeds a threshold value. The store exit management system according to Appendix 2.

[0146] [Appendix 4] The abnormality detection means detects the abnormality when the estimated quantity of products taken out is greater than the quantity of settled products. The store exit management system according to any one of Appendices 1 to 3.

[0147] [Appendix 5] The abnormality detection means detects the abnormality when the estimated quantity of products taken out is less than the quantity of settled products. The store exit management system according to any one of Appendices 1 to 4.

[0148] [Appendix 6] The quantity of settled products is the volume of the settled products, The quantity of products taken out is the volume of the products taken out. The check-out management system according to any one of Supplementary Notes 1 to 5.

[0149] [Supplementary Note 7] The quantity of the paid goods is the number of the paid goods, The quantity of the goods to be taken out is the number of the goods to be taken out. The check-out management system according to any one of Supplementary Notes 1 to 6.

[0150] [Supplementary Note 8] The estimation means estimates the quantity of the goods to be taken out from the image of the luggage of the customer who is about to check out and the image of the luggage of the customer before carrying the goods to be taken out. The check-out management system according to any one of Supplementary Notes 1 to 7.

[0151] [Supplementary Note 9] Further comprising gate control means for controlling a check-out gate through which the customer who is about to check out passes, When the abnormality is detected, the gate control means makes the check-out gate in a state where it cannot be passed. The check-out management system according to any one of Supplementary Notes 1 to 8.

[0152] [Supplementary Note 10] Settlement product information output means for outputting the number of the settled products to a notification device in response to the acquisition of the settled code The check-out management system according to any one of Supplementary Notes 1 to 9, further comprising the same.

[0153] [Supplementary Note 11] When product registration and settlement are performed via a portable terminal operated by a customer, the settled code is acquired from the portable terminal, The quantity of the settled products associated with the settled code is acquired, The quantity of the products taken out by the customer is estimated from the image of the luggage of the customer who is about to check out, An abnormality is detected based on the acquired quantity of the settled products and the estimated quantity of the products to be taken out, Output that the abnormality has been detected Store exit management method

[0154] [Appendix 12] When product registration and settlement are performed via a portable terminal operated by a customer, obtain a settled code from the portable terminal, Obtain the quantity of settled products associated with the settled code, Estimate the quantity of products taken out by the customer from an image of the customer's luggage taken before leaving the store, Detect an abnormality based on the obtained quantity of settled products and the estimated quantity of products taken out, Output that the abnormality has been detected A recording medium that non-temporarily records a program for causing a computer to execute processing

Explanation of symbols

[0155] 1 Store system 100 Store exit management system 101 Code acquisition unit 102 Settled product information acquisition unit 103 Estimation unit 104 Abnormality detection unit 105 Abnormality output unit 106 Gate control unit 107 Settled product information output unit 20 Portable terminal 21 Processing unit 22 Storage unit 31 POS server 32 Product database 33 Sales database 34 Detected abnormality database 41 Reader 42 Camera 43 Notification device 44 Store exit gate C1 Customer C2 Luggage

Claims

1. Code acquisition means for acquiring a code from the portable terminal when registration and settlement of a product are performed via the portable terminal operated by a customer; Settled product information acquisition means for acquiring the quantity of the settled product associated with the code; Estimation means for estimating the quantity of products in the shopping basket from an image taken of the shopping basket of the customer leaving the store; Abnormality detection means for detecting an abnormality based on the quantity of the settled product and the quantity of products in the shopping basket; Abnormality output means for outputting that the abnormality has been detected A store exit management system comprising.

2. The estimation means estimates the quantity of products in the shopping basket from an image taken of the inside of the shopping basket from above. The store exit management system according to Claim 1.

3. The abnormality detection means detects the abnormality when the difference between the quantity of products in the shopping basket and the quantity of the settled product exceeds a threshold value. The store exit management system according to Claim 1 or 2.

4. The abnormality detection means detects the abnormality when the quantity of products in the shopping basket is greater than the quantity of the settled product. The store exit management system according to any one of Claims 1 to 3.

5. The abnormality detection means detects the abnormality when the quantity of products in the shopping basket is less than the quantity of the settled product. The store exit management system according to any one of Claims 1 to 4.

6. The estimation means estimates the quantity of products in the shopping basket using the ratio of the volume of the shopping basket occupied by the products. The store exit management system according to any one of Claims 1 to 5.

7. The estimation means estimates the quantity of products in the shopping basket based on the position of the products in the top layer of the shopping basket. The store exit management system according to any one of Claims 1 to 6.

8. Further comprising gate control means for controlling a store exit gate through which the customer leaving the store passes, The gate control means makes the store exit gate impassable when the abnormality is detected. The store exit management system according to any one of Claims 1 to 7.

9. When registration and settlement of a product are performed via the portable terminal operated by a customer, a code is acquired from the portable terminal, The quantity of the settled product associated with the code is acquired, The quantity of products in the shopping basket is estimated from an image taken of the shopping basket of the customer leaving the store, Detect an abnormality based on the quantity of the paid goods and the quantity of the goods in the shopping cart, Output that the abnormality has been detected A store exit management method.

10. When goods are registered and settled via a portable terminal operated by a customer, obtain a code from the portable terminal, Obtain the quantity of the paid goods associated with the code, Estimate the quantity of the goods in the shopping cart from an image taken of the shopping cart of the customer who is leaving the store, Detect an abnormality based on the quantity of the paid goods and the quantity of the goods in the shopping cart, Output that the abnormality has been detected A program that causes a computer to execute the process.

Images