Information processing device and method for preventing erroneous detection of shoplifting

Abstract

This information processing device comprises: a detection unit that detects that a commodity has been taken from a first commodity placement table where a commodity, the commodity code of which is yet to be scanned, is placed; and a determination unit that determines that a shoplifting action has occurred if the commodity detected by the detection unit is placed, without being scanned, on a second commodity placement table where the commodity is to be placed after the commodity code thereof has been scanned. If the commodity detected by the detection unit is returned to the first commodity placement table without being scanned, the determination unit treats such case as one where the detection unit did not detect the commodity.

Description

Information processing device and method for preventing false shoplifting detection

[0001] The present disclosure relates to an information processing device and a method for suppressing false shoplifting detection.

[0002] In recent years, the spread of self-checkout systems has been rapidly increasing in order to reduce the man-hours of store staff in retail stores. However, since customers scan the barcodes of products themselves at self-checkout systems, measures to prevent shoplifting are important.

[0003] Japanese Patent Application Publication No. 7-141569

[0004] One possible method for determining shoplifting is based on the detection of products by a camera and whether or not a barcode has been scanned. For example, a self-checkout register uses a camera to detect products that a customer has removed from a product display stand (or a store's shopping basket) before scanning. If a barcode scan is performed after the product is detected by the camera, the self-checkout register determines that shoplifting has not occurred. On the other hand, if a product is detected by a camera but a barcode scan is not performed and the product is moved to the product display stand (or the customer's shopping basket) after scanning, the self-checkout register determines that shoplifting has occurred.

[0005] However, the above-mentioned method may falsely detect shoplifting. For example, a customer may remove an item from a product stand before scanning, bring the item close to the barcode reader in an attempt to scan the barcode, then cancel the barcode scan and return the item to the product stand before scanning. In this case, the self-checkout system may falsely detect shoplifting, because it believes that the barcode scan was not performed, even though the camera detected the item.

[0006] Non-limiting examples of the present disclosure contribute to providing an information processing device and a method for suppressing false shoplifting detection.

[0007] An information processing device according to one embodiment of the present disclosure includes a detection unit that detects that a product has been removed from a first product stand on which products are placed before their product codes are scanned, and a determination unit that determines that shoplifting has occurred when a product detected by the detection unit is placed without being scanned on a second product stand on which products are placed after their product codes are scanned, and when a product detected by the detection unit is returned to the first product stand without being scanned, the determination unit treats the product as not having been detected by the detection unit.

[0008] In one embodiment of the method for suppressing false shoplifting detection according to the present disclosure, a detection unit detects that a product has been removed from a first product stand on which products are placed before their product codes are scanned, and a determination unit determines that shoplifting has occurred when the product detected by the detection unit is placed without being scanned on a second product stand on which products are placed after their product codes are scanned, and the determination unit treats the product as not having been detected by the detection unit when the product detected by the detection unit is returned to the first product stand without being scanned.

[0009] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0010] According to an embodiment of the present disclosure, false shoplifting detection can be suppressed.

[0011] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and / or benefits may be provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of them may be provided to obtain one or more identical features.

[0012] FIG. 1 is a diagram showing an example of the configuration of a self-checkout system including an information processing device according to a first embodiment. FIG. 2 is a diagram explaining the operation timing of the information processing device when shoplifting is present. FIG. 3 is a diagram explaining the operation timing of the information processing device when no shoplifting is present. FIG. 4 is a diagram showing an example of the block configuration of an information processing device.

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or redundant explanation of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0014] The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] <First embodiment> (System configuration) Fig. 1 is a diagram showing an example of the configuration of a self-checkout system including an information processing device 1 according to a first embodiment. As shown in Fig. 1, the self-checkout system has an information processing device 1, scanners 2a and 2b, a camera 3, weight sensors 4a and 4b, and a display 5. In addition to the self-checkout system, Fig. 1 also shows product stands A1a and A1b and a stand A2.

[0016] The product stand A1a is a stand on which products are placed before being scanned by the scanners 2a and 2b. The products placed on the product stand A1a before being scanned may include a shopping basket or the like from a store containing products before being scanned.

[0017] The product stand A1b is a stand on which products are placed after being scanned by the scanners 2a and 2b. The scanned products placed on the product stand A1b may include a customer's shopping basket into which the scanned products are placed.

[0018] The information processing device 1 is, for example, a computer such as a personal computer or a server. In Fig. 1, the information processing device 1 is placed outside the stand A2, but it may be placed inside the stand A2 or in the store office. The information processing device 1 performs, for example, a payment process for products and a shoplifting monitoring process.

[0019] The scanner 2a is a handheld scanner, and the scanner 2b is a fixed scanner fixed to a stand A2. Hereinafter, when there is no need to distinguish between the scanners 2a and 2b, they will be simply referred to as the scanner 2.

[0020] The scanner 2 is connected to the information processing device 1. The scanner 2 scans product codes attached to products. The scanner 2 transmits the scanned product codes to the information processing device 1. The product codes are, for example, bar codes such as JAN (Japanese Article Number) codes. The scanner 2 may also be referred to as a barcode reader or a reader.

[0021] The camera 3 is connected to the information processing device 1. The camera 3 transmits image data of a captured image to the information processing device 1.

[0022] Camera 3 is installed so as to capture the area around where customers scan products with scanner 2 (see dotted frame A3 in FIG. 1 ). For example, camera 3 is installed above display 5 or above stand A2, and the angle of view is set so as to include the area between product stand A1a and product stand A1b, i.e., the area around where customers scan products with scanner 2.

[0023] The weight sensor 4a is connected to the information processing device 1. The weight sensor 4a is installed, for example, inside the product stand A1a, and transmits a signal to the information processing device 1 according to the weight of the product placed on the product stand A1a (or a shopping basket or the like containing the product).

[0024] The weight sensor 4b is connected to the information processing device 1. The weight sensor 4b is installed, for example, inside the product stand A1b, and transmits to the information processing device 1 a signal corresponding to the weight of the product placed on the product stand A1b (or a customer's shopping basket containing the product, etc.).

[0025] The display 5 is connected to the information processing device 1. The display 5 displays, for example, product information of a product scanned by a customer using the scanner 2. The product information may be, for example, the name, price, and quantity of the product.

[0026] The display 5 may be provided with a touch panel on the screen surface. The touch panel accepts customer operations. The customer inputs information about products without product codes, such as vegetables and fruits, via the touch panel and registers the products as purchased items. Note that the device accepting customer operations is not limited to a touch panel. The device accepting customer operations may be, for example, a key input device separate from the display 5.

[0027] The display 5 displays a screen for deterring shoplifting based on the control of the information processing device 1. For example, if a product is moved from the product stand A1a to the product stand A1b without being scanned by the scanner 2, the display 5 displays a screen that prompts the user to scan the product with the scanner 2.

[0028] (Operation Timing) 1. Operation Timing in the Case Where Shoplifting Has Occurred Fig. 2 is a diagram illustrating the operation timing of the information processing device 1 in the case where shoplifting has occurred. First, the flags shown in Fig. 2 will be described, and then the operation timing will be described.

[0029] The product code scan flag is a signal output from the scanner 2 to the information processing device 1. When the scanner 2 scans a product code, the product code scan flag is set to an H state for a certain period of time.

[0030] 2 remains at L. That is, the customer has not yet scanned the product code of the product with the scanner 2 at the timing of the operation shown in FIG.

[0031] The merchandise detection flag, merchandise return flag, merchandise movement flag, and shoplifting flag shown in FIG. 2 are set to the H state and the L state by the information processing device 1.

[0032] Merchandise detection flag The information processing device 1 sets the commodity detection flag to H state while an image of a commodity is included in the image data received from the camera 3. That is, the information processing device 1 detects a commodity removed from the commodity stand A1a (for example, a commodity picked up by a customer) based on the image data of the camera 3.

[0033] However, if the product code scan flag becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L. If the product return flag, which will be described later, becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L. If the product movement flag, which will be described later, becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L.

[0034] Product Return Flag When a product is removed from the product stand A1a and returned to the product stand A1a, the information processing device 1 sets the product return flag to H state for a certain period of time.

[0035] The information processing device 1 detects that a product has been removed from the product placement stand A1a and returned to the product placement stand A1a based on the signal from the weight sensor 4a. For example, if the weight calculated based on the signal from the weight sensor 4a decreases and then increases again (returns to the original value), the information processing device 1 detects that a product has been removed from the product placement stand A1a and returned to the product placement stand A1a.

[0036] The product return flag shown in Fig. 2 remains in the L state. That is, at the operation timing in Fig. 2, the product has not been removed from the product stand A1a and returned to the product stand A1a. The operation timing at which the product return flag becomes the H state will be described in "3. Operation Timing #2 when No Shoplifting Has Occurred."

[0037] Product Movement Flag When a product is moved to the product stand A1b, the information processing device 1 sets the product movement flag to H state for a certain period of time.

[0038] The information processing device 1 detects that the product has been moved (placed) on the product stand A1b based on the signal from the weight sensor 4b. For example, the information processing device 1 detects that the product has been moved to the product stand A1b when the weight calculated based on the signal from the weight sensor 4b increases.

[0039] Shoplifting flag If the information processing device 1 sets the product detection flag to H and then sets the product movement flag to H without receiving a product code scan flag that is H, the information processing device 1 sets the shoplifting flag to H for a certain period of time. That is, if the information processing device 1 detects a product based on an image from the camera 3 and then detects that the product has been moved to the product stand A1b without receiving a product code scan flag from the scanner 2, the information processing device 1 sets the shoplifting flag to H for a certain period of time. That is, if a customer moves a product from the product stand A1a to the product stand A1b without scanning the product using the scanner 2, the information processing device 1 determines that shoplifting has occurred.

[0040] Although each flag described above is a positive logic (active high), it may be a negative logic (active low). For example, the information processing device 1 may set the commodity detection flag to the L state while the image data received from the camera 3 includes an image of a commodity.

[0041] The operation timing will be explained below. In the explanation of the operation timing in Figure 2, it is assumed that a customer is shoplifting. The customer takes an item from the product stand A1a and moves it to the product stand A1b without scanning the product code of the taken item with the scanner 2.

[0042] 2, the information processing device 1 detects a product removed from the product stand A1a based on image data from the camera 3, and sets the product detection flag to H. Thereafter, the information processing device 1 sets the product movement flag to H, and sets the product detection flag to L.

[0043] If the information processing device 1 sets the product detection flag to H and then sets the product movement flag to H without receiving a product code scan flag that is H, the information processing device 1 sets the shoplifting flag to H. In other words, the information processing device 1 determines (detects) that shoplifting has occurred, assuming that a customer has taken out a product from the product stand A1a and moved it to the product stand A1b without scanning it with the scanner 2.

[0044] When the information processing device 1 detects shoplifting by a customer, it displays a message to discourage shoplifting, such as "Please scan the product," on the display 5. Alternatively, the information processing device 1 notifies a mobile terminal carried by a store clerk that shoplifting has occurred.

[0045] 2. Operation Timing in Case of No Shoplifting #1 Fig. 3 is a diagram illustrating the operation timing of the information processing device 1 in the case of no shoplifting. The operation of the flag shown in Fig. 3 is the same as the operation of the flag described in Fig. 2, and therefore the description thereof will be omitted.

[0046] 3, it is assumed that the customer is not shoplifting. The customer takes an item from the product stand A1a and scans the product code of the item with the scanner 2. The customer then moves the item whose product code has been scanned to the product stand A1b.

[0047] 3, the information processing device 1 detects a product removed from the product stand A1a based on image data from the camera 3 and sets the product detection flag to H. After that, when the information processing device 1 receives a product code scan flag from the scanner 2, it sets the product detection flag to L as shown in FIG.

[0048] The product scanned by the scanner 2 is moved to the product stand A1b. Therefore, the information processing device 1 sets the product movement flag to H state as shown in FIG.

[0049] After setting the merchandise detection flag to H state, the information processing device 1 receives a merchandise code scan flag in H state, and when it sets the merchandise movement flag to H state, it does not set the shoplifting flag to H state.

[0050] That is, the information processing device 1 determines that the customer has taken an appropriate product purchase action when the customer removes a product from the product stand A1a, scans the product with the scanner 2, and moves the product to the product stand A1b.

[0051] 3. Operation Timing #2 in the Case Where Shoplifting Has Not Been Attempts Figure 4 is a diagram illustrating the operation timing of the information processing device 1 in the case where shoplifting has not been attemped. The operation of the flag shown in Figure 3 is the same as the operation of the flag described in Figure 2, and therefore its description will be omitted.

[0052] 4, it is assumed that the customer is not shoplifting. The customer takes an item from the product stand A1a and returns it to the product stand A1a without scanning the product code of the item with the scanner 2.

[0053] A case in which a customer returns an item to the product stand A1a without scanning the product code may occur, for example, when the item removed from the product stand A1a is light, since items stored in a customer's shopping basket are generally placed with the heavier items at the bottom.

[0054] As shown in Fig. 4, the information processing device 1 detects the product removed from the product stand A1a based on image data from the camera 3 and sets the product detection flag to H. After that, when the information processing device 1 sets the product return flag to H, it sets the product detection flag to L and disables (resets) product detection as shown in Fig. 4. By disabling product detection, that is, by making it appear as if the product was not removed from the product stand A1a, the information processing device 1 does not set the shoplifting flag to H.

[0055] In other words, the information processing device 1 will not determine that shoplifting has occurred (will not erroneously detect that shoplifting has occurred) if the customer removes a product from the product stand A1a and returns the product to the product stand A1a, even if the customer does not scan the removed product with the scanner 2.

[0056] (Block Diagram) Fig. 5 is a diagram showing an example of a block configuration of the information processing device 1. As shown in Fig. 5, the information processing device 1 has a control unit 11, a storage unit 12, and a communication unit 13.

[0057] The control unit 11 controls the entire information processing device 1. The control unit 11 may be configured by a processor such as a CPU (central processing unit), for example.

[0058] The control unit 11 includes a merchandise detection unit 11 a, a merchandise movement monitoring unit 11 b, a shoplifting determination unit 11 c, and an alarm generation unit 11 d. The control unit 11 may realize the functions of the aforementioned units in accordance with a program stored in the storage unit 12.

[0059] The commodity detection unit 11a detects whether or not an image captured by the camera 3 includes an image of a commodity, based on image data from the camera 3. If an image captured by the camera 3 includes an image of a commodity, the commodity detection unit 11a outputs, for example, an H-state commodity detection flag to the shoplifting determination unit 11c.

[0060] The commodity detection unit 11a may use, for example, technology such as the image recognition service of Azure (registered trademark) to detect whether or not an image of a commodity is included in the image captured by the camera 3. The commodity detection unit 11a is only required to detect whether or not a commodity is included in the image of the image data received from the camera 3, and does not need to detect commodity information such as the name and price of the commodity.

[0061] The product movement monitor 11b calculates the weight of the product on the product stand A1a based on the signal from the weight sensor 4a. The product movement monitor 11b monitors whether the product has been removed from the product stand A1a and returned to the product stand A1a based on the calculated weight. When the product has been removed from the product stand A1a and returned to the product stand A1a, the product movement monitor 11b outputs, for example, an H-state product return flag to the shoplifting determination unit 11c for a certain period of time.

[0062] Furthermore, the product movement monitor 11b calculates the weight of the product on the product stand A1b based on the signal from the weight sensor 4b. The product movement monitor 11b monitors whether or not a product has been placed on the product stand A1b based on the calculated weight. When a product is placed on the product stand A1b, the product movement monitor 11b outputs, for example, an H-state product movement flag to the shoplifting determination unit 11c for a certain period of time.

[0063] The shoplifting determination unit 11c determines whether shoplifting has occurred based on the scanner information (product code scan flag) of the scanner 2, the product detection information (product detection flag) of the product detection unit 11a, and the product movement information (product return flag and product movement flag).

[0064] For example, if the shoplifting determination unit 11c receives a product detection flag in the H state, and then receives a product movement flag in the H state without receiving a product code scan flag in the H state, it determines that shoplifting has occurred.

[0065] For example, when the shoplifting determination unit 11c receives a product code scan flag in the H state after receiving a product detection flag in the H state, it determines that the customer has made an appropriate product purchase.

[0066] For example, if the shoplifting determination unit 11c receives an H-state merchandise detection flag and then an H-state merchandise return flag, it changes the H-state merchandise detection flag to L (disabled). The shoplifting determination unit 11c disables the merchandise detection flag and determines that the merchandise was not detected, and therefore determines that the customer has made an appropriate purchase even if it does not receive an H-state merchandise code scan flag. Note that in this case, because the customer returned the merchandise without scanning the merchandise code, the customer's purchase is not confirmed. However, the shoplifting determination unit 11c determines that the merchandise purchase was appropriate, in the sense that the series of actions related to the purchase of the merchandise did not include any actions that could be suspected of being shoplifting or other fraudulent.

[0067] When the shoplifting determination unit 11c determines that shoplifting has occurred, the alarm generation unit 11d generates alarm information. For example, the alarm generation unit 11d generates image data of an image including text such as "Please scan the product." The image data is transmitted to the display 5 via the communication unit 13.

[0068] The alarm generating unit 11d also generates, for example, an alarm signal. The alarm signal is transmitted to a mobile terminal carried by the store clerk via the communication unit 13. The mobile terminal that receives the alarm signal notifies the store clerk of the occurrence of shoplifting, for example, by sound.

[0069] The storage unit 12 stores an operating system (OS) program and application programs to be executed by the control unit 11. For example, the storage unit 12 stores an application program that processes payments at self-checkout registers and monitors shoplifting attempts. The storage unit 12 also stores various data necessary for processing by the control unit 11. The storage unit 12 may be, for example, a solid state drive (SSD), random access memory (RAM), flash memory, read only memory (ROM), and / or a hard disk drive (HDD).

[0070] The communication unit 13 communicates, by wire or wirelessly, with the scanner 2, camera 3, weight sensors 4a and 4b, and display 5. The communication unit 13 also communicates wirelessly with a mobile terminal carried by a store clerk.

[0071] (Operation Flow) FIG. 6 is a flowchart showing an example of the operation of the information processing device 1.

[0072] The information processing device 1 determines whether or not the customer has scanned all of the products placed on the product stand A1a with the scanner 2 (S1). The information processing device 1 may determine whether or not all of the products placed on the product stand A1a have been scanned with the scanner 2, for example, based on a signal from the weight sensor 4a.

[0073] If the information processing device 1 determines that the customer has scanned all of the products placed on the product stand A1a with the scanner 2 (Yes in S1), it performs the transaction process (S2).Then, the information processing device 1 ends the process of the flowchart in FIG.

[0074] If the information processing device 1 determines that the customer has not scanned all of the products placed on the product stand A1a with the scanner 2 (No in S1), it determines whether the product images are included in the image taken by the camera 3 (whether the products have been detected) (S3). That is, the information processing device 1 determines, for example, whether the customer has removed the products from the product stand A1a (whether the customer has picked up the products).

[0075] If the information processing device 1 determines that the image captured by the camera 3 does not include a product image (No in S3), it repeats the process of S3.

[0076] When the information processing device 1 determines that the image captured by the camera 3 includes a product image (Yes in S3), the information processing device 1 determines whether the customer has returned the product to the product stand A1a based on the signal from the weight sensor 4a (S4). For example, the information processing device 1 determines that the customer has returned the product to the product stand A1a based on the signal from the weight sensor 4a.

[0077] If the information processing device 1 determines that the customer has returned the commodity to the commodity stand A1a (Yes in S4), the information processing device 1 disables commodity detection (S5). Then, the information processing device 1 proceeds to S3 and determines whether the image captured by the camera 3 includes a commodity image.

[0078] If the information processing device 1 determines that the customer has not returned the product to the product stand A1a (No in S4), it determines whether the customer has moved the product to the product stand A1b (S6). For example, the information processing device 1 determines whether the customer has moved the product to the product stand A1b based on a signal from the weight sensor 4b.

[0079] If the information processing device 1 determines that the customer has not moved the product to the product stand A1b (No in S6), it proceeds to S4 and determines whether the customer has returned the product to the product stand A1a.

[0080] When the information processing device 1 determines that the customer has moved the product to the product stand A1b (Yes in S6), it determines whether the product has been scanned (S7).

[0081] If the information processing device 1 determines that the product has been scanned (Yes in S7), that is, if it determines that the product moved to the product stand A1b has been scanned, it transitions to S1 and determines whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0082] If the information processing device 1 determines that the products have not been scanned (No in S7), that is, if it determines that the products moved to the product stand A1b have not been scanned, it determines that shoplifting has occurred (S8). When it determines that shoplifting has occurred, the information processing device 1 generates alarm information and an alarm signal, and proceeds to determining (S1) whether the customer has scanned all of the products placed on the product stand A1a with the scanner 2. This allows the customer who has been notified of the alarm to be given an opportunity to scan the products again with the scanner 2.

[0083] If the customer is not given an opportunity to rescan the product when shoplifting is determined, the cash register operation may be terminated abnormally, an alarm may be displayed on the cash register screen, and subsequent cash register operations may be stopped. In this case, the fact that shoplifting has occurred may be notified to a terminal held by a store clerk or a base station.

[0084] If the information processing device 1 determines that the products have been scanned (Yes in S7), it proceeds to S1 and determines whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0085] Summary of the First Embodiment The information processing device 1 detects that a product has been removed from a product stand A1a on which products are placed before their product codes are scanned. The information processing device 1 determines that shoplifting has occurred when the detected product is placed on a product stand A1b on which products are placed after their product codes are scanned without having its product code scanned. The information processing device 1 disables product detection when the detected product is returned to the product stand A1a without its product code being scanned. This operation allows the information processing device 1 to prevent false shoplifting detection. For example, if a customer removes a product from the product stand A1a and returns it to the product stand A1a without scanning it, the information processing device 1 disables product detection. Therefore, the information processing device 1 does not determine that shoplifting has occurred because a scan was not performed despite the product being detected, thereby preventing false shoplifting detection.

[0086] Second Embodiment A customer may attempt to scan an item with the scanner 2 but stop, and neither return the item to the item stand A1a nor place it on the item stand A1b. For example, a customer may remove an item from the item stand A1a and place it on a stand between the item stands A1a and A1b. Also, for example, a customer may remove an item from the item stand A1a and continue to hold the item in their hand. In the second embodiment, if an item is removed from the item stand A1a and not placed on the item stand A1b, it is not determined that shoplifting has occurred.

[0087] The following describes the differences from the first embodiment. Note that the self-checkout system in the second embodiment is the same as the self-checkout system in the first embodiment.

[0088] (Operation Timing) Fig. 7 is a diagram illustrating the operation timing of the information processing device 1 according to the second embodiment. The operations of the product code scan flag, product detection flag, product return flag, product movement flag, and shoplifting flag shown in Fig. 7 are the same as the operations of the flags described in Fig. 2, and therefore a description thereof will be omitted.

[0089] 7 shows a shoplifting enable flag in addition to the above flags. After setting the merchandise detection flag to H, if the scanned merchandise return flag is L and the merchandise movement flag is L, the information processing device 1 sets the shoplifting enable flag to L. If the shoplifting enable flag is L, the information processing device 1 does not determine that shoplifting has occurred (does not set the shoplifting flag to H).

[0090] 7, it is assumed that a customer removes an item from product stand A1a and places it on a stand between product stands A1a and A1b. Then, the customer places the item on product stand A1b without scanning it with scanner 2.

[0091] As described above, after setting the merchandise detection flag to H, if the scanned merchandise return flag is L and the merchandise movement flag is L, the information processing device 1 sets the shoplifting enable flag to L. If the shoplifting enable flag is L, the information processing device 1 does not set the shoplifting flag to H.

[0092] That is, for example, when a product is placed on a stand between product stand A1a and product stand A1b, or when a customer is holding a product in their hand, the information processing device 1 sets the shoplifting enable flag to L. When the shoplifting enable flag is L, the information processing device 1 does not set the shoplifting flag to H. This operation prevents the information processing device 1 from erroneously determining that shoplifting has occurred when, for example, a customer places a product on a stand between product stand A1a and product stand A1b, or when the customer is holding a product in their hand.

[0093] (Block Diagram) The block configuration of the information processing device 1 in the second embodiment is the same as the block configuration shown in Fig. 5. However, the function of the shoplifting determination unit 11c is different. After setting the merchandise detection flag to H, if the scanned merchandise return flag is L and the merchandise movement flag is L, the shoplifting determination unit 11c in the second embodiment does not determine that shoplifting has occurred.

[0094] (Summary of the Second Embodiment) The information processing device 1 detects a product removed from the product stand A1a, and does not determine that shoplifting has occurred until the detected product is returned to the product stand A1a and placed on the product stand A1b. This operation allows the information processing device 1 to reduce false shoplifting detections.

[0095] <Modifications> Modifications will be described below. Unless otherwise specified, the modifications are applied to the first and second embodiments.

[0096] (Variation 1) Detection of the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b is not limited to a method using signals from the weight sensors 4a and 4b. The information processing device 1 may detect the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b based on camera images.

[0097] The camera for detecting the removal of products from product stand A1a, the return of products to product stand A1a, and the movement of products to product stand A1b may be camera 3 or a camera separate from camera 3. When a camera separate from camera 3 is used, for example, one of the two cameras may be installed above product stand A1a to capture the area around product stand A1a, and the other camera may be installed above product stand A1b to capture the area around product stand A1b. When camera 3 is used, a wide-angle camera is desirable to capture the images of product stands A1a and A1b.

[0098] The sensor is not limited to a weight sensor or a camera, as long as it can detect the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b.

[0099] (Variation 2) When a product is returned to the product stand A1a after being scanned by the scanner 2, the information processing device 1 does not have to determine that shoplifting has occurred. When a product is returned to the product stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen on the display 5 indicating that the product has been returned to the product stand A1a. Alternatively, when a product is returned to the product stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen on the display 5 urging the user to move the scanned product to the product stand A1b.

[0100] (Variation 3) The information processing device 1 may determine that shoplifting has occurred if it detects a product based on an image from the camera 3, but does not scan the product with the scanner 2 and does not detect that the product has been placed on the product stand A1b. A case in which the product is not scanned with the scanner 2 and is not placed on the product stand A1b may be considered to be a case in which none of the following three conditions are met. Condition 1: It is detected that the product has been returned to the product stand A1a. Condition 2: It is detected that the product has been placed on the product stand A1b. Condition 3: Any of the following is detected based on the image from the camera 3. Condition 3a: It is detected that the product has been placed on a stand for scanning products (for example, a stand between the product stands A1a and A1b). Condition 3b: It is detected that the product is being held in the hand.

[0101] (Modification 4) A weight sensor may be provided in the cart, which wirelessly transmits a signal corresponding to the weight of the product placed in the cart to the information processing device 1.

[0102] If the cart is equipped with a weight sensor, the customer can take an item out of the cart and scan it with the scanner 2 without placing it on the product stand A1a.

[0103] Note that a cart placed near the product stand A1a may be photographed by a camera (or camera 3) that photographs the periphery of the product stand A1a described in Modification 1. The information processing device 1 may determine whether a product has been removed from the cart or returned to the cart based on the image from the camera (or camera 3).

[0104] In other words, the configuration of this modified example can be said to be a configuration in which the product stand A1a is arranged on a cart.

[0105] Note that the product stand A1a may be provided on both the stand A2 and the cart. In this case, the product stand A1a provided on the stand A2 and the product stand A1a provided on the cart may be treated without distinction. For example, when a product is removed from the product stand A1a provided on the cart and moved to the product stand A1a provided on the stand A2, the product is moved between the cart and the stand A2, but the product may be treated as having been returned to the product stand A1a without distinction between the cart and the stand A2.

[0106] (Variation 5) The information processing device 1 may cancel the disabling of product detection and enable product detection again when the following occurs: - After a product is returned to the product stand A1a, it detects, based on a signal from the weight sensor 4a, that the next product has been removed from the product stand A1a; - After a product is returned to the product stand A1a, it detects, based on an image from the camera (or camera 3), that the next product has been removed from the product stand A1a.

[0107] (Variation 6) The information processing device 1 may determine that shoplifting has occurred when a product is placed on the product stand A1b without detecting the product based on the image from the camera 3 and without being scanned by the scanner 2. In other words, the information processing device 1 may determine that shoplifting has occurred when a customer places the product on the product stand A1b so as not to be photographed by the camera 3.

[0108] (Variation 7) The information processing device 1 may determine that shoplifting has not occurred if it detects that a product has been placed on the product stand A1a but does not perform product detection based on the image from the camera 3 and the product is not scanned by the scanner 2. This is because if a product is placed on the product stand A1a but does not perform product detection and the product is not scanned by the scanner 2, it is assumed that the customer has moved to another register.

[0109] (Variation 8) The information processing device 1 may determine whether or not a product has been moved from the product stand A1a to the product stand A1b based on signals from the weight sensors 4a and 4b. For example, the information processing device 1 may determine that a product has been moved from the product stand A1a to the product stand A1b when the increase in weight on the product stand A1b is the same as (including approximately the same as) the decrease in weight on the product stand A1a.

[0110] The present invention can also prevent false shoplifting detections when the camera detects objects other than merchandise, such as wallets, cards, smartphones, mobile devices, receipts, customer shoes, etc. Even if these non-merchandise items are not detected by barcode scanning and are detected as objects, false shoplifting detections can be prevented as long as they are not placed on the merchandise stand A1b.

[0111] Furthermore, the product stand A1a, the barcode scanning operation, and the product stand A1b may be monitored by a single camera with a wide angle.

[0112] Shoplifting may also be determined using movement history information of the product, such as the product stand A1a, the barcode scan operation, and the product being moved to the product stand A1b. For example, if a product is taken from the product stand A1a and then detected as having been moved to the product stand A1b through object detection without being detected by a barcode scan, shoplifting is determined to have occurred. In this case, if the product is not detected as having been moved to the product stand A1b, shoplifting is not determined to have occurred.

[0113] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims. It is understood that such modifications or alterations also fall within the technical scope of the present disclosure. Furthermore, the components in the embodiments may be combined in any manner without departing from the spirit of the present disclosure.

[0114] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuit," "... assembly," "... device," "... unit," or "... module."

[0115] The present disclosure can be realized by software, hardware, or software in conjunction with hardware. Each functional block used in the description of the above embodiments may be partially or entirely realized as an LSI, which is an integrated circuit, and each process described in the above embodiments may be partially or entirely controlled by a single LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of a single chip that includes some or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may also be called an IC, system LSI, super LSI, or ultra LSI.

[0116] The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, a field programmable gate array (FPGA) that can be programmed after LSI manufacturing, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells within the LSI, may be used. The present disclosure may be realized as digital processing or analog processing.

[0117] Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology or other derivative technologies, it is natural that such technology may be used to integrate functional blocks. The application of biotechnology, etc. is also a possibility.

[0118] The disclosures of the specifications, drawings and abstracts contained in Japanese patent application No. 2023-198190 filed on November 22, 2023 and Japanese patent application No. 2024-006815 filed on January 19, 2024 are incorporated herein by reference in their entirety.

[0119] The present disclosure is useful for preventing shoplifting at self-checkout registers.

[0120] REFERENCE SIGNS LIST 1 Information processing device 2, 2a, 2b Scanner 3 Camera 4a, 4b Weight sensor 5 Display A4a, A4b Product stand

Claims

1. An information processing device comprising: a detection unit that detects that a product has been removed from a first product placement stand on which products are placed before their product codes are scanned; and a determination unit that determines that shoplifting has occurred when a product detected by the detection unit is placed without being scanned on a second product placement stand on which products are placed after their product codes are scanned; wherein when a product detected by the detection unit is returned to the first product placement stand without being scanned, the determination unit treats the product as not having been detected by the detection unit.

2. The information processing device according to claim 1, wherein the determination unit does not determine that shoplifting has occurred until the product detected by the detection unit is neither returned to the first product stand nor placed on the second product stand.

3. The information processing device according to claim 1, wherein the determination unit detects that a product removed from the first product stand has been returned to the first product stand based on a signal from a weight sensor or image data from a camera provided on the first product stand.

4. The information processing device according to claim 1, wherein the first product placement table is provided on a cart containing products before their product codes are scanned.

5. The information processing device according to claim 4, wherein the determination unit detects that a product removed from the first product stand has been returned to the first product stand based on a signal from a weight sensor or image data from a camera provided on the cart, and if a product detected by the detection unit is returned to the first product stand without being scanned, the detection unit treats the product as not having been detected.

6. The information processing device according to claim 1, wherein the determination unit detects that a product has been placed on the second product stand based on a signal from a weight sensor or image data from a camera provided on the second product stand.

7. The information processing device according to claim 1, wherein the determination unit determines that shoplifting has occurred when a product is placed on the second product placement table and the detection unit does not detect a product and the product code is not scanned.

8. A method for preventing false shoplifting detection, in which a detection unit detects that a product has been removed from a first product placement table on which products are placed before their product codes are scanned, and a determination unit determines that shoplifting has occurred when the product detected by the detection unit is placed, without being scanned, on a second product placement table on which products are placed after their product codes are scanned, and the determination unit treats the product as not having been detected by the detection unit when the product detected by the detection unit is returned to the first product placement table without being scanned.

Images