Information processor and method of preventing false positive detection of shoplifting

Abstract

To provide an information processor that prevents false positive detection of shoplifting.SOLUTION: An information processor includes: a detection unit that detects that an article has been removed from a first article stand on which the article is placed before an article code is scanned; a determination unit that determines that shoplifting has occurred when the article detected by the detection unit is placed without being scanned on a second article stand on which the article is placed after the product code has been scanned. When the article detected by the detection unit is returned to the first article stand without being scanned, the determination unit treats the article as if the detection unit did not detect the article.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and a method for suppressing false shoplifting detection. [Background technology]

[0002] In recent years, the spread of self-checkout systems has been rapidly increasing in order to reduce the man-hours of store staff in retail stores. However, since customers scan the barcodes of products themselves at self-checkout systems, measures to prevent shoplifting are important. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 7-141569 Summary of the Invention [Problem to be solved by the invention]

[0004] One possible method for determining shoplifting is based on the detection of products by a camera and whether or not a barcode has been scanned. For example, a self-checkout register uses a camera to detect products that a customer has removed from a product display stand (or a store's shopping basket) before scanning. If a barcode scan is performed after the product is detected by the camera, the self-checkout register determines that shoplifting has not occurred. On the other hand, if a product is detected by a camera but a barcode scan is not performed and the product is moved to the product display stand (or the customer's shopping basket) after scanning, the self-checkout register determines that shoplifting has occurred.

[0005] However, the above-mentioned method may falsely detect shoplifting. For example, a customer may remove an item from a product stand before scanning, bring the item close to the barcode reader in an attempt to scan the barcode, then cancel the barcode scan and return the item to the product stand before scanning. In this case, the self-checkout system may falsely detect shoplifting, because it believes that the barcode scan was not performed, even though the camera detected the item.

[0006] Non-limiting examples of the present disclosure contribute to providing an information processing device and a method for suppressing false shoplifting detection. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present disclosure includes a detection unit that detects that a product has been removed from a first product stand on which products are placed before their product codes are scanned, and a determination unit that determines that shoplifting has occurred when a product detected by the detection unit is placed without being scanned on a second product stand on which products are placed after their product codes are scanned, and when a product detected by the detection unit is returned to the first product stand without being scanned, the determination unit treats the product as not having been detected by the detection unit.

[0008] In one embodiment of the method for suppressing false shoplifting detections of the present disclosure, a detection unit detects that a product has been removed from a first product stand on which products are placed before their product codes are scanned, and a determination unit determines that shoplifting has occurred when the product detected by the detection unit is placed without being scanned on a second product stand on which products are placed after their product codes are scanned, and the determination unit treats the product as not having been detected by the detection unit when the product detected by the detection unit is returned to the first product stand without being scanned.

[0009] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. [Effects of the Invention]

[0010] According to an embodiment of the present disclosure, false shoplifting detection can be suppressed.

[0011] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and / or benefits may be provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of them may be provided to obtain one or more identical features. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a self-checkout system including an information processing device according to a first embodiment. [Figure 2] FIG. 10 is a diagram illustrating the operation timing of the information processing device when shoplifting is detected. [Figure 3] FIG. 10 is a diagram illustrating the operation timing of the information processing device when there is no shoplifting. [Figure 4] FIG. 10 is a diagram illustrating the operation timing of the information processing device when there is no shoplifting. [Figure 5] FIG. 1 is a diagram showing an example of a block configuration of an information processing device. [Figure 6] Flowchart showing an example of operation of an information processing device [Figure 7] FIG. 10 is a diagram illustrating the operation timing of the information processing device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or redundant explanation of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0014] The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] First Embodiment (System Configuration) Fig. 1 is a diagram showing an example of the configuration of a self-checkout system including an information processing device 1 according to a first embodiment. As shown in Fig. 1, the self-checkout system has an information processing device 1, scanners 2a and 2b, a camera 3, weight sensors 4a and 4b, and a display 5. In addition to the self-checkout system, Fig. 1 also shows product stands A1a and A1b and a stand A2.

[0016] The product stand A1a is a stand on which products are placed before being scanned by the scanners 2a and 2b. Products placed on the product stand A1a before being scanned may include shopping baskets or the like from a store containing products before being scanned.

[0017] The product stand A1b is a stand on which products are placed after being scanned by the scanners 2a and 2b. The scanned products placed on the product stand A1b may include a customer's shopping basket into which the scanned products are placed.

[0018] The information processing device 1 is, for example, a computer such as a personal computer or a server. In Fig. 1, the information processing device 1 is placed outside the stand A2, but it may be placed inside the stand A2 or in the store office. The information processing device 1 performs, for example, a payment process for merchandise and a shoplifting monitoring process.

[0019] The scanner 2a is a handheld scanner. The scanner 2b is a fixed scanner fixed to the stand A2. Hereinafter, when there is no need to distinguish between the scanners 2a and 2b, they will be simply referred to as the scanner 2.

[0020] The scanner 2 is connected to the information processing device 1. The scanner 2 scans the product code attached to the product. The scanner 2 transmits the scanned product code to the information processing device 1. The product code is, for example, a barcode such as a JAN (Japanese Article Number) code. The scanner 2 may also be referred to as a barcode reader or a reader.

[0021] The camera 3 is connected to the information processing device 1. The camera 3 transmits image data of a captured image to the information processing device 1.

[0022] Camera 3 is installed so as to capture the area around where customers scan products with scanner 2 (see dotted frame A3 in FIG. 1). For example, camera 3 is installed above display 5 or above stand A2, and the angle of view is set so as to include the area between product stand A1a and product stand A1b, that is, the area around where customers scan products with scanner 2.

[0023] The weight sensor 4a is connected to the information processing device 1. The weight sensor 4a is installed, for example, inside the product stand A1a, and transmits to the information processing device 1 a signal corresponding to the weight of the product placed on the product stand A1a (or a shopping basket or the like containing the product).

[0024] The weight sensor 4b is connected to the information processing device 1. The weight sensor 4b is installed, for example, inside the product stand A1b, and transmits to the information processing device 1 a signal corresponding to the weight of the product placed on the product stand A1b (or a customer's shopping basket containing the product, etc.).

[0025] The display 5 is connected to the information processing device 1. The display 5 displays, for example, product information of a product scanned by a customer using the scanner 2. The product information may be, for example, the name, price, and quantity of the product.

[0026] The display 5 may be provided with a touch panel on the screen surface. The touch panel accepts customer operations. The customer inputs information about products that do not have product codes, such as vegetables and fruits, via the touch panel and registers them as purchased products. Note that the device that accepts customer operations is not limited to a touch panel. The device that accepts customer operations may be, for example, a key input device separate from the display 5.

[0027] The display 5 displays a screen to deter shoplifting based on the control of the information processing device 1. For example, if a product is moved from product stand A1a to product stand A1b without being scanned by the scanner 2, the display 5 displays a screen to prompt the user to scan the product with the scanner 2.

[0028] (Operation timing) 1. Action timing in case of shoplifting 2 is a diagram illustrating the operation timing of the information processing device 1 when shoplifting is detected. First, the flags shown in FIG. 2 will be described, and then the operation timing will be described.

[0029] The product code scan flag is a signal output from the scanner 2 to the information processing device 1. When the scanner 2 scans a product code, the product code scan flag goes to an H state for a certain period of time.

[0030] 2 remains in the L state. That is, the customer has not yet scanned the product code of the product with the scanner 2 at the operation timing of FIG.

[0031] The merchandise detection flag, merchandise return flag, merchandise movement flag, and shoplifting flag shown in FIG.

[0032] Product detection flag The information processing device 1 sets the commodity detection flag to H state while an image of a commodity is included in the image data received from the camera 3. That is, the information processing device 1 detects a commodity removed from the commodity stand A1a (for example, a commodity picked up by a customer) based on the image data of the camera 3.

[0033] However, if the product code scan flag becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L. If the product return flag, which will be described later, becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L. If the product movement flag, which will be described later, becomes H after setting the product detection flag to H, the information processing device 1 sets the product detection flag to L.

[0034] Product return flag When a product is removed from the product stand A1a and returned to the product stand A1a, the information processing device 1 sets the product return flag to the H state for a certain period of time.

[0035] The information processing device 1 detects that a product has been removed from the product stand A1a and returned to the product stand A1a based on the signal from the weight sensor 4a. For example, if the weight calculated based on the signal from the weight sensor 4a decreases and then increases again (returns to the original weight), the information processing device 1 detects that a product has been removed from the product stand A1a and returned to the product stand A1a.

[0036] The product return flag shown in Fig. 2 remains in the L state. That is, at the operation timing in Fig. 2, the product has not been removed from the product stand A1a and returned to the product stand A1a. The operation timing at which the product return flag becomes the H state will be explained in "3. Operation Timing #2 when no shoplifting has occurred."

[0037] Product transfer flag When a product is moved to the product stand A1b, the information processing device 1 sets the product movement flag to H state for a certain period of time.

[0038] The information processing device 1 detects that the product has been moved (placed) on the product stand A1b based on the signal from the weight sensor 4b. For example, the information processing device 1 detects that the product has been moved to the product stand A1b when the weight calculated based on the signal from the weight sensor 4b increases.

[0039] Shoplifting Flag If the information processing device 1 sets the product detection flag to H state and then sets the product movement flag to H state without receiving a product code scan flag that is in H state, the information processing device 1 sets the shoplifting flag to H state for a certain period of time. That is, if the information processing device 1 detects a product based on an image from the camera 3 and then detects that the product has been moved to the product stand A1b without receiving a product code scan flag from the scanner 2, the information processing device 1 sets the shoplifting flag to H state for a certain period of time. That is, if a customer moves a product from the product stand A1a to the product stand A1b without scanning the product using the scanner 2, the information processing device 1 determines that shoplifting has occurred.

[0040] Although each flag described above is a positive logic (active high), it may be a negative logic (active low). For example, the information processing device 1 may set the commodity detection flag to the L state while the image data received from the camera 3 includes an image of a commodity.

[0041] The operation timing will be explained below. In the explanation of the operation timing in Figure 2, it is assumed that a customer is shoplifting. The customer takes an item from product stand A1a and moves it to product stand A1b without scanning the product code of the taken item with scanner 2.

[0042] 2, the information processing device 1 detects a product removed from the product stand A1a based on image data from the camera 3, and sets the product detection flag to H. Thereafter, the information processing device 1 sets the product movement flag to H, and sets the product detection flag to L.

[0043] If the information processing device 1 sets the product detection flag to H state and then sets the product movement flag to H state without receiving a product code scan flag that is in H state, the information processing device 1 sets the shoplifting flag to H state. In other words, the information processing device 1 determines (detects) that shoplifting has occurred, assuming that the customer has taken out the product from the product stand A1a and moved it to the product stand A1b without scanning it with the scanner 2.

[0044] When the information processing device 1 detects shoplifting by a customer, it displays a message to discourage shoplifting, such as "Please scan the product," on the display 5. Alternatively, the information processing device 1 notifies a mobile terminal carried by a store clerk that shoplifting has occurred.

[0045] 2. Timing of Actions when Shoplifting is Not Occurring #1 3 is a diagram illustrating the operation timing of the information processing device 1 when no shoplifting has occurred. The operation of the flag shown in FIG. 3 is the same as the operation of the flag described in FIG. 2, and therefore a description thereof will be omitted.

[0046] 3, it is assumed that the customer is not shoplifting. The customer takes an item from product stand A1a and scans the product code of the item with scanner 2. The customer then moves the item whose product code has been scanned to product stand A1b.

[0047] 3, the information processing device 1 detects the product removed from the product stand A1a based on the image data from the camera 3 and sets the product detection flag to H. After that, when the information processing device 1 receives a product code scan flag from the scanner 2, it sets the product detection flag to L as shown in FIG.

[0048] The product scanned by the scanner 2 is moved to the product stand A1b. Therefore, the information processing device 1 sets the product movement flag to the H state as shown in FIG.

[0049] After setting the merchandise detection flag to H state, the information processing device 1 receives a merchandise code scan flag in H state, and when it sets the merchandise movement flag to H state, it does not set the shoplifting flag to H state.

[0050] That is, the information processing device 1 determines that the customer has taken an appropriate product purchase action when the customer takes out a product from the product stand A1a, scans the product with the scanner 2, and moves the product to the product stand A1b.

[0051] 3. Timing of Actions when Shoplifting is Not Occurring #2 Fig. 4 is a diagram illustrating the operation timing of the information processing device 1 when no shoplifting has occurred. The operation of the flag shown in Fig. 3 is the same as the operation of the flag described in Fig. 2, and therefore a description thereof will be omitted.

[0052] 4, it is assumed that the customer is not shoplifting. The customer takes an item from the product stand A1a, and returns it to the product stand A1a without scanning the product code of the item with the scanner 2.

[0053] In addition, a customer may return the product to the product stand A1a without scanning the product code if, for example, the product taken from the product stand A1a is light, since products stored in a customer's shopping basket are generally placed with the heavier product at the bottom.

[0054] As shown in Fig. 4, the information processing device 1 detects the product removed from the product stand A1a based on image data from the camera 3, and sets the product detection flag to H. After that, when the information processing device 1 sets the product return flag to H, it sets the product detection flag to L and disables (resets) product detection as shown in Fig. 4. By disabling product detection, that is, by making it appear as if the product was not removed from the product stand A1a, the information processing device 1 does not set the shoplifting flag to H.

[0055] In other words, the information processing device 1 will not determine that shoplifting has occurred (will not falsely detect that shoplifting has occurred) if the customer removes a product from the product stand A1a and returns the product to the product stand A1a, even if the customer does not scan the removed product with the scanner 2.

[0056] (Block diagram) 5 is a diagram showing an example of a block configuration of the information processing device 1. As shown in FIG.

[0057] The control unit 11 controls the entire information processing device 1. The control unit 11 may be configured by a processor such as a CPU (central processing unit), for example.

[0058] The control unit 11 includes a merchandise detection unit 11a, a merchandise movement monitoring unit 11b, a shoplifting determination unit 11c, and an alarm generation unit 11d. The control unit 11 may realize the functions of each of the above-mentioned units in accordance with a program stored in the storage unit 12.

[0059] The commodity detection unit 11a detects whether or not an image captured by the camera 3 includes an image of a commodity, based on image data from the camera 3. When an image captured by the camera 3 includes an image of a commodity, the commodity detection unit 11a outputs, for example, an H-state commodity detection flag to the shoplifting determination unit 11c.

[0060] The commodity detection unit 11a may use, for example, a technology such as the image recognition service of Azure (registered trademark) to detect whether or not an image of a commodity is included in the image captured by the camera 3. The commodity detection unit 11a is only required to detect whether or not a commodity is included in the image of the image data received from the camera 3, and does not need to detect commodity information such as the name and price of the commodity.

[0061] The product movement monitor 11b calculates the weight of the product on the product stand A1a based on the signal from the weight sensor 4a. Based on the calculated weight, the product movement monitor 11b monitors whether the product has been removed from the product stand A1a and returned to the product stand A1a. When the product has been removed from the product stand A1a and returned to the product stand A1a, the product movement monitor 11b outputs, for example, an H-state product return flag to the shoplifting determination unit 11c for a certain period of time.

[0062] Furthermore, the product movement monitor 11b calculates the weight of the product on the product stand A1b based on the signal from the weight sensor 4b. The product movement monitor 11b monitors whether or not a product has been placed on the product stand A1b based on the calculated weight. When a product is placed on the product stand A1b, the product movement monitor 11b outputs, for example, a product movement flag in the H state to the shoplifting determination unit 11c for a certain period of time.

[0063] The shoplifting determination unit 11c determines whether shoplifting has occurred based on the scanner information (product code scan flag) of the scanner 2, the product detection information (product detection flag) of the product detection unit 11a, and the product movement information (product return flag and product movement flag).

[0064] For example, if the shoplifting determination unit 11c receives a product detection flag in the H state, and then receives a product movement flag in the H state without receiving a product code scan flag in the H state, it determines that shoplifting has occurred.

[0065] For example, when the shoplifting determination unit 11c receives a product code scan flag in the H state after receiving a product detection flag in the H state, it determines that the customer has made an appropriate product purchase.

[0066] For example, if the shoplifting determination unit 11c receives a product detection flag in the H state and then a product return flag in the H state, it changes the product detection flag from the H state to the L state (disabled). The shoplifting determination unit 11c disables the product detection flag and determines that the product was not detected, and therefore determines that the customer has made an appropriate product purchase even if it does not receive a product code scan flag in the H state. Note that in this case, the customer returned the product without scanning the product code, so the customer's purchase of the product is not confirmed. However, the shoplifting determination unit 11c determines that the product purchase was made appropriately, in the sense that the series of actions related to the purchase of the product did not include any actions that could be suspected of being shoplifting or other fraudulent.

[0067] When the shoplifting determination unit 11c determines that shoplifting has occurred, the alarm generation unit 11d generates alarm information. For example, the alarm generation unit 11d generates image data of an image including text such as "Please scan the product." The image data is transmitted to the display 5 via the communication unit 13.

[0068] Furthermore, the alarm generation unit 11d generates, for example, an alarm signal. The alarm signal is transmitted to a portable terminal carried by the store clerk via the communication unit 13. The portable terminal that receives the alarm signal notifies the store clerk of the occurrence of shoplifting, for example, by sound.

[0069] The storage unit 12 stores an operating system (OS) program and application programs to be executed by the control unit 11. For example, the storage unit 12 stores an application program that processes payments at a self-checkout counter and monitors shoplifting attempts. The storage unit 12 also stores various data necessary for processing by the control unit 11. The storage unit 12 may be, for example, a solid state drive (SSD), random access memory (RAM), flash memory, read only memory (ROM), and / or a hard disk drive (HDD).

[0070] The communication unit 13 communicates, by wire or wirelessly, with the scanner 2, camera 3, weight sensors 4a and 4b, and display 5. The communication unit 13 also communicates wirelessly with a mobile terminal carried by a store clerk.

[0071] (Operation flow) FIG. 6 is a flowchart showing an example of the operation of the information processing device 1.

[0072] The information processing device 1 determines whether or not the customer has scanned all of the products placed on the product stand A1a with the scanner 2 (S1). The information processing device 1 may determine whether or not all of the products placed on the product stand A1a have been scanned with the scanner 2 based on, for example, a signal from the weight sensor 4a.

[0073] If the information processing device 1 determines that the customer has scanned all of the products placed on the product stand A1a with the scanner 2 (Yes in S1), it performs the transaction process (S2). The information processing device 1 then ends the process of the flowchart in FIG.

[0074] If the information processing device 1 determines that the customer has not scanned all of the products placed on the product stand A1a with the scanner 2 (No in S1), it determines whether the product images are included in the image captured by the camera 3 (whether the products have been detected) (S3). That is, the information processing device 1 determines, for example, whether the customer has removed the products from the product stand A1a (whether the customer has picked up the products).

[0075] If the information processing device 1 determines that the image from the camera 3 does not include a product image (No in S3), it repeats the process of S3.

[0076] When the information processing device 1 determines that the image captured by the camera 3 includes a commodity image (Yes in S3), it determines whether the customer has returned the commodity to the commodity stand A1a based on the signal from the weight sensor 4a (S4). For example, the information processing device 1 determines that the customer has returned the commodity to the commodity stand A1a based on the signal from the weight sensor 4a.

[0077] If the information processing device 1 determines that the customer has returned the product to the product stand A1a (Yes in S4), it disables product detection (S5). Then, the information processing device 1 shifts the process to S3 and determines whether the image captured by the camera 3 includes a product image.

[0078] If the information processing device 1 determines that the customer has not returned the product to the product stand A1a (No in S4), it determines whether the customer has moved the product to the product stand A1b (S6). For example, the information processing device 1 determines whether the customer has moved the product to the product stand A1b based on a signal from the weight sensor 4b.

[0079] If the information processing device 1 determines that the customer has not moved the product to the product stand A1b (No in S6), it proceeds to S4 and determines whether the customer has returned the product to the product stand A1a.

[0080] When it is determined that the customer has moved the product to the product stand A1b (Yes in S6), the information processing device 1 determines whether the product has been scanned (S7).

[0081] If the information processing device 1 determines that the product has been scanned (Yes in S7), that is, if it determines that the product moved to the product stand A1b has been scanned, it transitions to S1 and determines whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0082] If the information processing device 1 determines that the products have not been scanned (No in S7), that is, if it determines that the products moved to the product stand A1b have not been scanned, it determines that shoplifting has occurred (S8). If the information processing device 1 determines that shoplifting has occurred, it generates alarm information and an alarm signal, and proceeds to determining (S1) whether the customer has scanned all of the products placed on the product stand A1a with the scanner 2. This allows the customer who has been notified of the alarm to have an opportunity to scan the products again with the scanner 2.

[0083] If the customer is not given an opportunity to rescan the product when shoplifting is determined, the cash register operation may be terminated abnormally, an alarm may be displayed on the cash register screen, and subsequent cash register operations may be stopped. In this case, the fact that shoplifting has occurred may be notified to a terminal held by a store clerk or a base station.

[0084] When it is determined that the products have been scanned (Yes in S7), the information processing device 1 proceeds to S1 and determines whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0085] (Summary of the first embodiment) The information processing device 1 detects that a product has been removed from the product stand A1a, where products are placed before their product codes are scanned. The information processing device 1 determines that shoplifting has occurred when the detected product is placed on the product stand A1b, where products are placed after their product codes are scanned, without having its product code scanned. The information processing device 1 disables product detection when the detected product is returned to the product stand A1a without its product code being scanned. This operation allows the information processing device 1 to prevent false shoplifting detection. For example, if a customer removes a product from the product stand A1a and returns it to the product stand A1a without scanning it, the information processing device 1 disables product detection. Therefore, the information processing device 1 does not determine that shoplifting has occurred because a scan was not performed despite the product being detected, thereby preventing false shoplifting detection.

[0086] <Second embodiment> A customer may attempt to scan an item with the scanner 2 but stop, and neither return the item to the item stand A1a nor place it on the item stand A1b. For example, a customer may remove an item from the item stand A1a and place it on a stand between the item stands A1a and A1b. Also, for example, a customer may remove an item from the item stand A1a and continue to hold the removed item in their hand. In the second embodiment, if an item is removed from the item stand A1a and not placed on the item stand A1b, it is not determined that shoplifting has occurred.

[0087] The following describes the differences from the first embodiment. Note that the self-checkout system in the second embodiment is the same as the self-checkout system in the first embodiment.

[0088] (Operation timing) Fig. 7 is a diagram illustrating the operation timing of the information processing device 1 according to the second embodiment. The operations of the product code scan flag, product detection flag, product return flag, product movement flag, and shoplifting flag shown in Fig. 7 are the same as the operations of the flags described in Fig. 2, and therefore the description thereof will be omitted.

[0089] 7 shows a shoplifting enable flag in addition to the above flags. After setting the product detection flag to H, if the scanned product return flag is L and the product movement flag is L, the information processing device 1 sets the shoplifting enable flag to L. If the shoplifting enable flag is L, the information processing device 1 does not determine that shoplifting has occurred (does not set the shoplifting flag to H).

[0090] 7, it is assumed that a customer removes an item from product stand A1a and places it on a stand between product stands A1a and A1b. Then, the customer places the item on product stand A1b without scanning it with scanner 2.

[0091] As described above, after setting the merchandise detection flag to H state, if the scanned merchandise return flag is L state and the merchandise movement flag is L state, the information processing device 1 sets the shoplifting enable flag to L state. If the shoplifting enable flag is L state, the information processing device 1 does not set the shoplifting flag to H state.

[0092] That is, for example, when an item is placed on a stand between item stand A1a and item stand A1b, or when a customer is holding an item in their hand, the information processing device 1 sets the shoplifting enable flag to the L state. When the shoplifting enable flag is in the L state, the information processing device 1 does not set the shoplifting flag to the H state. This operation prevents the information processing device 1 from erroneously determining that shoplifting has occurred when, for example, a customer places an item on a stand between item stand A1a and item stand A1b, or when the customer is holding an item in their hand.

[0093] (Block diagram) The block configuration of the information processing device 1 in the second embodiment is the same as the block configuration shown in Fig. 5. However, the function of the shoplifting determination unit 11c is different. After setting the merchandise detection flag to H state, if the scanned merchandise return flag is L state and the merchandise movement flag is L state, the shoplifting determination unit 11c in the second embodiment does not determine that shoplifting has occurred.

[0094] (Summary of the second embodiment) The information processing device 1 detects a product removed from the product stand A1a, and does not determine that shoplifting has occurred until the detected product is returned to the product stand A1a and placed on the product stand A1b. This operation enables the information processing device 1 to prevent erroneous shoplifting detection.

[0095] <Modification> Modifications will now be described. The modifications are applied to the first and second embodiments unless otherwise specified.

[0096] (Variation 1) The detection of the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b is not limited to the method using the signals from the weight sensors 4a and 4b. The information processing device 1 may also detect the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b based on camera images.

[0097] The camera for detecting the removal of products from product stand A1a, the return of products to product stand A1a, and the movement of products to product stand A1b may be camera 3 or a camera separate from camera 3. When using a camera separate from camera 3, for example, one of the two cameras may be installed above product stand A1a to capture the area around product stand A1a, and the other camera may be installed above product stand A1b to capture the area around product stand A1b. When camera 3 is used, a wide-angle camera is desirable to capture images of product stands A1a and A1b.

[0098] The sensor is not limited to a weight sensor or a camera, as long as it can detect the removal of a product from the product stand A1a, the return of a product to the product stand A1a, and the movement of a product to the product stand A1b.

[0099] (Variation 2) The information processing device 1 may not determine that shoplifting has occurred when a product is returned to the product stand A1a after being scanned by the scanner 2. When a product is returned to the product stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen on the display 5 indicating that the product has been returned to the product stand A1a. Alternatively, when a product is returned to the product stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen on the display 5 urging the user to move the scanned product to the product stand A1b.

[0100] (Variation 3) The information processing device 1 may determine that shoplifting has occurred if it detects a product based on an image from the camera 3, but does not detect that the product is scanned by the scanner 2 and that the product is placed on the product stand A1b. A case in which the product is not scanned by the scanner 2 and that the product is not placed on the product stand A1b may be considered to be a case in which none of the following three conditions are met. Condition 1: It is detected that a product has been returned to product stand A1a. Condition 2: A product was detected to have been placed on product stand A1b. Condition 3: Any of the following is detected based on the image from Camera 3: Condition 3a: It is detected that a product has been placed on a platform where product scanning is performed (for example, a platform between product platform A1a and product platform A1b). Condition 3b: The product is detected as being held in the hand.

[0101] (Variation 4) The cart may be provided with a weight sensor that wirelessly transmits a signal corresponding to the weight of the product placed in the cart to the information processing device 1.

[0102] If the cart is equipped with a weight sensor, the customer can take an item out of the cart and scan it with the scanner 2 without placing it on the item stand A1a.

[0103] Note that a cart placed near the product stand A1a may be photographed by a camera (or camera 3) that photographs the periphery of the product stand A1a described in Modification 1. The information processing device 1 may determine whether a product is being removed from the cart or returned to the cart based on the image from the camera (or camera 3).

[0104] In other words, the configuration of this modified example can be said to be a configuration in which the product stand A1a is arranged on the cart.

[0105] Note that the product stand A1a may be provided on both the stand A2 and the cart. In this case, the product stand A1a provided on the stand A2 and the product stand A1a provided on the cart may be treated without distinction. For example, when a product is removed from the product stand A1a provided on the cart and moved to the product stand A1a provided on the stand A2, the product is moved between the cart and the stand A2, but the cart and the stand A2 may be treated without distinction and the product may be treated as having been returned to the product stand A1a.

[0106] (Variation 5) The information processing device 1 may cancel the disabling of merchandise detection and enable merchandise detection again when the following occurs. After the product is returned to the product stand A1a, it is detected that the next product has been removed from the product stand A1a based on the signal from the weight sensor 4a. After the product is returned to the product stand A1a, it is detected based on the image from the camera (or camera 3) that the next product has been taken out of the product stand A1a.

[0107] (Variation 6) The information processing device 1 may determine that shoplifting has occurred when the product is not detected based on the image from the camera 3 and the product is placed on the product stand A1b without being scanned by the scanner 2. In other words, the information processing device 1 may determine that shoplifting has occurred when a customer places the product on the product stand A1b so as not to be photographed by the camera 3.

[0108] (Variation 7) The information processing device 1 may determine that shoplifting has not occurred if it detects that an item has been placed on the item stand A1a but does not perform item detection based on the image from the camera 3 and the item is not scanned by the scanner 2. This is because if an item has been placed on the item stand A1a but does not perform item detection and the item is not scanned by the scanner 2, it is assumed that the customer has moved to another cash register.

[0109] (Variation 8) The information processing device 1 may determine whether or not a product has been moved from the product stand A1a to the product stand A1b based on signals from the weight sensors 4a and 4b. For example, the information processing device 1 may determine that a product has been moved from the product stand A1a to the product stand A1b when the increase in weight on the product stand A1b is the same as (including approximately the same as) the decrease in weight on the product stand A1a.

[0110] The present invention can also prevent false shoplifting detections when the camera detects objects other than merchandise, such as wallets, cards, smartphones, mobile devices, receipts, customer shoes, etc. Even if these non-merchandise items are not detected by barcode scanning and are detected as objects, false shoplifting detections can be prevented as long as they are not placed on the merchandise stand A1b.

[0111] Furthermore, the product stand A1a, the barcode scanning operation, and the product stand A1b may be monitored with a single wide-angle camera.

[0112] Shoplifting may also be determined using movement history information of the product, which includes product stand A1a, barcode scanning, and movement to product stand A1b. For example, if a product taken from product stand A1a is detected by object detection without being detected by barcode scanning and then moved to product stand A1b, shoplifting is determined to have occurred. In this case, if the product is not detected as having been moved to product stand A1b, shoplifting is not determined to have occurred.

[0113] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims. It is understood that such modifications or alterations also fall within the technical scope of the present disclosure. Furthermore, the components in the embodiments may be combined in any manner without departing from the spirit of the present disclosure.

[0114] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuitry," "... assembly," "... device," "... unit," or "... module."

[0115] The present disclosure can be realized by software, hardware, or software linked to hardware. Each functional block used in the description of the above embodiments may be partially or entirely realized as an LSI, which is an integrated circuit, and each process described in the above embodiments may be partially or entirely controlled by a single LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of a single chip that includes some or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may be called an IC, system LSI, super LSI, or ultra LSI.

[0116] The integrated circuit method is not limited to LSI, but may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, a field programmable gate array (FPGA) that can be programmed after LSI manufacturing, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells within the LSI, may be used. The present disclosure may be realized as digital processing or analog processing.

[0117] Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology or other derivative technologies, it is natural that such technology may be used to integrate functional blocks. The application of biotechnology, etc. is also a possibility. [Industrial Applicability]

[0118] The present disclosure is useful for preventing shoplifting at self-checkout registers. [Explanation of symbols]

[0119] 1. Information processing equipment 2,2a,2b scanner 3 Camera 4a, 4b Weight sensor 5. Display A4a, A4b Product stand

Claims

1. a detection unit that detects that a product has been removed from a first product table on which the product is placed before its product code is scanned; a determination unit that determines that shoplifting has occurred when a product detected by the detection unit is placed without being scanned on a second product placement table on which a product is placed after its product code has been scanned; Equipped with When a commodity detected by the detection unit is returned to the first commodity stand without being scanned, the determination unit treats the commodity as not having been detected by the detection unit. Information processing device.

2. the determination unit does not determine that shoplifting has occurred while the product detected by the detection unit is not returned to the first product stand and is not placed on the second product stand. The information processing device according to claim 1 .

3. The determination unit detects that the product removed from the first product stand has been returned to the first product stand based on a signal from a weight sensor provided on the first product stand or image data from a camera. The information processing device according to claim 1 .

4. The first product stand is provided for a cart containing products before their product codes are scanned. The information processing device according to claim 1 .

5. The determination unit Detecting that the product removed from the first product stand has been returned to the first product stand based on a signal from a weight sensor provided on the cart or image data from a camera; When a commodity detected by the detection unit is returned to the first commodity stand without being scanned, the commodity is treated as not having been detected by the detection unit. The information processing device according to claim 4 .

6. The determination unit detects that a product has been placed on the second product stand based on a signal from a weight sensor provided on the second product stand or image data from a camera. The information processing device according to claim 1 .

7. the determination unit determines that shoplifting has occurred when the detection unit does not detect a product and a product whose product code is not scanned is placed on the second product table. The information processing device according to claim 1 .

8. The detection unit detects that the product has been removed from the first product table on which the product code has not yet been scanned, a determination unit determining that shoplifting has occurred when the product detected by the detection unit is placed without being scanned on a second product placement table on which the product is placed after the product code has been scanned; When a commodity detected by the detection unit is returned to the first commodity stand without being scanned, the determination unit treats the commodity as not having been detected by the detection unit. A method for suppressing false shoplifting detections.

Images